Is there no way to "Empty" or "Clear" and entire album's contents so the album names are retained rather than deleting them?
Click "edit files" next to the thumbnail that represents the album, then click "Delete ALL files" at the top, scroll to the bottom, click "apply modifications".