With the mask selected, use a white paintbrush ... click the eye icon next to the original background layer. That will allow you to see your transparent background, but don’t delete the ...

Still, if you want to just quickly remove the white background from an image and make something transparent for use in a blog or making a meme, it's quite easy to do. Here's how.