Why Would You Use WordPress Tags When The Categories Mainly Serve A Similar Purpose?

 

In episode 322 of our weekly Hump Day Hangouts, one participant asked why would you use WordPress tags when the categories mainly serve a similar purpose.

The exact question was:

What do you with with wordpress tags and why would you use them when categories mainly serve a very similar purpose?