This SO answer really helped.

Essentially, a context is just a way to set the namespace on the client side when running kubectl so that you don't have to type out the namespace part of the command each time.

It would be nice to have the current namespace/context show up on the command line for every command, like I do with git for branches. Just to be safe.