> What is Puerto Rico?

A military base.

> Does this mean as a US citizen that I can just go to Puerto Rico whenever I feel like it?

Don't be ridiculous. Nobody wants to go to Puerto Rico.

> Why is it not considered a state?

Because if it was a state you'd have to raise their standard of living and let them vote.