I don't think you should necessarily switch to bright colors, that may just draw attention.

I can't think of anything you mentioned being bad or whatever, but a lot of people in college are still basically high schoolers. If you don't quote Will Ferrell and shit, and are just a polite, kind of quiet person, they'll call you weird. Enjoy the good friends you have.