I mean "What color is the sky on your planet?", I never heard that expression.

As for something more generic, "Where are you from?" can be used as an insult. But I don't know if this was used in Victorian times. Maybe "Where are thou from?" :P

Whar is yo' fum?
Where is you fum?
Where are yer from?
www.rinkworks.com/dialect/