I've just consulted a grammar book, and found this sample sentence: I don't know whether to go to the party or not.
Is that wrong?