I sorta still have this problem, I find it helps to concentrate on looking forward rather than straightening my back, because my eyes sorta wander to the ground all the time...

Just focus on looking straight forward.