Moving ollie turn problem?

I got good at my stationary ollies now and I started my moving olles yesterday on a board. Most of the time when I ollie my board turn 90 degrees and I stop moving. Some of the time I can ollie moving but not a lot. My street goes downhill so I can't go too slow on my ollies. Is there a way I can stop my board from turning? I know if I practice I will eventually get it but I want to know a faster way.