I'm thinking that you need to make sure your blade is stretched TIGHT as well, to ensure it cant bow sideways and follow the grain as easily. Tighter is better!
I check by pushing some on the side of the blade (not running) and look to see how far it flexes with light pressure, I try to keep it under a 1/16" and periodically check again after running a while to see if it stretched and re tighten it if necessary. I've gotten used to the feel when I turn the tightening knob and know when to stop. It's just a matter of doing it over and over to get the feel, and to see what works for you..
I hope this helps and good luck.
Gabby