Lightening up the pass cuts to at least .15" may give the best results...You're close!
But like Gerry said a Good, and Sharp bit is key as much or more than feeds and speeds.
What bit are you using?
Don't know if this would help, but I was in the habit of cleaning my router bits with a brass brush using what is now BladeCote after every use before I put it away(LIKE knowing ALL my bits are clean when I grab them quick on a long day)...and then continued the habit when I started CNC work. I used to think Bosch bits were top of the line before CNC, and found they were mid level.
Keep experimenting until you get the cut quality you want...THEN you can start gradually increasing Fees AND speeds together until the blend of quality vs time makes sense to you.
Every machine and wood is different....LISTEN and FEEL the machine while cutting, and you'll soon get a feel for your machine.
As long as the bit stays cool to the touch after a cut, and you're producing chips(even if they're small)....You're good to go regardless of chip load charts.
For my stuff the defaults were always to aggressive for top quality cuts.
I virtually ALWAYS run toolpaths twice Like Michael, as it saves so much hand work afterwards, and I'm lazy and would rather the machine spent time than me. Besides I have other work to do
Like Gerry and Martin say, atop coat of finish really only helps tearout on the material surface. Gerry's comment is similar to what I'd do on problematic material, Except I Zero as usual, then Nudge my Zero up what I'm seeing the tearout is(.01-.02"). Cut/apply finish/lower my Z zero down to original height, then cut again. Finicky, but I use oil finishes, and finish accentuates any tiny flaw.
You're getting better!