That is what I originally thought, but I was not sure looking at the profiler results.
So now I know: I need to reduce the other processes to increase idle time, which should make performance better. (Or the performance issue is something the profiler doesn't track... But that is another problem for another day)
Thanks for the help!