Thanks for mentioned article, I have tested before and as you mentioned on your post, I can't fix all problem.
I tested it with 2 vCPU and nothing changed, after increase vCPU to 4, voice quality was good.
So I recommend, if you don't have enough resources, analog headset and Teradici audio driver is better than this solution.