The RRC do not know if you are listen to CW or Phone, it just transfer the audio so it was tricky to guess you really mean receive.
To increase the tolerance against jitter when receiving, increase the jitter buffer size and jitterbuffer delay in the Control-RRC
Check the manual for details.
73 de mike