Hi Jon,
Try some of the following settings:
Rx jitter buffer size to 12
Rx jitter delay to 10
I also found that changing RTP tx mode to Continuous may help, although that causes a constant data stream.
If that doesn't help, then something in the router or even a switch is causing this problem.
73,
Mitch DJ0QN / K7DX