EM, are you referring to the MW 648 service, or on-line/smart speakers.
Because of the location of Orfordness, the internet is the only viable way of getting audio to the TX.
Yes, I agree there has been a problem now & then as you describe, due to internet congestion probably.
It is being worked on. Bear in mind, Caroline does not have the resources of the BBC, to have a dedicated audio feed.