Hey there,

Sorry for the delayed response. If you can answer a couple questions it may help us figure out the root cause.
  • How long have you had this issue?
  • Is your Xbox One connected directly to the Internet via an Ethernet cable or are you using Wifi?

Try out these steps and see if things improve.