It may sound weird, but if you're on a laptop or a computer that supports wifi, try switching between the two. Sometimes the Ethernet cable you use may be malfunctioning, or a wifi chip is being dumb. Do you experience this problem with other games, or just Toribash?
You may need to reset your router if it's purely a problem With the internet