This can happen with the mods on the server. All you have to do is go to connect directly to the server you was travelling to. Once you are on the server, spawn in your survivor. You should briefly see a screen saying 'Downloading survivor'
I got connection timeout when travelling to another server?