Answer by forcefsck for How to solve 'Connection refused' errors in SSH connection?

This looks more of a problem of your network equipment than the server itself.

Check /var/log/messages for ethernet link up/downs (or wlan in case of wireless). If so try changing the cables.