Update 2: They have restored our old network card in a different slot, we are hoping this resolves the issue, but if it does not, we will switch to the newly installed backup network connection, that while significantly slower, is much more reliable.
We have also handed out a full free month of credit for this, but please be aware that we are now unable to hand out any further credit for any related incident that comes in the next few months, but we promise that we will be on it as soon as possible, and if the issue persists, we will switch to our backup network connection until we can get someone to check the server in person.
Update: The new network card has been installed but the server now refuses to boot, we have asked them to reinstall the old one in a different slot to see if that solves the problem.
One of our servers that holds a large number of customers has had persistent network card issues which cause the link state to go down while the server is running.
It has failed again today.
We have decided to ask the data centre to swap to a new network card immediately, while the server is already down, it should be complete within an hour.
We will be issuing a full month of server time as credit to every customer on this server, I can only personally apologise for the issues caused from this, we don't yet have the infrastructure to run our services as high availability, but this is something we will be moving to in future to avoid downtime from issues like this.