I will be taking the web server down for approximately twenty minutes after midnight to image again with missing SSL certificates in place.
Maintenance on OpenSuse has been completed. Everything has been restored to service.
Maintenance has been completed on vps1. It has been restored to service.
Maintenance has been completed on the shell server Scientific and on the virtual private server vps4. Both have been restored to service.
Maintenance has been completed on Centos7. It has been returned to service.
I will be taking vps1 an vps4 down for about twenty minutes each in order to image the machines for possible future restoration.
The shell servers Centos7, OpenSuse, and Scientific are down to be imaged. This will take about an hour in total.
The imaging of the web server has completed successfully and it has been returned to service.
Our web server is slow currently because it is being hit with a denial of service attack from Amazon cloud server nodes. So far fail2ban has locked out 454 addresses, the majority being amazon nodes. As it locks out attacking addresses, the server load is slowly coming down.
The outage this afternoon was caused by a failed attempt to install ossn, an open source social network program onto our web site. Things seemed to work until I turned cache on then it went to a blank screen. I gave up and went to bed (about 6am).
This afternoon I discovered our website wasn’t responding, complaining of mysql descriptors, apparently ossn got stuck in some sort of loop and ate them all up. I’ve removed the program from the server until I can determine what is wrong.