The server upgrades were challenging. The actual upgrades went fine, it’s what newer versions of software broke that was problematic. For example, nfs-kernel-server and nfs-common, those upgrades broke the NFS server’s ability to talk to eskimo.com which is a SunOS 4.1.4 machine although it worked fine with all, even very old, flavors of Linux. So I backed out the upgrade for those two packages.
Then the upgrade also upgraded php from 7.0 to 7.1, but many of our web applications are not yet compatible with 7.1, most notably squirrel mail. So I had to uninstall 7.1, and add a third party repository to re-install 7.0.
I believe everything is working but if you find something please generate a ticket, use Support->Ticket’s from https://www.eskimo.com/. Since I was up until 7:30AM, I will not be available before around 2pm.
I will be rebooting servers to complete the Ubuntu upgrade by booting into 4.13.x kernel.
I have upgraded my workstation and one mail server to Ubuntu 17.10 and the upgrades went more smoothly than any prior Ubuntu update I’ve ever done. My ancient Nvidia graphics card that has always been a hassle to get to work properly required no tweaking at all, drivers worked out of the box, this is a first in five years!
I am done doing server maintenance for the night. I kept Ubuntu down longer than expected in order to troubleshoot and fix an issue with the greeter. I had to uninstall and reinstall a lot of things to get it fixed. Hopefully did not break something else in the process.
I am going to be taking mx1, mx2, ubuntu and ftp/www down for about twenty minutes each, one at a time, starting around midnight, to image the machines in preparation for an upgrade to Ubuntu 17.10 on the 19th.
Server reboots all done. Unfortunately, it did not fix the ethernet udp offload code.
I will be rebooting the host machines (which in turn will reboot all the servers) to load a new kernel that fixes some issue with UDP offloading on the ethernet port that was introduced with the last kernel upgrade. Outages should be brief (approx 10 minutes each machine).
The apache web server has been upgraded to 2.4.28. This upgrade primarily fixes a problem where by it was possible to obtain random memory data under certain circumstances. Unfortunately, Apache caching still seems to occasional serve the wrong page.
Maintenance work for the night is completed. We’ll will have individual servers go down tomorrow evening and Saturday evening for about 15-30 minutes each in order to back up those servers in preparation for upgrade to Ubuntu 17.10.
This will affect mx1, mx2, ftp, ubuntu, and several other machines that are new and not yet fully in service.
I will be rebooting servers in about an hour to upgrade kernels and test a fix to systemd. If the fix works this will be a short interruption of about the minutes. If not it may take approximately 45 minutes.