Mail is now available via webmail, smtp/pop3/imap.  I am still working on fixing mount points for shell servers.  Incoming will be backed up and take a little while to catch up.

     The physical machine is up and I have copied the mail spool to a new machine.  Now I am moving the virtual machines off of old hardware and changing mount points to reflect the mail spools new location.

     The physical host upon which the mail spool sits is down.  It is also the NIS slave that many of the machines slave off of so they won’t authenticate.

     I have to wait for a ride to get to where my car is and then from there make my way down to the co-location facility.  Because it will be rush hour by the time I get to my car it is going to take a while to get to the co-location facility.

     Once I get the mail server back up I am going to begin copying the spool from it to another physical machine and then move the virtual hosts off that box.  The fact that it has crashed twice in a weeks time suggests there is some marginal hardware issue with the machine.

     Since I had planned to upgrade it anyway I am going to move everything off the existing machine and then replace the motherboard, CPU, and memory.

     I hope to have the old hardware back up and operational by around 9AM.  It just depends upon how bad traffic is.

     There is something wrong with a DMA controller on the SS-10 chassis, I have two and they’re both cooked.  Going to bring the old server up on an LX, this is seriously under powered.  The SS-10 had two 120 Mhz CPUs, this will have one 40 Mhz,  The old machine had 512 MB of RAM, this will have 96 MB.  So it’s going to be slow as snails until I can locate another SS-10 chassis or find a way to dump the ROMS to a file so I can get emulation working.

     The old shell server is seriously broken.  It will not boot.  Gets data exception errors before you can even finish typing the boot command.  Brought it back home to try to determine what.  I’m thinking a bad DIMM or CPU is most likely.  I have no spares of either so if it is one of the two it is either going to return a single CPU box or with less memory.

     If anyone has any SS-10 hardware they want to get rid of or M-Bus CPUs or 64MB DIMMS these things used, I’d be happy to take it off your hand.

     This machine is the NIS master so I can not change passwords or enable or disable accounts until I get it operational.

     The mail server is up.  It was locked up hard, not even the Linux magic sys request key had any effect.  Power cycling it brought it back up.  Nothing in the logs useful to provide any post mortem information.

     This is the only Intel machine still running an I7-2600 rather than an i7-6700k.  I am planning  on upgrading it soon.  The i7-2600 only supports 32gb of RAM where the i7-6700k supports 64gb.  You can not give Linux too much RAM, it uses any excess for buffer and that improves performance.  There are some newer Intel CPUs available and I have not decided which I am going to go with yet.

     The old eskimo.com shell server is not responding.  I will need to make another trip down to the co-lo facility to fix that.  It is responding to pings but nothing else.  This is a wedged state the SunOS kernel occasionally gets into.

     The physical machine that hosts the mail spool has crashed.  I am on the way to the co-location facility to repair.  This is unrelated to the work I was doing.

     I will be rebooting the web server at approximately 2AM in order to make kernel and glibc updates effective.  This will take approximately five minutes.  Reboot on this machine is somewhat slow because of the use of caching of file systems in memory which provides faster web response but takes some time to flush upon a reboot.

     I replaced the 100 mbit switch by a new Linkeyes gigabit switch.  This is a made-in-china brand like TP-Link but unfortunately LinkSys no longer makes rack mount equipment, Cisco bought them out and discontinued those products and I’m not a big fan of Crisco equipment.  Hopefully this will last longer than the two TP-Link switches did.

     I am going to replace the 100mbit switch that I put in place temporarily when our last gigabit switch failed with a new gigabit switch made by a different manufacturer tonight.

     There will be very brief (under 2 seconds) interruptions in connectivity that may cause a momentary pause in videos being watched or keystroke echoes.  There is a remote possibility that I may have to reboot the mail server if it does not automatically recognize the speed change.  In the past it has always recognized increases but not decreases so this probably will not be necessary but it is a possibility.