I was unsuccessful at upgrading the web server last night but learned some more things and am going to make another stab tonight but before I start I am going to take it down for about 1/2 hour to make a backup as there was an upgrade to hubzilla today that I don’t want to accidentally back out.

     Then with respect to covid, Tina and Raymond, my wife and son who is still living with us, tested negative last night so they are getting over it.  I still tested positive but the line on the test was very weak.  And last night was the first night I’ve been able to sleep without intestinal and stomach pain in over a week and the congestion is down substantially so while I’m not totally over it I’m doing much better.

     I am going to make another attempt at updating the distro on the web server, if it fails there will be about a half-hour downtime to restore from backup, if it succeeds only a few minutes to reboot.

     Past attempts have failed because of library version mis-matches, I believe I’ve got a way to identify and fix the offending libraries.

     This will impact https://friendica.eskimo.com/, https://hubzilla.eskimo.com/, https://nextcloud.eskimo.com/, https://www.eskimo.com/, and all the shared hosting sites we host.

     Now that I’ve removed a number of unused PPAs, removed “Proposed” packages, and hopefully gotten the web server better prepared for a distribution update, I am going to take the server down for approximately an hour between 10pm-11pm tonight to make another image backup prior to another distribution upgrade attempt.

     This will affect https://friendica.eskimo.com/, https://hubzilla.eskimo.com/, https://nextcloud.eskimo.com/, and https://www.eskimo.com/ as well as any shared hosting customers during this interval.

     Ubuntu has successfully been upgraded to Jammy Jellyfish 22.04 LTS.

     Microsoft Visual Studio Code is no longer installed.  If you were using this please let me know and I will re-install.

     Because at some point I got the proposed archive enabled on Ubuntu, there are incorrect versions of a lot of software installed on Ubuntu making upgrading impossible.  I have to de-install all this stuff, upgrade, and then re-install.  So Ubuntu is going to be marginally functional while this is in progress.  I hope that I can complete this over the weekend.  In the meantime if something you need is among that removed, please use Debian, Mint, Zorin, or MxLinux, and if what you need is not present on them please use the ticket system to request what you need be installed.

     I am backing out the partial Ubuntu upgrade and restoring from backups tonight and will attempt again tomorrow.

     I am going to take the shell server, ubuntu.eskimo.com, and the web server www.eskimo.com down for maintenance tonight between 10pm-11pm to make backups prior to upgrading from Ubuntu 20.04 Focal to Ubuntu 22.04 Jammy.

     After the backups I will begin upgrade.  I do not anticipate long downtime for Ubuntu for the actual upgrade, only a reboot, however the webserver will take someone long as the change from OpenSSL 1.1.1 to OpenSSL 3.0.1 will require recompiling httpd.

     This will affect https://friendica.eskimo.com/, https://hubzilla.eskimo.com/, and https://nextcloud.eskimo.com/ as well as all virtual domains hosted with us.  I do not expect this to take more than 10-15 minutes for the actual upgrade as apache should continue to run until I reboot.

     I have to ask that you not mail payments until further notice as TIna, Raymond, and myself are all down with Covid-19.

     We are all doing alright so far, staying in our heads and not going into our lungs, good oxygen saturation status, mild fevers.  Pretty much the symptoms of your average head cold thus far.  Tina and I have been sick since Friday, Raymond just got sick today.

     We are pretty sure we know who exposed us to this and it was a triple jabbed moron that works with Tina that got it after being exposed to his sister but continued to walk around the store with it for a week anyway.

     Kernel upgrades are completed, all machines are operational.

     I will be doing another kernel upgrade this Friday between 11pm-midnight requiring reboots of all machines.

     As I feared, there were bugs introduced in NFS, particular an issue with delayed requests in NFSD causing the daemon to die (nfs server daemon).  While I have not encountered this yet it is a documented problem so going to upgrade to fix.

     Also some issues where introduced into KVM/QEMU used for hosting virtual machines.  Again, I haven’t experienced these but it is a race condition and so just a matter of time.

     With respect to Nextcloud, still no fix from the developers.  I’m going to attempt a re-install while keeping the existing database.