Now that I’ve removed a number of unused PPAs, removed “Proposed” packages, and hopefully gotten the web server better prepared for a distribution update, I am going to take the server down for approximately an hour between 10pm-11pm tonight to make another image backup prior to another distribution upgrade attempt.

     This will affect https://friendica.eskimo.com/, https://hubzilla.eskimo.com/, https://nextcloud.eskimo.com/, and https://www.eskimo.com/ as well as any shared hosting customers during this interval.

     Ubuntu has successfully been upgraded to Jammy Jellyfish 22.04 LTS.

     Microsoft Visual Studio Code is no longer installed.  If you were using this please let me know and I will re-install.

     Because at some point I got the proposed archive enabled on Ubuntu, there are incorrect versions of a lot of software installed on Ubuntu making upgrading impossible.  I have to de-install all this stuff, upgrade, and then re-install.  So Ubuntu is going to be marginally functional while this is in progress.  I hope that I can complete this over the weekend.  In the meantime if something you need is among that removed, please use Debian, Mint, Zorin, or MxLinux, and if what you need is not present on them please use the ticket system to request what you need be installed.

     I am backing out the partial Ubuntu upgrade and restoring from backups tonight and will attempt again tomorrow.

     I am going to take the shell server, ubuntu.eskimo.com, and the web server www.eskimo.com down for maintenance tonight between 10pm-11pm to make backups prior to upgrading from Ubuntu 20.04 Focal to Ubuntu 22.04 Jammy.

     After the backups I will begin upgrade.  I do not anticipate long downtime for Ubuntu for the actual upgrade, only a reboot, however the webserver will take someone long as the change from OpenSSL 1.1.1 to OpenSSL 3.0.1 will require recompiling httpd.

     This will affect https://friendica.eskimo.com/, https://hubzilla.eskimo.com/, and https://nextcloud.eskimo.com/ as well as all virtual domains hosted with us.  I do not expect this to take more than 10-15 minutes for the actual upgrade as apache should continue to run until I reboot.

     I have to ask that you not mail payments until further notice as TIna, Raymond, and myself are all down with Covid-19.

     We are all doing alright so far, staying in our heads and not going into our lungs, good oxygen saturation status, mild fevers.  Pretty much the symptoms of your average head cold thus far.  Tina and I have been sick since Friday, Raymond just got sick today.

     We are pretty sure we know who exposed us to this and it was a triple jabbed moron that works with Tina that got it after being exposed to his sister but continued to walk around the store with it for a week anyway.

     Kernel upgrades are completed, all machines are operational.

     I will be doing another kernel upgrade this Friday between 11pm-midnight requiring reboots of all machines.

     As I feared, there were bugs introduced in NFS, particular an issue with delayed requests in NFSD causing the daemon to die (nfs server daemon).  While I have not encountered this yet it is a documented problem so going to upgrade to fix.

     Also some issues where introduced into KVM/QEMU used for hosting virtual machines.  Again, I haven’t experienced these but it is a race condition and so just a matter of time.

     With respect to Nextcloud, still no fix from the developers.  I’m going to attempt a re-install while keeping the existing database.

     I apologize if Nextcloud is not working for you at the moment.  I attempted an upgrade yesterday and it failed resulting in file integrity check failing for a bunch of files.

     I opened a ticket for this and found out many others are experiencing the same thing for this release, but as of yet there is no fix.

     I intent to take the mail and web servers down tonight at 11pm to make backup images.  This is just a way to quickly restore the mail server or web server if something catastrophic happens to their file systems.  The mail server should take about 1/2 hour and the web server probably similar.  Don’t know exactly as I have not made an image backup since moving it to flash storage.