Likes

— likes —
As a developer I like access to the shell. I run a couple of small jobs here so I
don’t need a server at home.

I also run some stuff on the web here.

I have recommended it to other IT folks I know because of the features and
knowledgeable folks. I care less that it may take some time to get an answer than I
do when the response is “What?”.

— likes —
$$ and shell

— likes —
Like that I can email you and always get an answer. Personal touch. Local company.
Professional Total package for maintaining my web site, making changes to it,
internet service. You should offer the total package to everyone including web
design and maintenance.

— likes —
Good Spam filtering and security

— likes —
I Like to make frnd

— likes —
love it, been a customer for over 20 years

— likes —
Tools I want to use for what I want to do. Email and chat are text and I use as such
(mutt & irssi). I should not be forced to use a gui and see too much eye candy for
either.

I can connect to sites of my choice not the ones cable provider filters me to.

I do not have to bloated OS here with much larger security profile.

— likes —
availability, longevity, recent improvements in the last year. Glad to see your back
on the job.

— likes —
shell access and being able to use mutt instead of webmail.

— likes —
Small family business run by real people.

Personal service.

Privacy–my account isn’t being mined for marketing data.

— likes —
–Small company
–Excellent and personal customer support
–Our webpage on Eskimo has worked well for almost 20 years!
–You got away from Integra.

— likes —
I like the fact that I can get dialup access and can use tools like (secure) telnet,
pine, etc. as alternatives to web-based browsing. I also like that it is a small
company and I talk to a real person when I have an issue. If I were a UNIX geek I am
sure I would like the UNIX accessibility too but it doesn’t affect me personally. I
like having a web version email client as an alternative so I can always access my
inbox no matter what kind of device I’m on.

— likes —
I can call or email for support and you folks really know what you are talking
about. I get responses in a timely manner and 9 of 10 times it has resolved the
issue I was having.

— likes —
I like the fact that Eskimo is an independent local company. If I have any problems
all I have to do is call or email the owner! 🙂

— likes —
I like that the website is a bit “old school”, which makes me thing of back in the
good IRC days when I was running Eggdrops on IRC and so on. I also likes the mailing
lists where you get a very clear update on what’s going on.

Another great thing about Eskimo North is that it’s providing services that a lot of
companies don’t provide anymore, such as shell access and so forth.

This is a great way for “old schoolers” to do e-mailing in Mutt and write HTML code
directly in the terminal.

I like the fact that Technical Support is excellent and Customer support in
generally is very good and very professional. You have a person with high knowledge
to communicate with. I don’t think all users these days realize how important that
is!

A lot of hosting companies these days are very big and automate as much as they can.

So my impression is that as a user at Eskimo someone actually listen, and you don’t
get the feeling of just being “someone” in an endless user database.

So, Eskimo clearly shows quality in front of quantity.

— likes —
You were a small OS/2 friendly ISP when my local ISPs wanted ASMTP. I didn’t have
to change any of my software then. . . really like the over-the-phone service

— likes —
Personal responses to my questions, some of which belie my rudimentary knowledge of
computing. I’ve never felt a sense of criticism from you when I’ve asked some very
basic questions.

— likes —
Excellent ISP. Everything always works and never an issue – for me. I have not
ever had an issue because when I call or email for support, my questions are
answered completely and there is no issue how to do things. Then again, I have over
30 years computing experience.

— likes —
Shell account and easy web page set up. Back up access via web mail is really nice
too.

— likes —
Simple Nix interface

— likes —
EVERYTHING

— likes —
I will like 2chat wit new people

— likes —
When I need help, a knowledgable, helpful person (human being) is easy to access by
phone or computer.

I was able to use it back in the early 1990s when it was Unix (as I recall) and I
was on the shell with my first laptop and at school on an apple with students and
our first steps with computers and the internet.

— likes —
About the sharing of love amongst the lover.

— likes —
Freedom to use shell account, compile and run applications. Ability to configure
email and utilities like procmail. Real human being for support. Excellent support
and communications. Reasonable pricing. Unthrottled DSL.

— likes —
Timely reports of system outages and problems and explanations of what happened and
what was done.

— likes —
I like the convenience of having a local company to do business with.

It’s easy to get a hold of someone on the phone.

Friendly service.

I’ve had my account for a very long time and I’m comfortable with it.

— likes —
The SSH CLI, in which Pine became gratifyingly quick after conversion to shellx host!

— likes —
I like being online!i like eskimo account since we are chatting and socialising with
many people world wide
!thank you alot the management of eskimo.

— likes —
Dealing with a company I know instead of an anonymous corporation.

Recent Posts

Outage Difficulties

First some background..

     Our old web server was over burdened, particularly when it came to RAM.  Also it booted off a rotary disk and only the mariadb was on nvme memory thus it was slow to boot.  Linux likes having a lot more RAM than it needs because it uses any not required by something else as I/O cache and this speeds up average disk latency considerably because frequently required items will always be in memory.  Cache was configured as write-back so system never slowed waiting on writes.  The disks themselves had 512MB buffers so even if it waited on the drive it would not have to wait for physical write to media.

     So I decided to build a new server, and for this new server I had several things on the wish list.  One, it would address more RAM, and for this reason primarily I went with an i9-10900x CPU.  This CPU could address 256GB of RAM and it had four memory channels instead of two.  It also had ten cores and twenty threads, a step up from six cores and twelve threads.  The primary limit to this CPU’s performance is cooling. It’s rated a TDP of 165 watts but this is at stock 3.6Ghz clock.  One does not buy a binned ‘X’ CPU to run at stock speed.

     Some testing revealed this was electrically stable up to about 4.7Ghz but at 4.7Ghz busy it drew 360 watts of power.  I used a Noctua 15D cooler, but rather than use the stock quiet fans, I used some noisy after market fans that produced about twice the CFM and about 10x the noise level but if you’ve ever been in a data center, noise is not a big concern.  With these fans testing revealed that it could keep the CPU at or below 90C at 4.6Ghz and at that speed it drew 320 watts.

     I wanted to avoid a water based cooler because at home you get a leak and you ruin a few thousand worth of equipment.  In a data center you get a leak, it goes into the under the floor power and you burn down a building and go out of business.

     So I only had to give up about 2-1/2% of the performance of this CPU to avoid water cooling, not bad.  Then I wanted everything on RAID and I wanted all the time sensitive data on nvram so it would go fast.  I tried to find a hardware nvme RAID controller but if they make such a beast I was unable to find one.  I could only find “fake raid” devices, these work with Whenblows but but not Linux.

     So I ended up going with software RAID.  The one thing I could not RAID was the EFI system partition because this is read by the machines UEFI and it does not know about Linux software RAID.  So while that was un-raided, I had duplicated the EFI system disk on each nvme drive so if one drive failed the system would still be bootable and all I had to do to keep them in sync was modify the scripts that installed a kernel to do a grub-install to both devices.

     And it worked for a while.  Then we lost our forth router there (fried) and at that point I decided to spring for a Juniper router.  The reason I went with this brand is that when we first moved our equipment to the co-lo at ELI, they used Junipers and we never once had a data outage there and they were not at all easy to packet flood which is what made it possible for us to run IRC servers there.  After Citizens bought them, they sold the Junipers and replaced them with Ciscos and packet flooding then took the whole co-lo center which basically left us in a situation where either we got rid of the IRC server or they got rid of us.  So having had such a good experience with the routers there I decided to go that route.  But it’s a command syntax I’m not entirely familiar with and I’m still learning (it is similar to Cisco’s but not the same).

     Meanwhile I decided to use one of the Linux boxes as a router and I used the newest server only because at the time it was the only machine with multiple interfaces.  But it was not stable routing and I did not understand why but after a bit I moved it to another machine that I just put a 1G Intel ethernet into it.  It ran for a bit then ate it’s interface card and became unstable.  I had some spare cards but they all had realtek chipsets.  What I didn’t know about Realtek is that the Linux drivers for them are absolute crap.  They work ok at 100mb/s but a 1Gb/s they randomly loose carrier or cycle up and down.  So I put one of these cards in a machine and set it up to act as a router, that lasted about two days before it crashed.  I went over and found no carrier lights, but after playing with it for a while I thought ok, this is just a bad card and so went to replace it thinking it was a 20 minute job.

     Three cards later and now 10AM the next day it still wasn’t working so I drove from the co-location facility down to Re-PC and picked up an Intel based industrial model 4-port card, these are much more robust requiring multiple PCIe lanes so  you need to use a big slot but that’s ok as I only had a wimpy graphics card that only required one.  That solved the networking issue for now.  The Juniper still will be a better solution but I could completely saturate the 1G interface so we’re not losing any speed with this arrangement.

     But the fun and games were still not over.  I got all of the machines up and running except the new web server.  For some reason it would not automatically assemble the RAID arrays and come up online.  It would go into emergency mode.  There I could type mdadm –assemble –scan and it would assemble the RAID partitions and I could mount them and bring the machine up, but if it crashed while I wasn’t there it would not come up on it’s own.  I spent until 6pm trying to troubleshoot and fix, in the past when this has happened it has always either been an issue with the EFI system partition, and I had already re-installed grub 32 times to no avail, or it was a problem with the initramfs, solved by re-creating it, but neither of those things were the cause and I wasn’t successful at locating the error causing it in the logs.

     So finally at 6pm I just re-installed Linux and resolved myself to recovering everything from backups.  So I re-installed Linux, went home, and by then 8pm, I had been working on this for about 33 hours without sleep (I had started working on it at home before deciding to go down and swap out the Network Interface cards).  So went to sleep.

     This morning I proceeded to work on installing software and restoring things from backups and getting the machine configured again and part of that process required a reboot, from which it did not recover.  So I drove to the co-lo thinking I just forgot to configure the proper boot partition in the UEFI bios or something like that and instead found it in the same condition it was in before I installed Linux.

     But this time after a number of attempts I caught an error message it through that was only on the screen for I would guess less than a tenth of a second and what I noticed was that it started with initrd, suggesting an issue with the initramfs, it took about ten more reboots to make out that the message was: initrd: duplicate entry in mdadm.conf file.

     So I checked and sure enough the system had added an entry to those I had entered by hand, identical.  So I took the extra entry out, did a chattr +i file to mark the file immutable so the operating system didn’t modify it for me again, and went home, hoping I could finish restoring it to service, but when I got home it was again dead.

     I drove back to the co-location center (and it is 25 miles each way) it was on but did not have power.  So I power cycled the power supply and it came back up, but by the time I got home it was dead again..  If I move the cord around it goes on and off so I am assuming there is a bad connection from the pin on the end side, maybe a cold solder joint or something.  At any rate, I ordered a new supply which should get here between 2pm-6pm tomorrow and will go back and replace it when it arrives.  Right now I also have one customer on this new machine, MartinMusic.com, so before I replace it I will try to grab the data for his website just in case it is something else so that I can put it on the old server until this one is solid.

     So hopefully I can get this stable and then go back to learning the Juniper syntax and get that installed.  Then I’m going to work on upgrading the old web server for other work.  The motherboard has one bad USB port on it now so not really sure how long it is going to last.

  1. Outage Leave a reply
  2. Maintenance Outage Leave a reply
  3. Outage Leave a reply
  4. Server Issues Leave a reply
  5. Carl Jung Comments Off on Carl Jung
  6. SSH Key Vulnerability Comments Off on SSH Key Vulnerability
  7. Outage Comments Off on Outage
  8. 6.1.57 Kernel Borked Comments Off on 6.1.57 Kernel Borked
  9. Stability or the Lack Thereof Comments Off on Stability or the Lack Thereof