Dispatches From The Geeks

News and Announcements from the MCS Systems Group

Endnote X7 Site Licensing

Thanks to initiative from Anthony Avarca in CNM, who polled the various divisions on interest level, we’ve now got site licensing for EndNote X7

Please note these links are for CELS (MCS, ALCF, EVS, BIO, CELS & associated institutes) employees only.  Do not distribute these files or licenses beyond your own use.  The distribution links will require you to login to your Box account to retrieve the files.

When X8 is released, we will make it available via the above links as well.  Please note macOS Sierra is not fully supported, however will be under X8.

Written by Craig Stacey

November 1, 2016 at 12:56 pm

Posted in Uncategorized

Emergency upgrade of login.mcs.anl.gov

Due to a zero-day exploit of a Linux kernel vulnerability, we need to upgrade the machines login1, login2, login3, and login4.mcs.anl.gov (collectively known as login.mcs.anl.gov).

These machines will be replaced with new builds matching what’s running currently on login2.mcs.anl.gov (Ubuntu Trusty 14.04), but with the latest Linux kernel.

These upgrades are happening as we speak. I apologize for the short notice, but the level of exposure from this vulnerability requires us to patch these machines as quickly as possible. Other machines throughout the infrastructure (but not externally exposed) will be updated throughout the next few days.

Thanks, and sorry for the hassle.


Craig

Written by Craig Stacey

October 20, 2016 at 5:38 pm

Posted in Uncategorized

Postponed: File Server Maintenance

Once again we have to push this off. We’re awaiting resolution from a vendor on a problem we’re having with backups before we make this move. We don’t have a timeline on this resolution, so at this point the maintenance is postponed until further notice. I will announce it at least a week in advance when we’ve rescheduled it. Thank you.

Written by Craig Stacey

October 6, 2016 at 2:32 pm

Posted in Uncategorized

compute001 back online

The upgrade took longer than expected (slightly exotic hardware, plus it takes forever to boot due to its 1.5TB of RAM). Please let us know any issues you encounter, missing packages, etc.

Once the last of the compute servers is up to date next week, we’ll start on the remaining linux desktops. If you want to be at the head of the queue, send us a note at help@cels.anl.gov.

Thanks!


Craig

Written by Craig Stacey

October 5, 2016 at 3:57 pm

Posted in Uncategorized

Compute server upgrades: compute001 9AM tomorrow

We pushed back a bit on the schedule previously announced. We’ve got compute001 slated for 9AM tomorrow, Wednesday 10/5, and next week we’ll finish off with stomp.

As before, during each rebuild, the machine will be unavailable for some portion of that day. We’ll announce the shutdown on the machine itself to all logged-in users 30 minutes prior to shutdown. After the machine is rebuilt, you’ll need to recreate any crontabs you had in place. Also note /sandbox is not backed up and data will be lost – never keep data in /sandbox that can’t be easily reproduced.

If you notice software packages missing or other oddities, please report them to help@cels.anl.gov.


Craig

From: <cels-systems-announce-bounces@lists.anl.gov> on behalf of Craig Stacey <stace@anl.gov>
Date: Tuesday, September 6, 2016 at 8:58 AM
To: "cels-systems-announce@lists.anl.gov" <cels-systems-announce@lists.anl.gov>
Subject: [Systems Announce] Compute server upgrades continue

We’re pushing through on updating the remaining 64 bit compute nodes to Ubuntu 14.04 Trusty. Here’s the schedule:

This week (through Sep 9)

thwomp.mcs.anl.gov

vanquish.mcs.anl.gov

Next week (Sep 12-16)

trounce.mcs.anl.gov

churn.mcs.anl.gov

Week 3 (Sep 19-23)

crush.mcs.anl.gov

crank.mcs.anl.gov

grind.mcs.anl.gov

Week 4 (Sep 26-30)

compute001.mcs.anl.gov

steamroller.mcs.anl.gov

Week 5 (Oct 3-7)

stomp.mcs.anl.gov

During each rebuild, the machine will be unavailable for some portion of that day. We’ll announce the shutdown on the machine itself to all logged-in users 30 minutes prior to shutdown. After the machine is rebuilt, you’ll need to recreate any crontabs you had in place. Also note /sandbox is not backed up and data will be lost – never keep data in /sandbox that can’t be easily reproduced.

If you notice software packages missing or other oddities, please report them to help@cels.anl.gov.

We’ll start this week’s batch of machines tomorrow (Wednesday, September 7).

Let us know if this presents any problems.

Written by Craig Stacey

October 4, 2016 at 11:39 am

Posted in Uncategorized

Gitlab Maintenance Complete: Proposed CIS Maintenance weekends for FY17.

First up, the Gitlab maintenance announced earlier today is complete. The UI is a bit different – seems to be a more unified interface between desktop/mobile, so if you don’t see what you expect, hit the “hamburger menu” up in the upper left corner.

Secondly, CIS has proposed the following potential maintenance weekends:

November 4-6, 2016

May 5-7, 2017 (APS Maintenance)

August 25-27, 2017 (APS Maintenance)

As noted, the May and August weekends are designed to coincide with APS Maintenance. There’s no set expectation of what is or isn’t going to be available for the above weekends, but here’s what you can expect:

* We (CELS) will likely time any upgrades we have to coincide with these.

* ANL business systems will likely be affected

* ANL network access could be affected, though that doesn’t necessarily affect MCS/LCF. But it might.

Bearing that in mind, please send me (stace@anl.gov) any objections to this maintenance schedule so I can forward up the chain.

Thanks!


Craig

Written by Craig Stacey

September 29, 2016 at 5:16 pm

Posted in Uncategorized

Postponed: File Server Maintenance

In prepping for the previously announced file server upgrade (we need to do it right, and smoothly), we discovered a couple of gotchas. When we scheduled it, I set this afternoon as a go/no-go decision point, and if we weren’t ready to do it today, there’s no way to reliably say we’d be ready to go on Saturday. As such, we’re pushing this work back a week. Tentative schedule is next Saturday, October 8, with the same details as the previous announcement. I’ll send an update next week to confirm. If that date causes issues for you, let me know and we’ll find a date that works for everyone.

Thanks for your patience!

Written by Craig Stacey

September 29, 2016 at 2:35 pm

Posted in Uncategorized

Brief outage for gitlab and xgitlab today at 4PM

We need to apply some updates and reboot the servers xgitlab.cels.anl.gov and gitlab.cels.anl.gov. This will happen at 4PM today. The outage shouldn’t take too long, but we’re scheduling an hour just in case. During this time, you won’t be able to visit or use repositories hosted there.

Let me know if this poses an undue inconvenience. Thanks!


Craig

Written by Craig Stacey

September 29, 2016 at 10:08 am

Posted in Uncategorized

File Server Maintenance, Saturday 10/1.

We’ve scheduled this Saturday, 10/1 from 9AM onward (all day) to finally migrate the rest of our unix homes off the aging file server onto our new one. To do this, we need to take the home filesystem offline. This will not affect e-mail, web, or other services beyond the MCS linux computing infrastructure (https://wiki.mcs.anl.gov/IT/index.php/Linux). During this period, you will not be able to login to any MCS workstations or compute servers, including login.mcs.anl.gov. After the migration is complete, all linux workstations and compute servers that use this home directory server will be rebooted.

If this poses an inconvenience to you that would require us to reschedule this, please let us know now. I will make another announcement on Thursday unless we reschedule due to your requests or issues we encounter in the prep for this.

Thanks!

Written by Craig Stacey

September 26, 2016 at 11:36 am

Posted in Uncategorized

Emergency file server reboot

We’re still seeing issues with our primary file server, and it’s resulting in severe degradation of service at this point, to where logins aren’t being handled. We’re going to be rebooting it shortly. Some machines may require a reboot after this is done. Stand by for updates.

Written by Craig Stacey

September 22, 2016 at 5:00 pm

Posted in Uncategorized