Dispatches From The Geeks

News and Announcements from the MCS Systems Group

Copier installation for building 240 tomorrow (2/7/18)

Just a reminder the CELS copiers in Building 240 are being replaced tomorrow (except pr-5168, which was done this morning). Testing shows it should be painless. We’ve updated our documentation here:

https://wiki.mcs.anl.gov/IT/index.php/Printers

Expectation is linux desktops shouldn’t notice the change. Mac users may need to install the updated driver, but many did that when upgrading to Sierra or High Sierra. If you have issues, please contact us at help@cels.anl.gov and we’ll get you squared away.

Advertisements

Written by Craig Stacey

February 6, 2018 at 6:12 pm

Posted in Uncategorized

Replacement of Canon Printers in CELS

Hi, folks. Please see the note below from BIS on the plan to replace the canon printer/copiers in BIO, EVS, MCS, ALCF, and CELS. BIO and EVS are happening on Monday, and are supported by BIS. Also on Monday, we’re having the CELS printer on the 5th floor so we can get a handle on any changes we need to make. The remainder will be replaced on Wednesday, by which time we’ll have our documentation up to date.

Written by Craig Stacey

February 2, 2018 at 9:21 am

Posted in Uncategorized

Update: BIO File server UP (Z Drive, Y Drive)

The restores completed, we put the last pieces into place this morning. My testing shows workstations should be able to mount from the new file server . If you logout/login again or manually mount your file shares, they should work as expected.

Please report any issues to help@cels.anl.gov. Thanks!

— Craig

Written by Craig Stacey

February 1, 2018 at 8:12 am

Posted in Uncategorized

Update: BIO File server down (Z Drive, Y Drive)

The restore stopped overnight (due to the windows host it was running on applying updates and rebooting), so we lost about 8 hours of restore time. Right now, we’re at about 800GB left to restore (2.59TB out of 3.39TB total). When the restores are running, we’re achieving roughly 28 MB/sec (or, 100GB an hour).

In parallel, we’ve been working to make sure the permissions on the data is correctly restored and have put in the necessary firewall holes to allow BIO workstations to start talking to the new file server.

We’re going to keep an eye on it and make sure we can pre-stage as much as we need to do before releasing it to your machines. I expect this will happen first thing tomorrow morning. I’ll send a note by 9AM with an update.

Thank you.

Written by Craig Stacey

January 31, 2018 at 5:00 pm

Posted in Uncategorized

STARTING: Maintenance window: GitLab services

Beginning work to update our GitLab services at https://gitlab.cels.anl.gov and https://xgitlab.cels.anl.gov

Services will be disrupted during this maintenance window.

Service is expected to be restored by 13:00 CST and may be available sooner than that.

We will send a followup email upon completion of the work.

Written by Craig Stacey

January 31, 2018 at 12:03 pm

Posted in Uncategorized

Maintenance window: GitLab services Today 12:00 – 13:00 CST

A maintenance window of our GitLab services has been planned for Today from 12:00 to 13:00 CST in order to update the software.

GitLab services provided by gitlab.cels.anl.gov and xgitlab.cels.anl.gov will be unavailable during maintenance.

Service is expected to be restored by 13:00 CST, and may be available sooner than that.

If this window poses undue inconvenience please let us know, we can reschedule if needed.

Written by Craig Stacey

January 31, 2018 at 10:37 am

Posted in Uncategorized

Update: BIO File server down (Z Drive, Y Drive)

The restore on this new CELS-hosted hardware is going *much* faster. In fact, it was halfway done before the rebuilt storage mentioned last night was ready to go. As such, we won’t be pursuing that course as it would only slow down the other efforts. We anticipate full data recovery tomorrow morning. We’re working out the details of how to get the BIO computers to be able to talk to this new file server, but these should be worked out tomorrow.

If you have an immediate need for some subset of the data prior to tomorrow morning, let me know and I can bundle it up and drop a copy in Box for you if it’s already back from tape.

Thanks again for your patience.

Written by Craig Stacey

January 30, 2018 at 3:47 pm

Posted in Uncategorized

BIO File server down (Z Drive, Y Drive)

The replacement disk array we were hosting the restored data on on failed tonight. At this point, I don’t have any faith in the hardware in this infrastructure and we’re pursuing multiple paths.

First, we’re attempting a parallel restore of the data to storage in the CELS infrastructure. The hope is that the performance of the storage and the reliability will be greatly increased, allowing for a fast restore of the data.

In parallel, I’m initiating a restore onto a reconstructed storage device in the BIO infrastructure, in case the first doesn’t work out. I don’t intend this to be a long-term solution, but more to get this data back to where it’s usable by you while we implement the longer-term solution.

— Craig

Written by Craig Stacey

January 29, 2018 at 8:23 pm

Posted in Uncategorized

Maintenance window: GitLab services 2018-01-31 12:00 – 13:00 CST

A maintenance window of our GitLab services has been planned for 2018-01-31 from 12:00 to 13:00 CST in order to update the software.

GitLab services provided by gitlab.cels.anl.gov and xgitlab.cels.anl.gov will be unavailable during maintenance.

Service is expected to be restored by 2018-01-31 at 13:00 CST, and may be available sooner than that.

If this window poses undue inconvenience please let us know, we can reschedule if needed.

Written by Craig Stacey

January 29, 2018 at 3:48 pm

Posted in Uncategorized

Update: BIO File server down (Z Drive, Y Drive)

I’ve released the shares, so your Z: and Y: drives should be accessible again. You may need to login/logout before they show up.

Note: ** The restore is still progressing. **

The restore is not finished, so if there are files missing, it’s because the restore hasn’t progressed that far yet. If there are particular files or directories you need expedited, please let us know by sending a note to help@cels.anl.gov and we’ll do a targeted restore on those. In the meantime, the restore will still be running for some time (ETA still to be determined).

Thanks again for your continued patience with this.

Written by Craig Stacey

January 29, 2018 at 9:10 am

Posted in Uncategorized