Dispatches From The Geeks

News and Announcements from the MCS Systems Group

Archive for the ‘Uncategorized’ Category

Update: Some services impacted by data center cooling issue.

We believe we’ve restored all CELS general compute services. For other issues (LCRC, ALCF, etc.) stay tuned to the respective user notification lists for updates.

Happy Friday!

Craig

On Dec 14, 2018, at 6:17 AM, Stacey, Craig <stace> wrote:

Between 2 and 3 am, the lab’s central chilled water plant had a failure. The temperatures in the 240 data center spiked highly and a number of systems were affected by the heat.

Cooling was restored by 4:30, but we’ve been trying to get the affected services online. You may notice some problems reaching some servers or services, though most are back to normal at this point.

I’ll send an all-clear when we believe things are back fully.

Craig

Advertisements

Written by Craig Stacey

December 14, 2018 at 7:59 am

Posted in Uncategorized

MCS Environment compute nodes

The following compute nodes have been added to the existing MCS compute environment.

compute002.mcs.anl.gov
compute003.mcs.anl.gov
2X Intel Xeon Gold 6130 CPU @ 2.10GHz
192GB DDR4 2666 MHz Memory (12x16GB Modules)
1Gbit ethernet connected
Ubuntu 14.04

compute004.mcs.anl.gov
compute005.mcs.anl.gov
2X Intel Xeon Gold 6130 CPU @ 2.10GHz
192GB DDR4 2666 MHz Memory (12x16GB Modules)
1Gbit ethernet connected
Ubuntu 16.04

The following compute nodes will be retired around the end of this year. crush.mcs.anl.gov
crank.mcs.anl.gov
steamroller.mcs.anl.gov
grind.mcs.anl.gov
churn.mcs.anl.gov
trounce.mcs.anl.gov
thrash.mcs.anl.gov
vanquish.mcs.anl.gov
octopus.mcs.anl.gov

Please move anything you wish to keep out of /sandbox on these machines.

If you have any questions, please contact us at help@cels.anl.gov. – brad

Written by Craig Stacey

December 14, 2018 at 6:19 am

Posted in Uncategorized

Some services impacted by data center cooling issue.

Between 2 and 3 am, the lab’s central chilled water plant had a failure. The temperatures in the 240 data center spiked highly and a number of systems were affected by the heat.

Cooling was restored by 4:30, but we’ve been trying to get the affected services online. You may notice some problems reaching some servers or services, though most are back to normal at this point.

I’ll send an all-clear when we believe things are back fully.

Craig

Written by Craig Stacey

December 14, 2018 at 6:18 am

Posted in Uncategorized

COMPLETED GitLab maintenance window

Maintenance of our GitLab services has been completed. Please let us know if you encounter any issues by emailing help@cels.anl.gov

– CELS Systems

Written by Craig Stacey

December 4, 2018 at 12:30 pm

Posted in Uncategorized

STARTING: GitLab maintenance window

Beginning work to update our GitLab services at
https://gitlab.cels.anl.gov and https://xgitlab.cels.anl.gov

Services will be disrupted during this maintenance window.

Service is expected to be restored by 13:00 CST and may be available sooner than that.

We will send a followup email upon completion of the work.

– CELS Systems

Written by Craig Stacey

December 4, 2018 at 12:00 pm

Posted in Uncategorized

Maintenance window for GitLab services 2018-12-04 12:00 CST

A maintenance window of our GitLab services has been planned for 2018-12-04 at 12:00 CST in order to update the software.

GitLab services provided by gitlab.cels.anl.gov and xgitlab.cels.anl.gov will be unavailable during maintenance.

Service is expected to be restored by 2018-12-04 13:00 CST, and may be available sooner than that.

If this window poses undue inconvenience please let us know, we can reschedule if needed.

– CELS Systems

Written by Craig Stacey

December 3, 2018 at 9:33 am

Posted in Uncategorized

Why your mail forwarding might be broken, and you may not even know it.

Hi, again. Time for another story in the vein of Technology is Ruining Everything and Why Can’t Things Just Be the Way They Were and Get These Kids Off My Lawn.

Sorry, went off on a bit of a tangent there.

Let’s start again. If you forward your mail to another site (like Gmail, Yahoo , AOL , or some other facility), this message is for you. If you don’t, this really doesn’t apply to you, but you can read along for bonus points and extra credit.

This is another part of the DMARC saga I told you about a few weeks ago. Now, this first part is very important, at least in the CYA department for myself: none of this is under my control, and indeed none of it is under Argonne’s control. We aren’t doing this to you, the internet is. Blame them. They’re horrible, the whole lot of them.

Okay, now that the blame’s been set, here’s the issue. If you forward your mail somewhere else, it may be silently not arriving, and neither you nor the sender may know it’s happening. That’s very frustrating, and I would fix it if I could. Oh wait, I *can*! Or, at least, I can tell you how to get around it.

First, and this is the easy part, stop forwarding your mail. Like, seriously, stop. Forwarding is something that gets broken by anti-spam and anti-forgery methods, and those are becoming more common. If you remember from the previous lesson, when mail arrives with a From: address of one site, but is coming from another unauthorized site, many servers will simply reject it – this is what happens when you forward mail. It’s happening now, and it’s happening more frequently. If you forward your mail to gmail, and someone from lanl.gov sends you mail, chances are very good it won’t arrive. (If you have examples of this working, please let me know, I want to learn from it.)

Okay, so if you’re going to stop forwarding your mail, where do you do that? Well, there are a few places to look.

* You can login to your Office365 account and see if you have any forwarding rules set up there. Here’s a shortcut to that page: https://outlook.office365.com/owa/?realm=anl.gov&path=/options/inboxrules
* You can look at the Argonne alias system: https://apps.inside.anl.gov/email_alias/ (onsite only)
* If you have an MCS account, you can check your mcs.anl.gov, alcf.anl.gov, or cels.anl.gov forwarding: https://accounts.mcs.anl.gov (Under “Account Information”, “Configure Email”)

In Office365, you should remove any “Redirection” rules. If you want, you can change them to “Forward”, but that will wrap the message up as a forward, the same way when you forward a mail from your inbox to someone — it’ll be from you.

In the other situations, it should forward to @anlmail.anl.gov which will put it in your Office365 account.

I or my team can help with any of this.

Alright, but now you can’t get your mail at Gmail (or AOL ), right? Well, you can. I don’t recommend taking your mail offsite, and in fact strongly encourage you not to, but If you insist on it, here’s how you’ll want to go about it. I’m only giving instructions for Gmail. If you’re using something else, hopefully these instructions will help you in some way. Or you can print them and use them to line a bird cage. You do you.

You’ll need to configure Gmail to pull mail from your ANL account instead.

* First, unclutter your Inbox in Office365. If you don’t, Gmail’s going to try to get everything in it. Make a folder, move everything old you don’t need transferred into the new folder, and have a nice (fairly) clean inbox in Office365 before proceeding.
* In Gmail, go into Settings, Accounts and Import, then “Check Mail from Other Accounts” and click “Add a Mail Account” * Enter your “@anl.gov” address, and click Next.
* Choose “Import my mail from my other account (POP3) and click Next.
* Make sure “Leave a copy” and “Use SSL” is checked, enter your password, and “Add Account”. * To properly send mail, in “Send Mail As”, add an address.
* Enter your name and email (use your @anl.gov address), and go to Next Step
* Use “smtp.office365.com” (port 587) as the server, use your @anl.gov address as the user, and use your password. TLS is recommended and should be checked. It may ask you to confirm you are who you say you are via a mailed link.

Once that’s done, mail sent to your ANL account will *also* go to your gmail account. It won’t be instant – there may be a few minutes delay. If you’re expecting something right away and need it right away, login to O365 and get it there. Also, everything you send will properly have your @anl.gov address, will pass SPK/DKIM tests, and you’ll have a copy in the sent-mail folder of your O365 account.

Now, you don’t *have* to do any of this. But if you don’t, like I said, you may start missing mail and not even know it. A few instances of helping people who weren’t getting mail they expected is what prompted this announcement. If you send a ticket complaining that mail isn’t arriving, the first thing we’re going to ask you is if you forward your mail. And if you say yes, we’ll make you wear a silly hat for a day before we help you.

Well, the team probably won’t. But I will.

Hope this helps. Have a good halloween, even if it does mean those kids are still on my lawn.

If you want to discuss this with us and your fellow CELS tech-users, use the tech-discuss @ cels list. https://lists.cels.anl.gov/mailman/listinfo/tech-discuss. Thanks!

Written by Craig Stacey

October 31, 2018 at 6:20 pm

Posted in Uncategorized

COMPLETED GitLab maintenance window

Maintenance of our GitLab services has been completed. Please let us know if you encounter any issues by emailing help@cels.anl.gov

– CELS Systems

Written by Craig Stacey

October 31, 2018 at 12:37 pm

Posted in Uncategorized

STARTING GitLab maintenance window

Beginning work to update our GitLab services at https://gitlab.cels.anl.gov and https://xgitlab.cels.anl.gov

Services will be disrupted during this maintenance window.

Service is expected to be restored by 13:00 CDT and may be available sooner than that.

We will send a followup email upon completion of the work.

– CELS Systems

Written by Craig Stacey

October 31, 2018 at 12:11 pm

Posted in Uncategorized

Maintenance window for GitLab services, 2018-10-31 12:00 – 13:00 CDT

A maintenance window of our GitLab services has been planned for Wednesday, 2018-10-31 from 12:00 to 13:00 CDT.

GitLab services provided by gitlab.cels.anl.gov and xgitlab.cels.anl.gov will be unavailable during maintenance.

Service is expected to be restored by 13:00 CDT, and may be available sooner than that.

If this window poses undue inconvenience please let us know, we can reschedule if needed.

– CELS Systems

Written by Craig Stacey

October 29, 2018 at 2:36 pm

Posted in Uncategorized