More details will come later today once we’ve hammered out what happened, but everything is back (or should be back shortly). Thanks for your patience, sorry for the troubles, and stand by for details.
Your humble team of tech monkeys
Still struggling to get things back up. We’re moving the database services over to a different datacenter in the hopes it will be able to start providing service there. There’s a lot of data to move. I’ll provide updates direct to twitter from this point on, and reserve e-mail/blog posts for more detailed info. If you’re not already following, our twitter is @mcssys (https://twitter.com/mcssys).
We’re still battling an issue we have yet to diagnose. At this point, we’re not expecting things to come back tonight. We’re working to move the services off the affected infrastructure to bring the critical services back. We’re getting outage pages into place for affected websites.
Once we’re through this, I’ll provide a detailed explanation of how things are set up and what went wrong for those who are interested in that. At the moment, we’re still struggling to figure out what exactly has gone wrong, since there’s no indication as to what’s causing the service failures.
Our primary mysql database server is not allowing connections (or only sporadically allowing them), which is causing a number of services to fail including many websites. We’re working feverishly on getting it working again, but we have no ETA at this point since we’re still not able to get any real diagnostic info after multiple service and machine restarts.
More info as it comes available.
If you’re running MacOS 10.9 (Mavericks), please run software update to get the latest version (10.9.2). Aside from some bugfixes (including improved Exchange interopability), this contains a fix for a serious security issue with SSL certificate validation.
This update was just released, and should be available via the App Store/Software Update. It can also be found at Apple’s support downloads page here: http://support.apple.com/downloads/
The instructions for reserving equipment at https://wiki.mcs.anl.gov/IT/index.php/Mail#Reserving_Equipment has been updated to reflect the new addresses and information. Thanks!
This work is happening at noon today. Thanks.
As you may have heard, the lab is switching to a new system for time tracking. More announcements on that will be coming from others as we get closer to the switchover date, including training information.
In order to use the new app, there’s a piece of software (Citrix Receiver) that you need to have installed. We’ve already installed it on all the Macs we manage. If you self-manage your machine, however, it’s easy to install. The simplest way is to visit https://appgateway.anl.gov with your browser. It will detect if you have the app and offer to install it if necessary. Right now, this URL is only accessible from inside Argonne — I’m looking into whether or not this is intentional as I was led to believe this was an “access anywhere” solution.
The software is available for Mac, Windows, Linux, Android, and iOS. (To install for Android or iOS, use the Google Play store or Apple App store and search for “Citrix Receiver”).
Documentation related to Dayforce can be found on Inside Argonne at http://inside.anl.gov/tools/applications/dayforce including links to login to the system. You won’t be able to login to Dayforce until the division has been switched to use it, but there’s an “Inside Argonne” app there you can test things out with.
Specific instructions on the Citrix software can be found at http://inside.anl.gov/tools/applications/citrix-gateway including instructions on installing in Windows, Mac OS, Debian-based systems, and RPM-based systems. If using a mobile client, after opening the Citrix Receiver software, point it at https://appgateway.anl.gov for app and login information.
This work has been postponed to Wednesday. Sorry for the short notice.
In a very confusing method of observing Valentine’s Day, some resource calendars are being migrated from the soon-to-be-retired Zimbra server tomorrow during the day. If you have any reservations or changes to make on these calendars, please get them in place today. Tomorrow during the day they will be moved to Exchange, and we’ll send out pointers to instructions on the new calendar location and procedures after the migration is complete.
The list of calendars being migrated are:
MCS Travel/Absence calendar
MCS Wireless Modem reservation calendars
MCS Projector reservation calendars
MCS Loaner Laptop reservation calendars