[RESOLVED] Status Page Temporarily Down

[RESOLVED 10:45 a.m. Pacific]  The status page is active again.

[UPDATE 9:56 a.m. Pacific] No visible improvement yet.  The Web team is still working on it.

*****

The status page we use to report service disruptions in progress is suffering a temporary misconfiguration.  We expect to have it resolved shortly.

Voice Server Maintenance Monday 14 July

We’ll conduct grid wide maintenance on the voice servers on Monday morning, 14 July 2008, between 2:00 AM PDT and 5:00 AM PDT. Each voice-enabled region will experience a brief downtime (under five minutes) as the individual media server supporting voice for that region is restarted.

A handful of individual regions may experience audio interruptions lasting five to ten seconds for a period of a few hours following this maintenance period, as audio load is balanced across the voice grid.

We’ll update the status page as work progresses.

Logins, Registrations, Land Store Offline Wednesday a.m.

To improve the Second Life experience, we’ll be upgrading database hardware this coming Wednesday, 2 July.

The upgrade is scheduled to begin at 7:00 a.m. Pacific, and to take a maximum of an hour.  During that time, logins, new account registration, and the land store will be unavailable; however, residents who are in world will not be asked to log out.

We’ll report progress during the upgrade on the status page.

Voice-only Rolling Update, 2 a.m. – 5 a.m. Pacific Wednesday

We’re conducting some scheduled maintenance on the voice servers tomorrow, 2008-05-21, from 2:00 AM to 5:00 AM Pacific time. This maintenance consists of a web API update and a media server update. These changes will be pushed in the form of a rolling update, which means that each region will experience a voice-only downtime for a few minutes as the individual media server supporting a particular region is restarted.

This update also includes:

• Capacity improvements for large positional (spatial) channels
• A fix for an issue that causes problems when joining channels with single quotes in the channel name

[EDIT]

I think you’re right; this should’ve gone on the status page from the get-go.

My thought was to keep the status page for things happening Right Now, and to put the advance warning here. But checking back through some earlier posts on http://status.secondlifegrid.net/
I see it’s being used for some early advisories, not just issues in progress.

Sorry for the confusion. I’ll copy it over there.

[RESOLVED] Logins Re-opened

[UPDATE 1:35pm  Pacific] Logins are open, and the asset system has returned to full functionality. Please be patient when logging in, as the login queue will be processing a high volume of requests for the next few minutes.

[1:02 pm Pacific] Logins have temporarily been restricted to staff-only as Operations addresses a slowdown in the asset system. We’ve also broadcast a request in world for residents who are currently logged in to refrain from manipulating or transferring assets. We’ll have more info ASAP.

[CLOSED] Overdue Statements for Some Residents This Month

[UPDATE 24 Apr, 3:40 p.m. Pacific] The billing process is caught up.  The accounting group and their associated dev team will be monitoring this weekend’s billing run for any sign of trouble.

[UPDATE 22 Apr, 4:55 p.m. Pacific] Last night’s run cleared many accounts, but not all of them. Another catch-up run is scheduled for tonight, and we’ll post an update tomorrow.

Some of you may have noticed that you haven’t been billed yet for this cycle. The biller hasn’t run properly, so collecting some payments has been delayed. We’re planning a special billing run tonight as the first step in catching all accounts up to date.

Don’t worry, your payments aren’t late, and it won’t affect account status or land ownership. Because this is running a few days late, next month’s billing might seem to come up sooner than usual, but it will run on the usual day.

Once we have more details we’ll give you an update. Thanks!

I-World Island opens at midnight Pacific with 24 hour concert

At the top of the hour, I-World Island debuts with a full twenty-four hour showcase of musical talent.  

Here’s the lineup (PST):

• 12 am Mikelec Criss
• 1 am Jackdog Snook
• 2 am Cromwell Hoobinoo
• 3 am Dann Numbers
• 4 am Allister Westland
• 5 am Phemie ALcott
• 6 am Lacoppia
• 7 am Spaceman Opus
• 8 am Erin68 Frog & satin Galli
• 9 am Rich desoto
• 10 am POL Arida
• 11 am Jean Munro
• 12 pm SHamanes
• 1 pm Kaklick Martin
• 2 pm SRV4U Conacher
• 3 pm Virtual Live Band
• 4 pm Jaycatt & Frogg Marlow
• 5 pm Friendly Fire
• 6 pm Kyle Beltram
• 7 pm Zed Essex
• 8 pm Forsythe Whitfield
• 9 pm Kelvinblue Oh
• 10 pm Tallguy Kidd
• 11 pm Von Johin

We hope you’ll be able to come by, give some of these talented folks a listen, and take a look at what the island has in store.  There’s overflow space for relaxation and dancing, and we’ll also be streaming the performances into public areas such as Waterhead and Wengen.

Wednesday Maintenance of Support Portal Canceled

We originally announced a Wednesday morning (Pacific) outage for the support portal.  That outage has been canceled.  All necessary work was completed during the first phase of maintenance.

[CLOSED] Reduced Voice and Live Chat Support for Next Few Minutes

[CLOSED 9:45 a.m. Pacific] The power cycling is complete.  All voice and live chat channels are now running at normal capacity.

*****

A minor hardware glitch has prompted us to shut down the power to one of our support teams for about ten or fifteen minutes. This is causing reduced access to voice and live chat for Billing and Outworld support; Concierge support is unaffected. This should take about fifteen or twenty minutes to address at most.

[Edit: in World Support channels are also unaffected.]

[UPDATE] Maintenance Events Scheduled, 13 – 16 April

[UPDATE 15 Apr, 11:22 a.m. Pacific] The Wednesday maintenance for the support portal is canceled.  All the necessary work was completed during the Sunday night maintenance.

[RESOLVED 22:44] The service disruptions caused by tonight’s maintenance should now be taken care of. Thank you for your patience and understanding. – Twilight

[UPDATE 14 APR 22:27] The maintenance is causing some disruption of services for some residents, including logging in, teleporting and transactions. Please refrain from making any transactions until further notice. Please monitor this post for further updates as they occur. – Twilight

We have one maintenance event scheduled for each day between this coming Sunday and Wednesday, inclusive.

The maintenance is of two types, and each event will briefly impact resident experience in one of two ways.

Sunday 13 Apr, 9pm – 10pm Pacific: Our support portal will be off line for one hour for Phase I of a two-step vendor maintenance event. During that time, the support portal will be unavailable for chat or ticketing services.

Monday 14 Apr, 10pm – 1 am (Tuesday) Pacific: Phase I of an essential two-step upgrade to the breaker system at our San Francisco datacenter facility will require a shutdown of a number of our server racks.

Tuesday 15 Apr, 10pm – 1 am (Wednesday) Pacific: Phase II of the breaker maintenance at our San Francisco facility will again require a shutdown of some of our server racks.

Wednesday, 16 Apr, 7 am – 9am Pacific: The final phase of the support portal maintenance. The support portal will again be unavailable during the maintenance window.

Operations is already at work minimizing impact of the Monday and Tuesday maintenance by rerouting essential backbone services. However, we project that a total of approximately 1400 regions will experience three hours of downtime on one or the other of those nights.

Due to the way regions are dynamically assigned, we cannot predict in advance which regions will be affected, but as we get closer to the start times, we’ll publish any particulars that our own Ops team can control or pre-schedule to minimize impact on resident experience.