Seti is down again

[Richard Haselgrove]

The BOINC site is still active, and from the evidence of the re-wiring weekends, they share power. But it might be another router/switch, judging by how abruptly it went down.

[msattler]

Well....they came back up for a couple hours.  Just now shut back down for the weekly outage.  Might make recovery after the outage just a little more congested.
Maybe we will get a note about what happened later when they come back up.

[Pappa]

The Odd part was I could ping setiboinc.ssl.berkeley.edut and setiboincdata.berkeley.edu They were just not responding on port 80 it was almost as someone had disabled the deamons on the hosts.

[msattler]

Seti just went dark again........
Whazzup?

[Richard Haselgrove]

Cricket graph shows we had been downloading at max link speed for 10 hours solid - guess we blew a fuse in that dodgy database again....

Edit - maybe we blew the whole Berkeley campus -  http://seti.berkeley.edu/ is down too.

http://downforeveryoneorjustme.com/%20http://seti.berkeley.edu/

[msattler]

They should go back to tubes........
They go soft, not down.....LOL.


Sigh.....back to bed then.

[hiamps]

Looks like a hard crash at Seti, can't even bring up anything...

[Richard Haselgrove]

It was comprehensive and sudden, but BOINC (which lives in the same building) is still up, so it can't be a power outage - BOINC went dark too during the re-wiring weekends.

Best guess is a switch or router going down - that's happened before - in which case we can be hopeful that all the servers are still intact behind the blackout curtain.

[sunu]

Seti splitters started doing heavily some VHAR workunits, my PC started downloading a multitude of them, maybe a 1000 or more, for the past 12 hours. All this traffic from all seti participants, I guess must have something to do with the outage.

[Richard Haselgrove]

Doubt it. They're back, and straight up to full speed with no messing. Still think it was comms rather than db.

[hiamps]

Looks like either they are working late or the web pages have a problem...Everything else seems to be working...

[arkayn]

Replica is caught up, the only thing off is

data-driven web pages   thinman   Disabled
sah_assimilator1    vader   Disabled
sah_assimilator2   vader   Disabled
sah_assimilator3   vader   Disabled
sah_assimilator4   vader   Disabled

[hiamps]

Looks like after limping for a day or two seti has crashed hard. The tuesday outage didn't seem to help...

[arkayn]

Looks like it might be the router again as cricket still works.

http://boinc.berkeley.edu is down as well though.

Must just be the lab.

[hiamps]

A little progress, finally got a "Project down for Maintenance" page.
From front page...
Projects are down due to a server closet air conditioning failure.
We have to power down most of our computers until this is fixed. 17 Feb 2010 2:36:55 UTC


--------------------------------------------------------------------------------

Exceptions prove the rule ... and wreck the budget.

- Murphy's Law