Spunky File Server Issue
We are currently experiencing problems with one of the file servers in the “spunky” cluster. An admin is already on the way to the data center to investigate. When the issue is resolved or we have further information an update will be posted. Our apologies for the issues, we are working to get this fixed up as soon as possible.
Update: 8:15am pacific: one of the fibrechannel interface cards died and had to be replaced. We’ve completed this process and the filer is back online now. Services should be back up as usual!
.
March 5th, 2008 at 8:10 am
Is Razzle affected?? It was rebooted and now I can’t access any of my websites.
March 5th, 2008 at 8:11 am
I am on snocap and arlene and my site is unresponsive.
March 5th, 2008 at 8:13 am
Nerds is having an issue as well it seems. Cannot access my websites or my e-mail.
March 5th, 2008 at 8:13 am
Likewise. Still down and not answering on port 80. And I can’t seem to get past step one in contacting support - after I select website, a little box pops up saying it’s checking the status of my site and then it zaps me back to the main support page. WTF.
March 5th, 2008 at 8:14 am
website on bazooka is not loading.
March 5th, 2008 at 8:14 am
Cancel my message, it’s all working again now.
March 5th, 2008 at 8:14 am
Bazooka, too. No email, sites down.
March 5th, 2008 at 8:19 am
Yep… all my sites are down. *twiddles thumbs*
March 5th, 2008 at 8:25 am
My site on Bazooka is down. Only plain html pages will load.
March 5th, 2008 at 8:25 am
no sign of ‘look’ coming back yet
March 5th, 2008 at 8:28 am
Still unable to ssh to warhead from here (despite the status post reading “resolved”), but my email seems to be doing a bit better.
March 5th, 2008 at 8:30 am
website on bazooka still down. can access webmail but cannot via pop3. hohum.
March 5th, 2008 at 8:34 am
all my sites on larchmont are down, webmail still works though
March 5th, 2008 at 8:40 am
My website on warhead is also fried
March 5th, 2008 at 8:41 am
shocktart is having issues too.
1. ssh’ing to shocktart.dreamhost.com gives:
“ssh_exchange_identification: Connection closed by remote host”
2. Websites are not responding.
March 5th, 2008 at 8:47 am
Yeah, definitely all services NOT working normally right now, as all my sites are down.
March 5th, 2008 at 8:52 am
Yup, warhead still down, can’t even ping it. Or is this a new issue?
March 5th, 2008 at 8:52 am
My website on Bazooka is up.
March 5th, 2008 at 8:55 am
look is back!
March 5th, 2008 at 8:56 am
All my sites on Sawtelle are down.
March 5th, 2008 at 8:58 am
Even the support test was down for a minute, but now may be back (https://panel.dreamhost.com/index.cgi?tree=support.test&).
Every domain shows:
http service for error Your website does not appear in the Apache configuration file.
Also:
warning Your website took longer than 5 seconds to respond.
March 5th, 2008 at 8:59 am
warhead still down for me as well.
March 5th, 2008 at 9:13 am
Warhead looking better now
March 5th, 2008 at 10:04 am
I didn’t notice a thing. Maybe I’m lucky or something.
March 5th, 2008 at 10:06 am
My sites on bazooka is up again.
March 5th, 2008 at 12:03 pm
Both my E-Mail and Site are down!!!! When I try to pull up my site a GoDaddy ad comes up.
March 5th, 2008 at 12:17 pm
Guys, I don’t meant to be impolite, but is DreamHosting up to the task? I have set up my site and (Kyrie), and it has either been down, or painfully slow for 50% of the day (mostly after 7pm PST) for the last five days.
March 5th, 2008 at 1:17 pm
Guys? dreamhost dot com is down wtf, aslo my website and i even can’t access to my panel X_X
March 5th, 2008 at 1:17 pm
All of DH has gone inaccessible from here. Anyone else? Did CA fall off the continent or something?
March 5th, 2008 at 1:19 pm
End of the world?
March 5th, 2008 at 1:19 pm
Down here also. Website and dreamhost.com
March 5th, 2008 at 1:19 pm
Everything Dreamhost (except for this page) is down… FTP, My Website, My friend’s website (on a different server), my email, dreamhost panel. How do you contact support when the support contact is down? If anyone knows, please let them know…
March 5th, 2008 at 1:20 pm
1:17pm all sites down. Awesome!
I will now begin refreshing this blog over and over and over waiting for an announcement.
March 5th, 2008 at 1:22 pm
IS BACK!… This is rare.
March 5th, 2008 at 1:23 pm
Nope, none of my sites are back online yet. This looks like an actual fiber optic backbone going down.
March 5th, 2008 at 1:23 pm
All my sites are dead. Whee.
March 5th, 2008 at 1:24 pm
Chiming in to add that all of DH is also inaccessible from the UK. It’s a failure at DH, not somewhere else.
March 5th, 2008 at 1:24 pm
F you dreamhost.
March 5th, 2008 at 1:25 pm
4:25pm EST. Everything is down, including the panel.dreamhost.com.
March 5th, 2008 at 1:25 pm
How do we get ahold of support if the panel is down too?
All my sites are down and so is the control panel!
March 5th, 2008 at 1:27 pm
Well my site is back, thank you GOD!
March 5th, 2008 at 1:28 pm
DebK: I personally rode on a former trouble ticket I had in e-mail and just changed the subject, but left the ticket number intact.
March 5th, 2008 at 1:28 pm
Well, there it goes…back online. yay!
March 5th, 2008 at 1:28 pm
aaaaaaand we’re back. Hopefully there’ll be an explanation.
March 5th, 2008 at 1:36 pm
I was ust able to login to my panel, but it is slooooooooooooooooooooooow! And it states that they are having problems with spunky again, but I am NOT on spunky I am on orbital so they need to check into that one too!
@Shawn Muder, guess I will go have a look and see if I have a old one! Thanks!
March 5th, 2008 at 1:44 pm
Yep, my sites are back, as well. I’m not on spunky either (and neither is their panel, I imagine). I’m sure there will be a status report soon, as this was a rather major (albeit brief) outage.
March 5th, 2008 at 1:52 pm
My sites are back but they are slooooooooooooow now.
March 5th, 2008 at 2:05 pm
My sites are back and fast as hell
March 5th, 2008 at 2:28 pm
Can anyone explain to me why I got an email partially quoted with “”We are currently experiencing problems with one of the file servers in the “spunky” cluster. An admin is already on the way to the data center to investigate. Our apologies for the issues, we are working to get this fixed up as soon as possible. - We’re sorry..because of the following emergency situation and the overwhelming amount of support it is causing right now, our system is unable to handle email support, and so your message is being returned to you. Title: Your message was NOT recieved” at 4:10PM CST when apparently this issue was “resolved” and not only that, why the fuck can’t I opt-out of their bullshit spam newsletters directly from the email with a link? I got that in return for me requesting they remove me from their “mailing-list”.
March 5th, 2008 at 3:24 pm
All my databases on “spike:ellsworth” are down. Error establishing connection. Front ends of my websites hosted on Krackel load fine. I’ve submitted a ticket, hopefully it doesn’t take too long to resolve. it’s 3:22PST here now and it all worked fine in the morning AFAIK
March 5th, 2008 at 8:15 pm
Resolved? NO ITS NOT
March 5th, 2008 at 8:19 pm
I think this is a brand new issue. Of course, I also think there is an overarching quality problem going on here, but then I’ll wait to pass final judgment until I hear from someone in charge.
March 5th, 2008 at 8:44 pm
My websites are down.
March 5th, 2008 at 10:49 pm
All my sites are still down. It is aggravating to see this web page say that the problem is resolved when it most DEFINITELY IS NOT.
March 5th, 2008 at 10:51 pm
My sites have been down for over 3 hours. I keep getting this error: error id: “bad_httpd_conf”. What does that mean?
March 5th, 2008 at 11:31 pm
hm, thanks a lot..
March 6th, 2008 at 6:09 am
Still Not able to receive Email.
I’ve looked at the DreamHost Status page, it says the problem is resolved, it’s not resolved for me thou.
March 6th, 2008 at 7:20 am
12:19 PM GMT-3
Web site very very slow..
Cant contact support, panel doesnt works.
I never thought Dreamhost could be this bad support and service…
March 6th, 2008 at 8:15 am
I get the “bad_httpd_conf” error also.
March 6th, 2008 at 8:36 am
Still down for me, Then it sparks to live for a few minutes to die again
March 6th, 2008 at 8:40 am
WTF?
Up and down all night.
My users are ticked and I want a refund.
March 6th, 2008 at 8:43 am
my website is completely down and I have no idea about servers or what one I am using -
but this is a huge pain in the bum.
Gomonews provides news/ scoops/ instant information and at the moment - I can’t access anything.
March 6th, 2008 at 8:50 am
Birdo is not responding.
No sites up - no ftp access.
Emails functioning.
– if only we were born with 8 arms each and could be everywhere at once.
If I don’t hear from them, it’s a safe bet that they’re working their butts off to find the solution. I find it less stressful to just give them the facts and the room to work it out. Losing patience doesn’t get it there any quicker
– but that’s me.
Continued Factual feedback - all clues leading towards a positive result.
Each different issue changes the variables - what could look like one thing, may result in a completely different issue with the next piece of info that comes in from someone - and that may very well be the key.
Can’t say I’ve ever come across a service that is completely flawless.
I’ve just left MDWebHosting because they completely lost all of our sites and evaded every question thrown to them, ducking and weaving at every turn, over a period of a month - at least Dreamhost is honest and open about what is happening when it happens and don’t try to cover it up or completely avoid you for weeks on end with no reply or a moutful of hogwash as a feeble attempt to keep you at bay - I find it easier to cope with issues when I know that it has a name etc.
Ok… my ‘patience’ theory fell on it’s face after week three with MDWebHosting… even my patience has it’s limits… but I digress.
:o)
March 6th, 2008 at 9:27 am
O my God!!! Apocalypse!!! I have all down…
March 6th, 2008 at 9:32 am
Come on Dreamhost! Not even a System Status notice about this outage?? I’ve got a client on my case here.
March 6th, 2008 at 10:54 am
This is a total disgrace. I can’t believe I even pay for this nonsense. My website is not working. I can’ t believe I even use DreamDisgrace. That’s the new name for this hosting company. I can’t log in, I can’t post. After my contract is over with dream host, I’m moving because I can’t take this anymore
March 6th, 2008 at 11:24 am
Not resolved for this West Coast user either.. Curiously was working on site yesterday, odd behavior guess I was lucky to be doing so. Today: nada.. I’m going to find out from the web programer details on submitting this officially to Dreamhost… Holding up alot of work at the moment.
March 6th, 2008 at 12:06 pm
Is anyone over there even embarrassed about these performance problems? Sometimes accessing the site fails after several seconds, occasionally it’s fast, but overall this is not what I signed up for. Please at least demonstrate respect for your customers by at least giving us a status update. Why does DH disrespect us like this?
March 6th, 2008 at 1:13 pm
Its happenning, like yesterday, dreamhost dot com is down, also my website WTF is going on here GUYS!
March 6th, 2008 at 1:14 pm
ARGH, and i was uploading some files via http://FTP...
March 6th, 2008 at 1:15 pm
Dreamhost.com is down, the main blog is down, and both my sites are down… erm, isn’t this the second time within 30 days that this has happend? Sort it out soon guys!
March 6th, 2008 at 1:15 pm
Everything just went down for me too, CRAP. Very annoying!
March 6th, 2008 at 1:16 pm
Down down down. Everything is down.
March 6th, 2008 at 1:17 pm
dreamhost.com is no longer accessible, nor our hosted sites/e-mail.
Looks like network issues:
…
7 cr1-loopback.lay.savvis.net (208.172.34.70) 1084.884 ms 265.466 ms 50.062 ms
8 dpr1-so-7-0-0.losangelesequinix.savvis.net (204.70.203.45) 55.385 ms 50.244 ms 48.449 ms
9 bpr3-so-0-0-0.losangelesequinix.savvis.net (204.70.194.173) 55.207 ms 52.600 ms 58.316 ms
10 internap.LosAngelesEquinix.savvis.net (208.174.196.38) 115.101 ms 111.748 ms 111.536 ms
11 border1.po2-bbnet2.ext1a.lax.pnap.net (216.52.255.95) 111.777 ms 111.862 ms 111.559 ms
12 * * *
13 * * *
14 * * *
15 * * *
March 6th, 2008 at 1:18 pm
I’d laugh if Dreamhost has a script installed to see how fast comments are being posted to this blog. ALl they have to do is wait for it to explode and they’ll know there is a problem
March 6th, 2008 at 1:20 pm
Is getting back … DEJAVU?
March 6th, 2008 at 1:22 pm
What is with the dreamhost panel, website, my website, and clients websites on other servers being down for over a few hours now? I’m getting complaints, and no response or resolution!
March 6th, 2008 at 1:26 pm
We were down for about three minutes. Back again, knock wood.
March 6th, 2008 at 1:30 pm
I sent a service ticket and posted on here back at 9:30am that were were having MAJOR outage issues and I’m VERY disappointed that there’s no response or even any mention of it on the so-called “status blog”. I FULLY respect and understand that DH is probably scrambling to address the problem, but let’s see some professional courtesy in even acknowledging that there is one! This is absolutely terrible handling of the situation. Give us something to tell clients!!
March 6th, 2008 at 1:42 pm
dreamsuck, well, sucks.
March 6th, 2008 at 2:48 pm
@Aaron S:
They have posted a notice in the panel on the contact support page.
March 7th, 2008 at 3:43 am
This STILL hasn’t been resolved. Seriously, what the hell is going on over there. You’re claiming this is resolved, it clearly isn’t, I still have sites down.
It’s not even like this is a one-off, outages, slow-response times, servers timing out are a daily occurance with Dreamshit.
We’ll be taking our business elsewhere at the nearest opportunity.
March 8th, 2008 at 2:33 am
Thank you for fixing Spunky
March 10th, 2008 at 9:20 pm
It’s happening on yoshi again. *sigh*
yoshi:~> uptime
22:19:40 up 4 days, 12:36, 11 users, load average: 294.46, 371.70, 201.97