Power Outage Update
Posted (February 25th, 2007 at 2:56 am PST) by JustinPower has been restored to the building and all servers are back up and running. There currently is an issue with a blade in one of the core routers and it is being replaced, so the servers are still unreachable until this issue is corrected. We are working to get service restored as soon as possible. Our apologies for the inconvenience.
- UPDATE 04:51 PST -
The supervisor in one of our core routers went kaput when the power went off. It was replaced shortly after the original posting. Further problems arose with corrupt configurations left over from the old supervisor. These have been restored and we have re-established connection to seven out of our eight uplinks. We are currently working on the eighth uplink and everything is coming back to normal operation now. We are close to being 100% and thank everyone for their patience. As always, check this space for updates.
- UPDATE 11:21 PST -
The router is up and healthy, and the majority of our network is back up and running. However, a few of our servers are having issues because their file servers are not talking to the rest of the network correctly. There is a link down from one part of the datacenter back to the routers and that is causing the file server issues. If you are on a server whose name is a beverage, this will effect you. We are working very hard to resolve this issue, and we apologize for the inconvenience.
992 Responses to “Power Outage Update”
Hurry Up Guys , You are again losing you repu as last year 
Best Of Luck
Nothings working for me,
That post seemed pretty contradictory to me … how can the servers be back up and running if they’re still unreachable?
Yay! I’m so lost with my websites down.
Sites & mail still not working…
I was curious why my site wasn’t working, and when I couldn’t get to the panel, that was even worse. But glad to see ya’all know about it and are working on a fix.
so they have power just no routers
I guess what they meant was: the building has power again, but our servers still don’t work.
Now the minimum that dreamhost can (must?) do is increase our disk space or send us a cold beer 
Nice work guys…
still not working
Surely the faulty blade in the router couldn’t have been caused by the (controlled) powering down and up again (could it?), so wouldn’t that problem have been evident before?
In any case, I’m glad you were on hand to shut down the machines safely, and thank-you for keeping us all informed.
@Huh?: The servers are up but their connection through our pipe out of the building is the issue, so they are still unreachable to the outside world. It is being worked on right now.
@CAFxX: The dreamhost.com and other dreamhost sites besides dreamhoststatus.com are on the network with the core router issue, they will be back up when it is fixed.
Mail is working, but not Panel or my websites
The servers may be up internally, meaning the computers they run on are up and running, but the blade that is down is preventing people form the outside to access them, or the data is inaccessible until the blade is repaired. From experience, they are definitely working on this, not just blowing smoke up our butts.
Keep up the work guys, it’s appreciated. (Gals also if there are any working, sorry, it’s slang)
@huh: servers run independently of the routing equipment. If the servers are up, but the routers are down, then you still won’t get anything. Even if the servers were up and the routers were up, there’s still plenty of places to cut the link and make your server disappear.
It is still rather odd to think that DH has 3 datacenters with all lines to the internet loading into one of them… what was that saying about eggs and a basket?
I do sympathize with DH though - they’ve had some real bad luck in the last year.
No irony here then that I was about to post a blog entry about the state of electrical power supply in my town ( Horsham , Sussex , England ). The power had been off for 3 days and is even now intermittent. Its like living in a 3rd world country. So there I go to blog about it and har de har har the power is out at Dreamhost. I love the irony in that , I really really do. Anyway to the Dreamhost guys whom are currently working had to get things running I do hope your not getting those annoying interupting questions like ” Will it be much longer ? or Hows it going then ?” and keep up the good work( hard ) work .
Thanks for telling us!
and to the n00bs that say “you have too much downtime” “when are the sites coming back up” “Hurry up”
Think of the price and what you get and at my old host, site goes down for a day, comes back up and no news!!
My mistake, mail was not working
@Justine
How come this blog runs while every thing on ur network is down ??
also… Hurry up… 
its been a while since sites are down… unfortunatelly i have to say, i see every now and then some thing is always wrong with DreamHost hardwares…..
pues a mi no me funciona ninguna.
How can all servers be up if it is still unreachable?
I’m not complaining … just the wording sounded weird to someone who doesn’t know a lot about that sort of thing, was all I was trying to point out … “servers” means the same, regardless of how anyone explains anything. I actually found it more humorous than anything else. Maybe I’m the only person who has a sense of humor at 5 am …
Ni a mi… Pero esta gente trabaja rápido!
Still can’t access DH main page, though.
Neither my sites, BTW.
Actually, I was just pointing out the irony since “server” means “server” means “server”, no matter how you look at it. I found it humorous; I wasn’t complaining … Maybe I’m the only person who has a sense of humor at 5 am?
I appreciate the fact that this page is here for updates. Building management waited for an appropriate time to do this upgrade if you are in the PST time zone. Next time it could be good to fire off an email (though it might just make people who never knew about the outage jumpy, so on the other hand I understand not sending out an email).
so, the unreachable server includes the server in fiji ?
Here in Brazil is 7 am Sunday morning. It is the first time I go to my DH hosted site and it is down. Hope this core router problem be solved ASAP (the outage is solved now).
Bye!
don’t worry… be happy
A lot of hosting outfits would not bother to keep clients up-to-date with what’s happening. On that score, congrats to the Dreamhost team. Hope I still feel the same at the end of the weekend — by which time everything should be back in place for Dreamhost to maintain street cred.
If they have 3 datacenters and one goes down, shouldn’t the other 2 have all the data stored and take over the load? If this is not the case then what is the point of having the other two data centers, might as well just have one and charge us less money for hosting…
@Saurav Basu
Because this site is hosted completely off of Dreamhost systems, so that even if the entire system goes down, they can still notify us.
Lets all just go to bed ^_^
hope it’s fixed soon…
*sigh*
Hmmm…. so who does dreamhost use when even dreamhost goes down?
Most of my emails are working fine now (a couple aren’t, but s’okay) though the websites are still unreachable. I don’t mind downtime when it’s something I’m prepared for, and even then, I think that (for me) the fast and courteous tech support I’ve received makes up for a few down-times. My last host never, ever warned anyone about down-time, and they couldn’t be bothered to tell anyone when there was a system-wide problem, and I was paying much more for their service. There’s always a trade-off. I rather like the one I’ve found with Dreamhost.
I agree with harrisony, at least you get told when things are down so you know they are working on it. It’s a shame it’s down at the moment (and it’s 10:26 am here (GMT), so it’s causing me problems) but clearly they are working on it so let’s just sit tight!
I work for an ISP and one of its main revenues is data centre and hostings - and though we charge -a lot- more, we have generators and what not to pick up the slack etc
having had to put up network status messages on a regular basis, when a time isn’t specified it usually means they have no idea 
I’m with Aixsyd, bed time. My f5 key is getting worn out ^.^
It looks like things should be up soon now. It’s a matter of less than an hour.
that means it shouldn’t be long now.
remember this is probably not their datacenter alone.
It is likely shared. these kinds of facilities are too expensive for only one host to be in there.
So you can bet some non-DH people are also down.
Three things:
1) To those that say one shouldn’t complain because the service is cheap: not everyone is paying $8/month. Also, it seems to me that since even http://www.dreamhost.com is down, it’s not a matter of price. If they don’t have redundancy for themselves, who do they have redundancy for ?
Maybe things should be quantified: what kind of uptime for each class of accounts does DH aim to provide ?
2) Is Apple Store really down because of DH ?
3) What provider are they using for this site ? 
Thank you,
Davide
Wow, I was expecting for you to have much more downtime than this (even though I still can’t access anything)!
Thanks for the speedy work!
Lee
I don’t think you understand. When you have a business and customers are trying to reach your website and they can’t, what does that say about your business? Thats like you going to a 7 Eleven and the doors are locked… What’s the first thing your going to think? WTF?!??!?!?! Obviously the people that are cool with this are the people that have personal websites about their cats hosted here.
not yet
Thanks for the update. Good luck on the blade.
And how about having an open house to make it up to us customers and have King Taco do the catering?!
>>Ken Says: February 25th, 2007 at 3:30 am
>>Of course this has to happen on the night my site makes it to the homepage of digg.com >>…. why god why?
KARMA
Why dont you email us about this? the LEAST you could do is send an email out to all your clients to let us know.
I have just been abused and had my head torn off cause one of my customers sites was down. You guys do make me look incompetent at times eh! and I’ve always got to search for the problem that you already know about.
Please consider emailing us. Maybe the employee owned model does not work well, whos there to keep you all on your toes.
Waaaaaaa!!! I want my site back now!!! I want my mommy!!!
come on guys, just pay the electricity utility their money and flick the switch to ON
I was worrying here… I thought my site was down for another reason.
Hope it gets back up ASAP…. It still can’t be access via web browser!
Hey, None of my sites are up. And you know what? I don’t think it’s a big deal. They’ll be back. Rather have an outtage like this with the updates and the honesty then a provider that tells me all kinds of shite just to shut me up.
Hmm, a website for my cat??? Why didn’t *I* think of that …
Continua sin funcionarme, esto no esta bien, nada bien.
3.5 hours of downtime so far
Any ETA when things will be back?
Easy guys, this is not end of the world, I have few sites that not work right now..but I hope that guys from dreamhost will fix that…for price that they give to us..this is all ok…:)
Cool down folks… it’s not the end of the world!
lol CAFxX relaaaaax!!!
ciao CAF!!!
Hardware will always break upon power down/power up, glad it happened now and DH was on hand to make the repairs ASAP.
Good Luck DreamHost and Go Team !
Thanks to the DH folk for the update. It’s the middle of the night over there and you’re all working like maniacs to get our sites back up. I appreciate it.
I gotta say, though, in answer to a previous poster, eight bucks a month *is* a lot of money to some folk. DH is the most expensive webhost I’ve ever been with and to be frank, its reliability is about the same as the previous ones (although I gather DH is having a rough year, infrastructure-wise.) The value to me is in the customer service, such as having the intelligence to have a separately hosted status report site.
@ CAFxX: ciao CAF!!!
relaaaaax yourself!!!
@???
Is 7 Eleven run by servers? are servers always predictable? if you want to have a cry .go get hosting from (MT) (Media Temple) you pay for what you get. (MT)=Expensive but good, Dreamhost=cheap and good enough for me
and technically this isnt dreamhosts fault!
As far as customer service, Dreamhost has got to be THE ABSOLUTE WORST.
This entire system you have in place, is rediculous. Since you had prior knowledge of this incident, you could of directly emailed all customers notifying them of this disaster. Your customers do have other email addresses that can be reached, I know I do.
Forcing your customers to contantly check up on the instability of your service by way of this board is not only unprofessional, but a slap in the face to the people who put food on your table.
You have alot of nerve!.
Seems you forgot that I DO NOT NEED YOU, you need me. Their are other MORE stable hosting service providers out there.
This outage already has costed me over 1200 dollars in revenue.
Had you emailed me and notified me, I could of avoided the loss of revenue by using my back up hosting.
Once you finally get your system working, I will be cancelling my account immediatly with dreamhost, and will never recommend this company to anyone.
If your a simple webmaster ,hosting a simple site that doesnt involve putting food on the table then i guess service interruption like this is irrelevant to you.
But to a heavy hitter like myself, this is a mjor issue.
Hey biscuitz-guy - same inspiration to the same time?!
Best wishes from Switzerland, C.
lets all just have one MASSIVE freak out, and slit our wrists and we can just run Dreamhost out of business! First one who does it is a rotten….body…
Lets all just have one MASSIVE freak out! Lets all slit our wrists at the same time, and run DH out of business! Muhahaha!
Venting is great, but you know, if you really want to complain, maybe you should do it in an email instead of in a blog that isn’t actually going to change anything in the long run. It says on the front page that this blog is not an official way to notify Dreamhost of problems, and that would include griping over down-time.
*goes off to wait for my “cat” webpage to come back online …………… *
Geez. Get a life, folks. And if you run enterprise web sites, choose a more reliable (and more expensive) web host.
I just spent all yesterday getting my first ever web site the way I wanted it, only to find this in the morning. It was quite a shock, I can tell you!
I certainly agree with other comments made about emailing customers to let them know about any emergencies as they arise.
Keep up the good work guys, I really appreciate the work you are doing “in the mid of the night”
Relax guys and calm down:).
harrisony
Actually it is, if their POS system (pun intented) was run by Dreamhost they wouldn’t be able to sell you anything right now. And it is their fault for not having a contingency plan.
We all have experienced problems when switching back on computers. My own in-house file server blew its power supply the other week when switched back on after being turned off for a weekend. It had been running fine for over a year before that. I am just glad Dreamhost have the systems in place, and spare components, blades etc. to be able to fix the problem quickly.
This off-site status system with ‘warts and all’ posts and allowing customer comments really works for me, more so than the ‘we never admit a problem to the customer’ attitude of my domestic ISP company.
Lets hope we get back online quickly…. I am losing money, but on the whole I have been a Dreamhost customer since July 1998 and I still have not been given a valid reason to want to leave. This company rocks in my opinion.
What is a router blade?
I don’t understand why everyone asks for something failure free when we all know that everything will fail sometime!
1st rule: put yourselves in their place, and consider the factors…
Keep up the good work DH!
dreamhost.com and dreamhost panel are down like our web site . 
En España es bien de día y lo mínimo es que envien un mail antes avisando del blackout.
Muy mal.
Things like this happen, but it’s not so bad when we at least know what’s going on and approximately how long it should be to resolve the problem. Thank you for keeping us in the loop DreamHost.
The IT department at the company I work for could take a lesson from you. When there is a problem with our mail server … they email us to let us know what’s happening and when it should be up again. We usually get those emails right around the time the system is back up and running. I’m not sure I follow their line of reasoning, but at least it’s something to laugh about.
You guys actually have common sense, which isn’t all that common. Be proud.
de dia y con sol…
estoy de acuerdo, tendrían que avisar.
siguen perdiendo reputacion.
Well, I am about to renew my hosting plan (U$ 119) and after this I am in serious doubt. I think in the end dreamhost is not so reliable..there has been quite a few problems last year, and now this.
Hey dreamhost!!
Enough first DNS zone problem then all sites are down.. What is happining? REALLY ENOUGH!! I am looking for a new Host…
I am soo happy with your great effort and all my down sites!!!!!
@TOTALLY DISGUSTED: You’re a tool. If you’re losing $1,200 in three hours, you’re making almost $10k A DAY. That’s $300k a MONTH. You can afford dedicated colocated hosting, and YOU SHOULD HAVE IT. So, I’m calling you out as a liar. If you’re dumb enough to run a 3.5 million dollar business on $120 a year hosting (with a pretty damn good, honest, communicative company IMO) then you deserve the downtime.
Thanks for keeping us informed. I don’t mind problems as long as I know what they are, and that they will soon be fixed. If I was getting charged a ton of money I would be screaming blue murder, but DreamHost offers a ton of bandwidth for tiny prices, and 99 percent of the time the service is perfect, so I can’t complain.
Agreed, anyone that would willingly run mission critical websites on a budget webhost deserves a kick in the arse every now and again to wake them up.
@TOTALLY DISGUSTED: If you are the guy who make 1200 buck every 3 hours, then go and get your own server and stop blaming DH for power problem
Reading through these comments, leads me to believe a few things
a. majority of customers are no older than 12
b. this company over sells, claims to be able to provide service for all range of sites..personal or enterprise when in fact they do not.
c. am i the only one who finds the statement of ” THIS IS NOT THE WAY TO LOG A COMPLAINT- LOG IT THROUGH BLA BLA BLA” rediculous?
how can we log complaints IF YOUR SITE ISNT UP?
relax guys! its weekend… enjoy your weekend
### QUOTE ###
biscuitz.com Says:
February 25th, 2007 at 3:39 am
Easy guys, this is not end of the world, I have few sites that not work right now..but I hope that guys from dreamhost will fix that…for price that they give to us..this is all ok…:)
### RESPONSE ###
For the price we pay? we pay for hosting, they compete for our business like all other hosts. Down time is never good, and something any hosting company should do their utmost to minimise, hosting is the core of their business. Cheap means affordable, usually meaning they are able to operate a professional business using cost saving methods that do not impact on the actual business being able to provide its core services, ie employee owned = no greedy owner needs to be included in the price that sits back and does nothing but wait for his employee’s to earn his nice slice of the action.
If cheap pricing is provided because ‘we could be down for hours’ several times a year then the product should never be marketed to business’s.
The guys do provide great interface and functionality, their one click installs etc are amazingly simple, powerfull and easily customised, it is truly a fantastic service if we didnt have the stability issues. I’m staying loyal and hoping that stability will prevail in the long run, other than this, I have nothing but praise for the add ons in the control panel, easiest and quickest interfaces Ive used.
So the powers on… but the sites still aren’t working? hmm… That sucks.
But I’m glad this site is here to let me know whats going on
Hey,
you always get what you pay for.
So I can’t understand how someone could complain about this service interruption like this.
Here you get about 200 GB space with 2 TB transfer about 10 USD.
If you want a more reliable service go to someone better, which takes 1000 USD ore more per month for the same. Only in that case such a down-time would not be ok, and should never occur.
Guys
I appreciate all you are doing to restore the service but come on… why didn’t you email us to give us advanced notice of this outage.
This has a serious impact to your and importantly our reputation.
I have to say - the comments here amuse me more than a downtime could ever piss me off.
People, did dreamhost write anywhere what is their uptime ?
No they didn’t.
So, they do not guarantee a 99% uptime.
Shut up and let the guys solve the issues. Watch a movie in the meantime or something.
@TheHeartSmasher
lol, your spam would be more effective if your website wasn’t down like everything else on dreamhost.
I received a planned power outage notification right in my mail box 2 days ago (from this RSS feed).
http://www.dreamhoststatus.com/2007/02/22/planned-power-outage/
HEY GUYS!
ARE WE PAYING YOU FOR DOWN TIMES ? I’M PAYING UP SERVERS .I’M NOT PAYING DOWN SERVERS. YOUR PANEL AND YOUR MAIN WEB SITES ARE DOWN TOO . :MAD:
PLS DO YOU JOB .
ONE MORE DERAMHOST CLASSIC .
YOU HAVE CREATED ONE MORE DREAMHOST ENEMY .
I WILL WRITE THIS AT EVERY WEBMASTER FORUM .
I only knew about this planned outage by coming here since my site is unreachable. More importantly my mail is down too. I guess it’s being accepted / spooled somewhere?!
Another comment I will note that some people are freaking out a bit too much. I was a bit scared that someone was gonna think I tore down the site for no reason, but then I realized that no one’s gonna be awake at the time Sunday morning. For some around the globe, that’s a different story, but this kind of stuff happens, it’s just the way of electronics. I especially hate those that call themselves human beings yet they make crude comments and do not even identify themselves in their comment. If you want to be angry, that’s fine, but it’s your responsibility to check this page often if you’re the webmaster or the person paying for the service. My friend is the one who is renting the server space, I only own my domain name. He regularly checks this pages and will e-mail me about anything I should know.
Checking this page is very simple and RSS feeds facilitate that. I’ll put it this way, if you buy a new car but never look at the gas gauge until the car stops on the road, you’re irresponsible. It’s the same thing with anything you own. Buy a router, check the site for firmware updates at least once every 3-4 months. Buy a motherboard, make sure you have the latest BIOS. Upgrading PC hardware? Make sure you get the newest working drivers and make sure your BIOS and power supply support what you’re putting in. Renting web space? Make sure you know if there are going to be any problems. Yes, e-mails would’ve been nice, but then again, if they say to check this, add the RSS feeds about system-wide downtime to your e-mail or bookmarks, and you’re good. I know as a fact Thunderbird supports RSS feeds meaning, if you use that for your e-mail client, then send the system-wide status reports there and now you got your e-mail about the scheduled downtime. You can’t blame a company for telling you, at the location they asked you to look at, about scheduled downtime and then have you complaining that they somehow didn’t tell you.
Remember everyone, responsibility is key to being responsible. The person who said they lost $1200 in revenue could’ve prevented that not by a Dreamhost e-mail, but by making sure they kept up with their hosting service. Only now do they ask to be updated by e-mail, only now! If it was this big of a deal, then responsibility would’ve kicked in, and you would’ve notified Dreamhost that if they want your business, they will e-mail you concerning downtime. It’s logical. Dreamhost is not a babysitter. You should be glad they’re not mindless corporate money-hogs.
I believe that the hosting features provided by DH are great, some downtime is acceptable compared to other features I get from DH especially they keep us informed and updated about all the problems.
Aw poop. I wanted to get my portfolio done and finished- well at least a large chunk of it anyway. Hope you’re back up soon
this “pissed-off-ridiculous-get-a-life” comments amuse me so much :D
Does any one else feel like they walked into a bitching contest?? :p
They did put in Employee Owned Hosting.. Never really put in the expert web hosting hosting thingy kinda of stuff, I guess downtime are part and parcel of things here. 
Can’t really blame a $7 per month hosting. Haha…
I was going to spend my morning updating a few sites, but hey its no big problem, it’ll keep till later… the BIGGEST PROBLEM is im out of excuses….. im going to have to go to the gym!!!
@TheHeartSmasher
lol, your spam would be more effective if your website wasn’t down like everything else on dreamhost.
—
Hahah. Good One!
Still can’t access my sites now from Europe
Johnny - I got the same feeling.
Glass Half Empty: Downtime Suck! Its 10 hours of my sites life lost.
Glass Half Full:
I get the best of everything from dreamhost.
I never have to deal with issues.
Fast support.
Live News.
@ everyone complaining: if you do not like dreamhost go to tripod.com, where you will pay $19/month and your site maybe down for 3 days, and the only space you get is 50mb disk and 250mb bandwidth. STOP COMPLAINING! You are all getting great service. I am sure they are working hard into the night day or what ever it is there. Its good having 3 shifts let alone 24/7 status updates.
I think that it is time to say BYE BYE Dreamhost, the service that you provide is worth nothing if you can not notify such incidents in advance. Expect my account to be closed as soon as you have power up!!!
@everyone whining: Why are you complaining so much? Dreamhost provide you with cheap hosting and they’re really not as unreliable as youre making them out to be. Also, if you regularly checked this page, you’d know that they gave you plenty of warning that there was going to be downtime. If you knew anything about technology, you’d know its touchy and things never go to plan. So give DH a break, they’re at least keeping you up to date and sorting stuff out. Peel yourselves off your chair, go outside and chill.
geez,
all my sites are down
but my worry is my svn is on this server, so I cant commit or deploy my code elsewhere.
@ everyone complaining: if you do not like dreamhost go to tripod.com, where you will pay $19/month and your site maybe down for 3 days, and the only space you get is 50mb disk and 250mb bandwidth. STOP COMPLAINING! You are all getting great service. I am sure they are working hard into the night day or what ever it is there. Its good having 3 shifts let alone 24/7 status updates.
Bargain!!!, im going there now
Hmmm how the heck did you ever become a webmaster with such bad English and attitude ?
Please tell me i would also like to buy that degree
Meh, this isn’t to much of a problem I am in the Uk and its 11:19 am and bobody is awake still. We are lazy shits here. The only problem is I host many files so now some pages that people in japan need are gone… they will live:) Sure it will be up soon enough. I think everyone needs to take a seat back and realise shit happens and at least they are their to fix it.
It’s a brave move putting up a blog to communicate things like this to your customer base. I’ve only been a customer for a few weeks, and I’ve gotta say I like the open approach.
Having recently been through similar myself in my daytime job I can imagine what’s going on in the racks - keep at it guys. Unlike TOTALLY DISGUSTED (dude, 99.96% uptime comes at more than $10/month in the real world), I *will* be keeping my business with DH.
@Sam
DH does oversell, they say so themselves! At least they don’t deny it.
As for redundancy, no they don’t claim it nor do they advertise it. You want that, you get that from somewhere that does that, and you pay more.
Uh, dipshits, yes, enterprise servers go down too. Universities go down. Google’s gone down before. Yahoo too. Nothing is infinitely available. The Yamanote loop line around Tokyo is the single busiest train line in the world. It too goes down occasionally. That’s life. If your clients are complaining, then it is YOUR fault for not making them aware of this potential before, and for not building your own redundancy, or contingency plan.
Like any business, if you don’t like it, go elsewhere or start your own. If terms of your contract have been violated, and it’s worth enough money to you, call a stinking lawyer.
Me? I’m gonna write here until my shits up again. and hope for it.
Clients? I tell them the reality of the situation. If they want cheap, they go with shared hosting and get all that entails. They want guarantees of service with stipulations, they go with expensive.
How long does it really take to replace a blade? Come on folks.. Wake up someone who can do it if you can’t!!
You 8$ whiners .. No the ones saying noone has the right to complain need to get lost. WHY are you even on here? Some of us lose allot of money and face when theres an outage. So what we use dreamhost. Is that some sort of reason we should expect crap service? If you think that then your the idiots.
I cant afford to have another rack at my colo, and like Dreamhost.. So what! If its broke and I pay for it I’ll complain…exspecially if I’m up because of 4 phone calls this Sunday morning.
dh still a good hosting even my 50 sites all down.
you got you paid for!
once a year not a big P.
just relax!
I think it’s a bit ironic that the servers go down right in the midst of me transferring files OFF of Dreamhost as I’m transferring to a more reliable solution. I lived through the mess of last summer and switched in August for my business sites. Kept my personal sites on here just because I didn’t need as much reliability. Decided to consolidate as I can get better service from another provider for the same amount of money.
This just reminds me of why I’m moving away from DH.
You know, I don’t enjoy the downtime either, and I’m still a bit ticked about the way the PHP upgrade was handled, but having part of the router fail from a power cycle isn’t something that can be predicted. I seriously doubt that the Dreamhost folks are any happier about this than we are, and I would say they’re probably getting a tad ticked at Cisco with all the router issues they’ve had.
Besides, the blade was obviously going to fail eventually anyway. Would you have preferred it fail now and make a single outage longer or fail later and cause a second, unplanned, outage?
How much will this last still?? My site down!!
Well Well…..not only do I have to contend with a major shut down but I also have to deal with an issue over phpbb:
[quote]It appears that your site is currently using a large amount of CPU time on the server you are hosted on (named “mug”). Currently there are three php.cgi processes each using 30% of the CPU, and it is making the load averages on the server to go up. I have had to disable your site because it is making the load averages on the server to stay up between 15.00 and 25.00. This is unacceptable. Please let me know when you have taken the necessary steps to make sure that your site doesn’t use as such large levels of CPU time. Thanks! Christian[/quote]
Seems like it never rains but it pours
i sincerly hope the DH techs are scurrying around.
i ‘event’ might have a side effect of ppl realizing how much we depend on Dreamhost
@Saturn2888
Yes, for some around the globe is totally a different story…here in Italy it’s 12.22…and my site is still down…4 hours down since 8 a.m to now…
My sites still offline :S
dont drink the water it contains parepin
@Xiphias: Indeed, I am drinking Aquafina at this very moment. My water of choice however is Poland Spring. I find water is wet, mostly.
@bye bye or what ever your name is: I sit in my chair reading this page laughing at all you guys whinning, the reason I pointed you out is your crazy. I mean your site better be GOOGLE, and if it was you should have your own server hosting the site. I think its funny how some of you think your site means a freakin wink on the internet.
oh and bye bye, good luck finding a host like dreamhost, few dare to go this far with users. if you want have this space your looking at $40 - $70 bucks a month.
Ugh. Seriously, ugh. It’s quite ironic how I am apologizing to my “clients” for something that I can do nothing about. I hate having my credibility tied up in this mix…
Relax people, enjoy the weekend.
Dreamhost doesn’t deserve any bashing, the service they provide for the money they charge is unbelievable, when I first signed up I was just waiting for the network to go down and never come back up with an email “it was all a dream”, two years later I am still pleased. Those who claim to have had better hosting for this price have obviously not been with any other hosts, or their websites don’t get more than 5 visitors a day.
I am sure this guys is working hard to fix the problem..
As far as E-mail notifications go, I think DH does need to clarify things a bit there. This blog grew out of what was originally just an _Emergency_ status page. I suspect I’m not alone in still thinking of it that way, I didn’t realize the panel notice says that all announcements will be on this blog until Dallas said something about this being the official notification site. (I thought the notice said something different, I think it used to, but I can’t prove that.)
I would suggest that DH puts in the next newsletter a section announcing/explaining that this blog is where ALL announcements will be made about outages/upgrades/etc. That way those expecting E-mail notifications will get an E-mail telling them that’s not how it works, and also telling them where to get the info they need.
I honestly don’t remember this ever being mentioned in the newsletter before, it may have and I missed it, but even if so it won’t hurt to mention it again. They could just put it in every newsletter even, that way no one can claim they weren’t informed.
demonsurf: greetings from Poland
dh: why it’s taking so long? everything is still down (even xmpp)
I am very disappointed on dreamhost ,:(
mmm i love water… especially the wet kind :p
HAHAHAHA!!!
worst part, that conversation sounds more interesting the rest of the B/S here :p
WOW! look at all the jealousy.
DreamHost advertises itself as being able to meet the demand when in fact it doesnt.
DreamHost claims and Advertises itself to big enterprise sites, and small.
You have no clue as to what plan I have with DreamHost, So go back to posting pictures of your sisters girlfriends and claiming them as your girlfriends.
Calling me out? ha!!
Instead of counting my money, you should be counting yours since you have to come up with this months payment of 10 dollars for your nonsense yahoo booter website.
As far as all the comments saying” what do you expect for 10 bucks a month etc etc.- JUST BECAUSE YOU HAVE THEIR BASIC PLAN, DOESNT MEAN EVERYONE ELSE DOES.
If a hosting company is offerring that type of bandwidth, its sure to attract enterprise websites. What will a 12 year old with a website about his fantasy car need that amount of bandwidth/storage.
Bottom line is this:
Its my money.
I pay you for a service that you claim and advertise that you provide.
If you cant handle the big fish, then be straight and honest.
Do business to a level of class that you can handle.
To advertise and claim that your service is fully able to handle a broad spectrum of service, Claim to have the best customer support system, then have the odascity to leave the customer in the dark and force the customer to incorporate a daily regime of checking on the stability of your service is unexceptable.
Its unprofessional to say the least.
BTW, any person with a point 12 i.q. can realize all these comments praising dreamhost are from dreamhosts staff.
Where ever you are in world (day or night), it is weekend!!
So, no business or very less it is not considered as loss.
Enjoy your weekend
@ Enjoy @
…. this sucks. I understand it’s out of your control, but it’s been a really poor start to the year guys. Really poor.
Well, I have a dedicated server at DH, 400$/month, don`t tell me I can`t bitch about it.
Anyway, in a week i`m gone to a proper datacenter…
To be honest I prefer my water hard, like Frozen and stuff.
ANYWAYS
how far away are we guys??
keep up the hard work
Regards
Jase.
Respected Dreamhosters,
Sure we can wait.
With 40+ websites down I am still happy.
At least I have an excuse for not working on my sites and playing with my kids
@relax: Not when you are located in Germany and all your eBay auctions end in 50 minutes …
TOTALLY DISGUSTED, you’re an imbecile.
“BTW, any person with a point 12 i.q. can realize all these comments praising dreamhost are from dreamhosts staff.”
Oh please…
@TOTALLY DISGUSTED: If youre not happy with the service, then stop complaining and go elsewhere. Im sure Dreamhost has better things to do than put up with whiney customers like you.
We had choice DREAMhost. We should dream at a host or we should have a host like a dream?
This is getting ridiculuos, and yes, I am complaining. Don’t care how cheap dreamhost is. They are still offering a service. So get on with it guys.
11.34am here in the UK Sunday morning when I like to get things done but the reason we are with Dreamhost is value for money. Lets not judge them on this first problem of 2007 let us judge them at the end of the year. If this is the only prblem all year then it is still good value for money. I wouldn’t mind Dreamhost offering a back-up option for members, even if it meant those members paying say $50 a year each as a kind of insurance policy, a take it or leave it option. You could say YES I will pay the $50 extra and you know you have your site on a back-up located elsewhere or no and suffer if these things happen.
cold beer? more storage? yay!
still no mail or websites…
Oh, guess what? I heard Google broke off talks to buy DH!
casi la 1 de la tarde aqui en España y desde las 9 sin servicio, .
Creo que en breve migraré todos mis dominios en Dreamchoft, un poco mas de $ merecerá la pena.
i like totally disgusteds way off try to push the blame on dreamhost.
one question though: what email client do you use?
@Alms
Why are you here? Godaddy is offering a decent deal..I might just take your advise.
I can agree, DH definitely SHOULD send out email announcements of major outtages.
DH should also look into offsite redundancies.
But I’m happy for what it is for the price it is and for what I’m currently doing with it.
Thank god its controlled. xD
I formatted my PC like, yesterday so I havent had a chance to backup my files. When i woke up and noticed the site wasnt working and I couldnt get on to FTP I crapped myself XD
Glad it should be back online soon.
“Dreamhost doesn’t deserve any bashing, the service they provide for the money they charge is unbelievable, when I first signed up I was just waiting for the network to go down and never come back up with an email “it was all a dream”, two years later I am still pleased. Those who claim to have had better hosting for this price have obviously not been with any other hosts, or their websites don’t get more than 5 visitors a day. ”
Agreed! Dreamhost is my far the best hosting ive ever had. Ive had busy sites before but never have I had my site down only once in a year. It would usually be more like 3 a month. x.x Its haaaard to built traffic under those conditions >_
hang in there guys, maybe you can get google to inject some funds to pay for a half a dozen generators, tho i realise it cant be easy when you loose all power
keep up the updates! good luck guys!
cheers
leigh
Hmmm, who should we blame then? I know, ourselves for sticking with such a lame service.
Just get it back as soon as you can! (this is my second outage… I guess I’ve been lucky)
Ya’ll need to lighten up. Shit happens, stuff breaks and people lose sleep to fix it. Show me one ISP who hasn’t gone thru’ this at some point over the years, and thru’ their growth. If losing access to a few blogs and such makes you this cranky, you need to get laid or something.
@ relax:
we run several membership sites with dreamhost, and it’s during weekends we get the most signups.
@ @ all people running their cat’s websites:
it seems you cannot understand such things, so go to bed (again).
Can you please hurry up.
yo contraté dreamhost hace una semana y ya con estos problemas
encima ahora mismo estoy en pleno efecto digg y efecto meneame y estoy perdiendo posiblemente cientos de visitas y lo peor de todo, la falta de seriedad que genera el que una web no este online en la cantidad de gente que está intentando entrar a traves de meneame y otras páginas que me han enlazado, y sobre todo lo que pensarán los que me han enlazado y comprueben que mi web esta off
espero que lo solucionen rápido, en españa es de día y como se prolongue la situación podría hacer mucho daño
Well i don’t think complaining here is going to get anything done faster…
come on guys… they provided us with this space, can’t we just have some fun and play a game instead of bitching to kill time?????
Heres a game=>
“What are you listening to”… put some music on and say what your listening to….
me=> Saliva “always”…. great song :p
Ha, ha these comments are so funny. Seriously, it’s pretty well known that you don’t host a major site with dreamhost, but for little sites it’s fine.
I am not part of Dreamhost staff.
Thanks for the update! I was getting a bit hysterical and then I remembered about this status update page hehe.
Keep up the good work!
$10 it wont be up in the next hour any takers ?
s
Still , still can NOT access my website,
still can NOT access dreamhost main page,
still can NOT ……
Glad to hear you’re sorting the problem
Hey, I’m glad. This frees me up from my routine morning junkmail sifting! : )
Of course it’ll be much more laborious tomorrow!
So, 1.000 comments above this, someone mentioned that the dedicated boxes are up.
I WISH… they are not. at least ours isnt. (nor is our cat’s)
Upsets me not because we’re loosing money, … as we are a non profit, but, because people are not getting to the information they need, and the email is CRUCIAL 24/7
Contract is almost up, and now, we’re seriously thinking for that much $$$ … gotta be a better place? (6+K/yr)
@Membershit sites
boohooo!
cry me a river.
You got that much traffic and money on the line?
Build your own stinking server. Pay for a T3 line or better.
Good luck with that. Start weighing the cost/benefit ratios between that and DH
This is bullshit
i have sites on a couple of hosting services, and i keep moving more and more sites to dreamhost. this is the second downtime i have experienced with dreamhost since i’m here (about a year i think), which is ok comparing to the countless issues i had with other hosting companies (like powweb which i liked very much before they had a new owner).
4 hours offline… i can definitely live with that. had these kind of problems even on a dedicated server with another company. you can’t have 100% uptime unless you have lots of backup servers in different physical areas.
@alcoholic1: $10, thats just over a months worth of hosting :-p
I just lost 10000000 in sales!
My opintion:
Do not increase every week the diskspace and transfer. To buy every time new servers to give this space it is smarter to improve the stable service ..
Greets
Peter
Me too waiting for the sites to be up…
I think we have some of the worst luck in terms of the timing of these outages. Every time we have a big match (soccer) and our site is likely to be at it’s busiest, then something farts and the site goes down.
I’m guessing, so far, that we’ve lost about 5000 to 6000 site hits (for today) and the advertising revenue that would have generated, not to mention new users who always appear on days like this who may not come back and all those people around the world who rely on our site for information about whats going on during the match due to a media block outside the UK for Radio Transmissions.
30 minutes till kick-off……I live in hope of a resolution by then!!!!
@Alcoholic1
i got nothin better to do… i’ll get in on that action :p
5 hours of downtime and counting.. No backups, no redundancy - who cares
Haha, the guy claiming losing money makes reading these comments interesting. I never really understood who goes for the higher priced, same service, package, what’s the point, callbacks or something? If a site is down what the hell do you need a call back for, they’re just gonna say “the site is down”.
People who make serious money from their websites (thousands a day) and choose to do it on shared hosting, whether it costs $7 or $70 a month, are people who don’t take running a professional business seriously and their customers should be warned, silver linings and all.
Dreamhost = best host I’ve been with so far, and that includes 5 different shared hosting providers. There were more reliable ones that would only tolerate sites with no visitors (that’s when I learned why they were reliable), some that went down for days on end because the sysadmin doesn’t work on weekends, some which cost twice as much for a hundredth of the resources and those whose customer service needs and explanation on what I mean by “server”.
Go DreamHost!
ok, time to find a new host
i’m losing a fuckload of money, thank youz dreamhost
What’s next ???
@TheHeartSmasher
“Just trying to figure out why I have a little over 50,000 hits and only 67 registered users”
I imagine it’s because your rather ugly vbulletin based CMS seems to offer very little unique content (on the other hand, even if it did, your site was too hard on the eyes for me to find whatever it is you’re uniquely offering).
Well, I switched to dreamhost after a similar, but less time lasting issue with bluehost.com
Now I am covinced you get what you pay. I am already (in this moment) looking for more reliable providers (price is important, but peace of mind is more important) - any ideas/advices?
DON’T LARGE ORGANISATIONS NORMALLY HAVE REDUNDANCY / MIRRORS ?
Anybody know an ISP that does?
I think e-mails should be sent out. I’m appalled they aren’t. I’ve only just joined Dreamhost (so am a bit annoyed that they’re down so quickly), but if this is the only outage for a while, I’ll be happy. Every host I’ve been with has had downtime, and often that’s during the evening peak when things get busy and it’s really annoying.
If this blade hadn’t messed up, I wouldn’t have even noticed. Now that blade is down, I have. Why is it taking 2 hours to repair a blade server? Surely that’s the whole point of blades - you can just swap a new one in! If you haven’t got a spare, then why not!
So I’m fine with the power outage, but needed an e-mail to tell me, and I’m disgusted at the blade situation.
Let’s hope this doesn’t continue guys. 97 days I get, don’t I…
If you don’t have the time or the wherewithal to check an RSS feed (namely this one), which gave you advance notice on the 22nd, then I’m not sure what good an e-mail notification would have done you. Hell, you can get an e-mail notification service to e-mail you when this site changes if you can’t spell RSS. Change and maintenance windows happen–and if you’re having issues and there was never any communication, then yeah, you could smack DH around till the cows come home. But if you’re given advance notice (which you were via this service) and you didn’t take steps to inform your readers/customers or switch to your backup service or whatever AND this downtime is an issue because of that, then the root cause of your issue is PEBCAK. Once you figure that out, you can learn from your mistake. Good luck.
Yeah! This is totally unacceptable! I can’t believe how DreamHost doesn’t provide octuple redundant hosting, and failsafe plans in case someone nukes the northern hemisphere. I also demand they debug and optimise my sites and, failing that, provide a dedicated server for them at no extra cost, because their servers failed to meet the demand placed by my site. Finally, I demand they send over someone to give me a foot massage. Daily.
Regards,
A very disgruntled customer…
Glad they are fixing stuff like this now instead of letting it break down during our workday. People that are bitching are just bored - it’s 5am and no one else is awake for them to annoy.
It’s funny the people who ask when things will be back up again. Do you think DH is just going to delay things for fun? Maybe things are already fixed but they are sitting around saying “Let’s just keep things down for an extra hour for the heck of it!” Of course not. It will be back up as soon as possible. Same as when the power goes out to your house.. The power company will fix it as quickly as possible.
For me the timing of this outage isn’t great (I’m in GMT+2 so it’s 2pm here) but I’m not complaining. Outages happen. For my real business, I pay $1500+ per month to colo servers at a datacenter. DH provides good value for the money, and a few hours of downtime per year is acceptable for the price. I would not accept that level of downtime from the company I pay $1500/month to of course, but that’s why they are so expensive.
You can threaten to leave DH and that’s your prerogative. Go ahead and leave if you like — any one customer accounts for such a tiny percentage of business that they will not be impacted. Even if 5% of customers left (highly unlikely), the impact on their business will likely not be that great as it lowers their variable costs anyway.
im scaring.. :/
hmmpff
I wonder just how much some of you guys are really suffering, having your websites down in the dead of night on a Sunday! Chill out, grab a beer, enjoy the silence!
Thanks for keeping us posted and working on it! Honestly knowing that there are updates keeps me sane! I dont mind the downtime as long as I am kept informed! Dreamhost gets two thumbs up for keeping me informed! Thanks!
I’ve had ham sandwiches for dinner
what’s your favorite animal
sorry wrong board
What’s going on with the router? Any plans to have a redundant one for situations like this? Anyways, hope things come back on soon. Let us know!
Dreamhost has been the best host I have ever used - by far. A few downtime hours on a Sunday morning ain’t gonna kill anyone. =)
I mean, for about $90 a year, I am hosting something like 15 sites. Who else can offer that service?
(Waiting contently..)
no update for 2 hours. You just don’t care do you?
In the UK, my customers have been without service since they woke up this morning - it’s now noon. They might well leave me, should I stay with you?
Blade, shmade!!!!
The Power Outage is over, so this is Dreamhost’s fault!
Here in LONDON, ENGLAND it is weekend, NOON.
This is the ultimate time for working on personal web projects.
NO MORE EXCUSES! One more of these incidents and I’m switching company. The price is not a factor for me, but I really like the ‘one click installs’. Time is money - GET A MOVE ON!
still not working
You can always expect the unexpected with such a cheap service, however I wish you good luck, Dreamhost - your hosting is great when it is online!
its 2pm here and not had any access all morning - not all dreamhost users are in US
I don’t think it’s the power outage that’s the issue. Not even the fact I don’t get e-mails. It’s the fact it’s taken 2 hours to repair a blade server.
No, I don’t think it’s deliberate, and I know they’re working their socks off, but I do think it’s poor. There should be a backup core router. It’s nothing to do with the price, it’s to do with common sense.
I swapped over to dreamhost 2 months ago and im afraid to say I’ve already decided I will not be renewing my hosting after this year is over.
I have experience more downtime, problems (mail outages, system wide downtime, panel downtime, etc) over the past 2 months that I’ve been with DH then what I’ve ever in the 3 years I was with my previous host. (I had to leave them because my site was going and the plans they offered were not good enough)
Why does that happen every time I need to update my site Hurry up guys.
I can totally understand that electricity failures happen, but I have to say a simple email to customers as soon as you found out would have been very helpful.
I run a few forums and can just imagine the hassle I am going to get explaining this, when I could have posted up a notice about it and let people know what was going to happen.
thnx
I love dreamhost’s hosting plans, and I’m okay with experiencing some down time, although e-mail notification would’ve been nice, it wasn’t expected. I’m staying with dreamhost, despite any problems, I love having so much space and bandwidth for such a small amount of dosh! ^_^
Quote: “omg”
”
ok, time to find a new host
i’m losing a fuckload of money, thank youz dreamhost ”
If you’ve lost so much money in a matter of 4 hours you must be fucking rich from all the other days that dreamhost have been up.
You have to pay more for common sense
Thanks for the update and working to get everyone back online!
HistoriasDelMotor@ Muy buenas tío, me alegro encontrar a un español aquí. Llevo con ellos un poco más de un año, y la verdad que no había tenido un problema con ellos hasta el día de hoy, así que no te desanimes que esto no es la tónica de todas las semanas.
La verdad que para los que tienen contratado un servidor dedicado es una gran putada, tenían que haber pensado en tener servidores descentralizados.
Un saludo.
It’s been hours now and it’s getting rather annoying. Is there any chance it is going to be back up anytime soon?
@{all DH Users} From an Architects Point of View, you could do *Hedging*. You can, at least what is concerning websites, split the risk up like this:
book a 5MB (or even 1MB), 99,999999% availability plan at some AKAMAI like hoster, which has redundancy across continents. You need only to host the FIRST Page of your Site on it, so you don’t need much space and it won’t cost the world. THis first page will redirect then to the DH Site where the rest is held, or in a case like today give your customers / site visitors a page which explains the downtime, so that the first page of your site AKA your public face is always UP. For mail and DNS there are hedging solutions too. Anyway, this is a small subchapter out of Redundancy 101, as I teach my students.
@{all who think it is night and it won’t bother anyone} dont be so US-centric, many of us clients are in Europe or in ASIA WHERE IT IS ACTUALLY DAY
Cheers,
AlexX
The old saying, you get what you pay for applies here. This being said, WTF. Seriously. How can you guys not have redundant backups or whatever? I mean if power to your building goes down, you SHOULD have back ups. Other hosts do.
I have had my site off line or unreachable, or crazy slow more than 20 times in February. I’ve done trace routes, I am on a 25mbs connection so no, it’s not on this end.
Keep the good work! .. first!