Spunky and Central Move
We’re about to begin to move the spunky cluster and our central machines. We’ll be taking down servers soon, but our status site, of course, will remain up and running.
Again, we’ll try to keep this move quick and painless as we possibly can, and we apologize for the inconvenience.
For more details on this, see the previous post here:
http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/
UPDATE — Sat Mar 22 00:12:05 PDT 2008 –
Most central functions are back up. Dreamhost.com and panel.dreamhost.com are working again. We are currently working on webmail. The spunky cluster move is still underway. We’ll post more here later.
UPDATE — Sat Mar 22 02:45:26 PDT 2008 –
Webmail is up! 99% of all central services are functioning now. Spunky is 80% racked, more info on that to follow.
UPDATE — Sat Mar 22 03:40:27 PDT 2008 –
Spunky is coming up. We’re spotchecking and fixing troubled file, web, and mail servers. We’ll sound an all when all is clear… We will likely be firefighting for the next few hours.
UPDATE — Sat Mar 22 06:01:28 PDT 2008 –
Spunky is still coming up, we’re dealing with a couple of machines that didn’t survive the move and some more cleanup stuff. We’ll keep you posted as things progress!
UPDATE — Sat Mar 22 07:04:35 PDT 2008 –
We have noticed a problem with some of our networks. They seemingly did not make the jump to the new router and we are looking into that. Any websites with IP addresses that look like either 64.111.xxx.xxx or 208.113.xxx.xxx are down to the outside world right now. The machines themselves are up so as soon as the networks are working again they’ll begin working immediately.
UPDATE — Sat Mar 22 09:55:54 PDT 2008 –
The networking problem has been resolved with our network provider so as of right now all services should be up and running. If anything is not working, please open a new support message from our web panel.
.
March 21st, 2008 at 8:45 pm
My only complaint is that I received no heads up warning about this. If things need to be moved, they need to be moved. A little warning would have been nice is all I am saying.
March 21st, 2008 at 8:46 pm
Geez, I was in the middle of a shower and suddenly my site stops working? I got soap in my eye here, Dreamhost!!
March 21st, 2008 at 8:46 pm
Do you realize that is exactly the same as saying, “Being too stupid to subscribe to an RSS feed was absolutely necessary in this situation”?
Everyone that WANTS to be kept up to date… is.
And if they did send out emails, all the whiners would be here complaining about how unreliable email is and demand that there be an RSS feed. Waaaaaaaaaaaaaaaa.
March 21st, 2008 at 8:47 pm
Well, it’s the weekend…which means another server outage.
March 21st, 2008 at 8:49 pm
I’m pretty sure a weeks notice counts as a “heads up warning.”
It’s only been said a few hundred times though, so I’m not expecting it to sink in for you just yet.
March 21st, 2008 at 8:49 pm
MY SITE IS DOWN. ITS OFFICIAL. BE BACK ON SOON (HOPEFULLY).
March 21st, 2008 at 8:50 pm
This is a great source of amusment. Sending an email to over 600 000 people? Yes that seems perfectly logical….
I agree that some sort of warning would have been nice, but to be honest, it is 12 hours of you people’s lives. I assure you that you will survive without your websites for a mere twelve (going on eleven now) hours.
March 21st, 2008 at 8:50 pm
Happy Easter!?!?!
March 21st, 2008 at 8:51 pm
Funny thing is that even people outside the cluster are being affected! We are on pacey and web/email is up, but sql is down… rendering us inoperable all the same - this a a ‘bonus’ for us because we already had our allotted 12 hours of guaranteed downtime during the spacey move in january.
Gotta say, I *love* dreamhost’s support, their control panel and their pricing - but the downtime is just making it that much more difficult to keep singing their praises!
March 21st, 2008 at 8:51 pm
Actually, as a side note, I did in fact know about this move and scheduled downtime about a week ago, so I suppose they did put out a warning, if not as good as it should have been, it was still there.
March 21st, 2008 at 8:56 pm
Hmm, a 3 minute break between posts. That is rare!
Jessica, I am no DreamHost obsessor, but I can say that I knew about the scheduled downtime, and the reason for it, around a week ago.
March 21st, 2008 at 8:56 pm
I love that song……
March 21st, 2008 at 9:04 pm
Shawn, you’re a little bit on the annoying little shite side, aren’t you?
Just because you are so incredibly acquainted with the frequency of DH downtimes and the number of people who genuinely get upset about it does not mean that “you should have subscribed to this blog” is anything close to a reasonable solution, nor does your pissant little “waaa” comments help to soothe matters between DH and their already irate customers. I think you could actually help relations a tad bit by merely stfu-ing.
@Jason - a) I think 600k is way off the mark, and b) DH sends out periodic newsletters telling their customers how great they are… sending out a warning about downtime to make sure people know isn’t only reasonable, it’s expected. Hostrocket notifies of upcoming changes to all of their customers on a regular basis, even the free accounts.
March 21st, 2008 at 9:04 pm
Did you guys mean to take out DNS for all of the hosts that are still running?
[yoda]$ nslookup www.google.com
;; connection timed out; no servers could be reached
I’d report this in the panel…but it seems to be down.
March 21st, 2008 at 9:04 pm
My SQL servers are down.
March 21st, 2008 at 9:06 pm
My site is down, ftp is down, panel is down; can’t report the problem to anybody. Suggestions?
March 21st, 2008 at 9:07 pm
Email is the right channel for this type of planned downtime.
With a feed, you must read it like this:
DAY 1: sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big deal”
DAY 2: sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big deal”
DAY 3: sdkf “no big deal” sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big DAY 4: deal” sdflsdjf sdkf “no big deal” sdflsdjf sdkf “no big deal” BIG DEAL! sdflsdjf sdkf “no big DAY 5: deal”sdflsdjf sdkf “no big deal”sdflsdjf sdkf “no big deal”sdflsdjf sdkf “no big deal”sdflsdjf DAY 6: sdkf “no big deal”
See the message that affects you?
Here’s how emails work.
DAY 1: DUDE, YOUR SITE IS GOING DOWN NEXT WEEK FOR 12 HOURS.
Cool; got it. Thanks.
They brought down 100’s of servers without communicating directly with the admins. No bueno…
If they fire out a monthly newsletter, they can shoot me a quick email telling me my server will be down. Most people understand that this will happen on occasion with hosting plans like this.
Anyway, I’m looking forward to the resurrection after this Good Friday downtime.
Over and out…
March 21st, 2008 at 9:07 pm
be quick!
be quick!
March 21st, 2008 at 9:07 pm
Damn you RI! LOL!
March 21st, 2008 at 9:11 pm
“Truckload of fail brought to you by Dreamhost.com”
asses.
March 21st, 2008 at 9:13 pm
@Michael VanDeMar: I stand corrected, I honestly had forgotten about the monthly newsletter. Also, I have to agree, Damn you RI! I
March 21st, 2008 at 9:14 pm
I do think that in the case of super-critical things like this, that are scheduled, an e-mail to users who have content hosted on the affected servers would be a good policy to consider, in the future.
March 21st, 2008 at 9:16 pm
some of us prefer email, some prefer the RSS feed. I find it inconvenient to stay subscribed to the RSS feed. maybe DH could give us an option for what WE (the people who pay for it, the people who matter..) prefer. I prefer mail, and obviously a lot of the rest of y’all do. the option would be nice. I have a business to run, like everyone else on here, I cannot have this downtime. the website being down doesn’t bother me so much, but I can’t afford to be without my email server. Thanks a lot. I pay too much money for the amount of downtime I’ve experienced in the past years I’ve been a member. The service *was* great, but I will be finding another host. DH, you’ve failed to understand that it’s the customers that pay your salaries and for your equipment, and as any business knows, success is completely dependent on having happy customers. Obviously, you do not care, or I would think you’d be a little more conscious to how all this downtime affects *us*.
btw: my work grinds to a complete halt when I’m without my email. who’s going to make up for the loss of income I’m experiencing right now? I hope none of my clients are trying to contact me right now, or I will be sending them straight to you for an explanation.
March 21st, 2008 at 9:20 pm
First the billing goof-up where DH charged all their customers. Now this! Someone needs to be fired from their executive team.
March 21st, 2008 at 9:21 pm
I hope that this problem should be resolved quickly !
March 21st, 2008 at 9:21 pm
So, you looked everywhere, except for where you’re supposed? That makes you an airhead.
Instead, you come to place where you ARE notified, to claim that you haven’t been.
Send Dreamhost a support ticket telling them it’s their fault that you’re too stupid to figure out the RSS subscription that keeps everyone with a brain up to date. They’ll send a tech right out to flip the switch on the back of your head to the “On” position.
Yes, actually, you are. Very.
Know how you can spot the ones that aren’t stupid? They’re the ones that stay up to date and don’t come here claiming there was no warning, when there has been for a week.
March 21st, 2008 at 9:23 pm
Some of us prefer to stay up to date, rather than look like dumbasses, so we subscribe to the RSS instead of crying about email. This is how it has been for a very LONG TIME. Real quick learners around here.
It makes more sense for them to post it once, than to send out hundreds of thousands of emails that say the same thing.
March 21st, 2008 at 9:26 pm
Another funny thing about you illiterate morons that think email is the way to go, is that you’re the same people that would be dumb enough to use your dreamhost email address for receiving them… and you would be here complaining about not getting an email telling you when your mail server is down.
March 21st, 2008 at 9:27 pm
Another airhead that thinks this site was built specifically for unchallenged little baby tantrums?
If you don’t like getting called an idiot, then stop being one on sites where people can reply to point it out.
March 21st, 2008 at 9:28 pm
http://elliottback.com/wp/archives/2007/05/03/dreamhost-sucks-at-hosting/
March 21st, 2008 at 9:29 pm
This is absolutely ridiculous. At least send an email out to people affected and say “Hey, we’re pulling the plug on your server, don’t expect your website to work!”. I’m trying to sell a car and all of my pictures are down all the sudden when I try to submit them. And of course, my files are on the server, and not my computer, so I can’t upload them somewhere else. I’m just stuck waiting until you guys get this finished. Thanks.
March 21st, 2008 at 9:30 pm
You already attempted this move a week ago, what happened? Why are you bringing down sites yet again? Why don’t you have a plan that leaves websites and services up while you’re making your move, as most competent web hosts do?
This hosting company is turning into one of the worst out there. Constant headaches from mistakes, downtimes, what’s next?
March 21st, 2008 at 9:30 pm
I think such a *big planned move* requires that dreamhost emails about the planned downtime to the affected webmasters. Not everyone subscribes to the dreamhost status alerts. It will definitely go a long way to improve customer satisfaction, help them prepare and warn their readers and reduce comments on threads like this. I am fortunate to maintain a status blog, but not everyone does that.
March 21st, 2008 at 9:31 pm
Maybe, maybe not. You don’t speak for all the stupid people, though… and they would be here doing exactly what I said.
March 21st, 2008 at 9:33 pm
I’m hosting sites for clients and all this downtime from one cause or another is getting to be a problem. As for notice, yeah, I’ll have to fall in line with those wanting email notice a week ahead when something like this is going to affect me. And no, I don’t think they need send it to all of their customers, just those who are going to be affected.
As for the “get the RSS feed” crowd….. I don’t read RSS feeds. I’m doing good to check email five or six times a day.
March 21st, 2008 at 9:34 pm
I take it your reason for thinking that is because you’re not too bright?
Looks like I was right, because you prove it right here:
They’re called, “morons.” If you don’t want to be alerted, you won’t be.
You illiterate little babies have all the time in the world to whine here, but no time to check an RSS feed? Idiots.
March 21st, 2008 at 9:36 pm
Really, I have been an unwaivering supporter of Dreamhost, but I would really, really appreciate it if I was notified at least a day or two before you guys do something like this. I really don’t think that we’re asking too much here.
I had specifically planned to do the majority of my client work over the
March 21st, 2008 at 9:36 pm
would all of you donkeys trying to send support requests (why isn’tmy site working? what move?) get the fuck offline so the people who are trying to access the panel who read the big announcement in red a week ago can go about their work?
you dumb shits — quit your whining and pay attention to the status blog every once and awhile.
March 21st, 2008 at 9:36 pm
Thanks for explaining exactly what makes you stupid, for those that couldn’t already tell.
Maybe you can stop using brake pedals, then blame car manufacturers for when you crash into stuff.
March 21st, 2008 at 9:37 pm
Shawn, seriously, stfu. You really think that the DH team you are defending want you in here pissing off the already pissed off people? Did you even read this blog post about you?
http://elliottback.com/wp/archives/2007/05/03/dreamhost-sucks-at-hosting/
March 21st, 2008 at 9:39 pm
So… a weeks notice wasn’t enough, but 1 or 2 days would have been plenty?
Are you sure? If that’s still not enough, they could tell you 3 months after it happens, if that gives you more time to prepare.
Finishing a sentence is almost as hard as subscribing to a feed.
March 21st, 2008 at 9:41 pm
What does an almost 1 year old, irrelevant, whiny blog post have to do with me? Or anything else for that matter?
Besides, anyone that actually read up on that knew that moron was abusing the server. He’s almost as stupid as you, for thinking he was getting a dedicated server for $9/month.
March 21st, 2008 at 9:43 pm
hey shawn.. wanna dance?
http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/comment-page-4/#comment-143243
March 21st, 2008 at 9:46 pm
Shawn:
you f’ing moron. it takes just as much effort to send an outage notice to the same damn mailing list they do the newsletters as it does to make a blog post on this site.
am I wrong, but when I pay for a hosting site, I expect uptime and reliability, and I don’t want to have to go check a stupid fucking rss feed or website every day just to know if I need to make other arrangements for clients. not to mention the fact that either way you look at it, I can’t give them a new email address to reach me at every god damn week because MY REAL MAILSERVER IS DOWN! and as was said earlier, it’s more effort than it’s worth to try and weed out all the stuff that doesn’t affect the individual user, given how many daily posts there are about the DAILY PROBLEMS!
March 21st, 2008 at 9:49 pm
Garbage! I love dreamhost, but this was bush league. No warning, just disappointment. With a bit of a heads up, I could have emailed people that viewed my site ahead of time. This was a royal f*cking, Dreamhost. You also had a recent billing debacle. I can easily tolerate a little downtime and the occasional email problems, but this was bull. That is two strikes. Three strikes, you’re out.
March 21st, 2008 at 9:50 pm
fuck this. unbelieveable.
March 21st, 2008 at 9:51 pm
Ok, so the actual issue is that you’d lose a battle with a f’ing soapdish, and simply don’t know wtf you are talking about then.
Would you like to take a stab at where in that post he described anything close to “abuse”?
March 21st, 2008 at 9:52 pm
I wonder if this will FUCK up our google rankings?
March 21st, 2008 at 9:52 pm
Oh, the unwarranted self-importance people have in regards to their piddly little sites and blogs.
Somehow I’m not convinced that all these internet celebrities with their “5,000 unique visitors” and the THOUSANDS of dollars of revenue their shared-hosting sites rake in hourly would really be using hosting that costs less than $10/mo.
Sit back and relax, folks. Your blogs and “Welcome to Joe Average’s Personal Webpage ;-)” sites will come back up and you can continue rolling in hits and dough soon enough.
March 21st, 2008 at 9:53 pm
Very mature. By the way, maybe you should how to use commas before calling others illiterate.
Anyone else think Shawn’s fanatical DH defense smacks of astroturfing?