Spunky and Central Move
We’re about to begin to move the spunky cluster and our central machines. We’ll be taking down servers soon, but our status site, of course, will remain up and running.
Again, we’ll try to keep this move quick and painless as we possibly can, and we apologize for the inconvenience.
For more details on this, see the previous post here:
http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/
UPDATE — Sat Mar 22 00:12:05 PDT 2008 –
Most central functions are back up. Dreamhost.com and panel.dreamhost.com are working again. We are currently working on webmail. The spunky cluster move is still underway. We’ll post more here later.
UPDATE — Sat Mar 22 02:45:26 PDT 2008 –
Webmail is up! 99% of all central services are functioning now. Spunky is 80% racked, more info on that to follow.
UPDATE — Sat Mar 22 03:40:27 PDT 2008 –
Spunky is coming up. We’re spotchecking and fixing troubled file, web, and mail servers. We’ll sound an all when all is clear… We will likely be firefighting for the next few hours.
UPDATE — Sat Mar 22 06:01:28 PDT 2008 –
Spunky is still coming up, we’re dealing with a couple of machines that didn’t survive the move and some more cleanup stuff. We’ll keep you posted as things progress!
UPDATE — Sat Mar 22 07:04:35 PDT 2008 –
We have noticed a problem with some of our networks. They seemingly did not make the jump to the new router and we are looking into that. Any websites with IP addresses that look like either 64.111.xxx.xxx or 208.113.xxx.xxx are down to the outside world right now. The machines themselves are up so as soon as the networks are working again they’ll begin working immediately.
UPDATE — Sat Mar 22 09:55:54 PDT 2008 –
The networking problem has been resolved with our network provider so as of right now all services should be up and running. If anything is not working, please open a new support message from our web panel.
.
March 22nd, 2008 at 1:20 am
@shhhhyawn & others who have wondered about that -
I can understand the frustration, but I think if you look look just at the list of webservers alone and figure in the number of MySQL servers, file servers, and networking hardware that would go along with it all, I really think it’s unreasonable to expect them to have that much spare equipment laying around collecting dust except for rare occasions like this, not to mention that after the current wave of shuffling is done, all that extra hardware would probably be obsolete the next time they need to do major restructuring. I’m no expert either of course, but at least for me it seems fair to assume that even at the rate they grow it will always be a tall order to have so much equipment always on reserve. As for the resident DH sockpuppet, I’ve been doing some net detective work and I think I’ve discovered why he’s such a bitter person, but since they’ll just delete it in these comments, I’ve gone ahead and posted my extremely compelling evidence here: http://shawn-is-pathetic.com
March 22nd, 2008 at 1:22 am
Notification or compensation, your choice Dreamhost!
Some of us run businesses off these domains, how about some notification?
March 22nd, 2008 at 1:23 am
Hey frnds what about ur side….. reply ur comments :
March 22nd, 2008 at 1:23 am
Someone’s getting a visit from Ted the Lead Pipe.
March 22nd, 2008 at 1:27 am
To bitch about it is stupid but that is a great idea and makes sense: 404 redirect to a “sorry we’re down for awhile” page. Hopefully the Dreamhost team pick it up and realise it.
March 22nd, 2008 at 1:30 am
How about neither. Read the TOS.
Your business has already failed because it was never worth more than $10/month.
Okay, you can have the notification you got a week ago when they made the original post. Glad I could help.
March 22nd, 2008 at 1:31 am
yes andreas……..hopefully they get it. not all of us are slackers.
March 22nd, 2008 at 1:38 am
“If they’re fine with that because they know they can have another sale and sell twice as much for half the price than so be it …”
If DH screws up enough times and pisses off enough influential customers they will find they can no longer go to that well. It will have been poisoned.
March 22nd, 2008 at 1:39 am
You didn’t sign a lifetime contract and things change. If you’re not happy shop around.
I’ve been here for years, but wouldn’t hesitate to leave if they gave me a reason to. Same goes for other hosts I use… and obviously all the hosts I’ve left in the past.
Customers sign up way faster than they leave. A lot of morons thought they were going to fold over the billing error, which wasn’t even a remote possibility.
If they lost customers over this, it’s because of their honesty. Many hosts would not have announced this at all because it makes it easy for people to leave. Instead, a lot would have just pulled the plug and made up a BS “emergency” story.
That plan works great because a disturbingly large percent of hosting customers aren’t smart enough to keep backups for those situations, or data loss in general for that matter.
The more open Dreamhost is, the more it makes you realize how open most aren’t. There are also hosts that would have a staff policing their forums during times like this to delete any mention of it and ban the posters.
March 22nd, 2008 at 1:43 am
People,
Shown is for sure an employee of Dreamhost that is working now to protect this absolutely ridiculous action!
What is he saying is: “You are not going to get that in this price range anywhere” and “12 hours … super-fast”! In other words, people, you all got a very cheap hosting, you all are loosers because you can’t pay more, and that is why you have to live with 12 hours downtime! That is what they tell us.
This is a highest disrespect to not even notify by email about such incredible downtime that was planned! They do it on Easter and posted the notice on blog only, hoping people won’t notice that!!
But everybody should know, you’ve lost your customers for 12 hours, and this what they can do for you!
March 22nd, 2008 at 1:44 am
Everybody should be old enough to choose the best hosting solution for his websites. I know a lot of providers wich are more expensive providers providing less service.
March 22nd, 2008 at 1:44 am
Shawn, go to bed. We’re here because we have issues with the businesses and sites we’re running. If you’re going to heckle people and pick apart arguments with terrible business logic, without providing any help, then start your own site. Maybe dreamhostrules.com? Just don’t host it on dreamhost… OH NO HE DIDN’T!!!
Seriously.
March 22nd, 2008 at 1:45 am
CHRIST A FREAKIN’LIVE - WTF £”£*(^&£$%()^”£$%()”&£$%)£&$%….
Look you guys, I know these tings have to be done and at some points in life you have to deal with things you just have to… BUT WHY DIDN’T YOU TELL ME ???????
I read through the monthly crap I get to see what’s new and what’s not.. NOTHING IN THERE !!! What’s the biggy about sending out something a couple of days before a PLANNED take down ???
F%^%&^%K !!!
Just paid $385 dollars renewal to be F&%^$k’d in the A$$ again… ??
March 22nd, 2008 at 1:46 am
I concur with Jerry.
March 22nd, 2008 at 1:48 am
Domain Cloaking Error
We’re sorry, we had a problem with our web panel when you set up cloaking for your domain chat.dreamhost.com!
Please go to the DreamHost Web Panel’s Domain > Web area and click the [Edit] link next to chat.dreamhost.com to re-configure cloaking.
Error: no domain chat.dreamhost.com/chat.dreamhost.com
???
March 22nd, 2008 at 1:50 am
FUCK YOU!!!
Not to dreamhost, but to the miserable beings who are such fucking idiots who act like complete arseholes in this blog.
Fuck you all! Dreamhost notified us of this, what seems like ages ago, and you all rock up and start fucking crying! Get fucked, every single one of you! As a business, unfortunately you can’t chose your customers, so to all those fucking idiots who like to come here and bitch about things that are totally their fault (that’s right, IT’S YOUR FAULT you don’t read week-in-advance warnings!), SHUT THE FUCK UP!! If you chose to pay $10 a month, then don’t expect 110% uptime and a red carpet, fuck, do you want them to wipe your gigantic arsehole too? Get fucked!
——————————————————————————————————
(Glad to get that off my chest after years of reading what these children post!) - I do apologize for the profuse amount of vulgar language, but perhaps it requires speaking at their level to get through to them?
March 22nd, 2008 at 1:51 am
@Shawn and others
You know, Dreamhost don’t have to buy 2 of everything.
Just 20 extra servers. Put those servers in the new datacenter. Then transfer 20 old server to them. Then move those 20 old servers.
Repeat until done. Then you’ve got 20 extra servers to put customers on!
Very simple.
March 22nd, 2008 at 1:52 am
@Darcy - Dude, need a hug?
March 22nd, 2008 at 1:52 am
No Darcy, all we wanted was a motherfucking email.
March 22nd, 2008 at 1:55 am
Darcy, that are true words. Paying for a train ticket but want travel in a learjet.
March 22nd, 2008 at 1:55 am
Yeah… webmail’s up alright:
Error connecting to IMAP server: localhost.
111 : Connection refused
March 22nd, 2008 at 1:56 am
OMG…sites down for six hours..
you should have email users..
March 22nd, 2008 at 1:57 am
Email is not a learjet. I get the monthly DH agitprop. Sending email is “free”.
What is it with this pro-DH spin? It’s very transparent.
March 22nd, 2008 at 1:59 am
Yeah, they hired me to come here in tell you pussies to go host somewhere else. Saying I work here would be like saying you’re smart.
Wrong again, dumbass. But I will call YOU a loser for spelling loser wrong.
You don’t have to live with the downtime, you can take your sites somewhere else right now. Let’s see if you can put your money where your mouth is or if you’re just here to cry like a little baby.
Oops! There I go again, obviously being an employee!
March 22nd, 2008 at 2:00 am
If they would have sent you an email, you would have ignored it, deleted it, or read it and still wouldn’t have been satisfied.
Just wait it out, shit. Life goes on folks.
Either way, if folks are going to leave over this, hopefully it’s some folks from Abazaba… that’s where my digital world lives.
Now I will go back to checking references in Wikipedia Articles until they finish.
Matt
March 22nd, 2008 at 2:01 am
No one is crying. We’re rational business-men looking for solutions.
March 22nd, 2008 at 2:01 am
Did you offer to flip the bill for it, or are you just showing us how easy it is to spend other peoples’ money?
March 22nd, 2008 at 2:02 am
12 hours without notice and NOT on sunday night/monday morning IS unacceptable and deserves a major re-think by DH.
March 22nd, 2008 at 2:04 am
seriously man your way past the window of maintenance.
get your isht together. i could give a feck if my site is down during middle of night but email is important.
March 22nd, 2008 at 2:04 am
You have issues because you’re incompetent — not because I’m here.
Wrong again. If you want to be a whiny little baby and not get called out for it, then YOU go do that on your own site.
March 22nd, 2008 at 2:04 am
@repete: Jesus, I’ll send you an email, I’ll bloody email you a link to each and every status post dreamhost make. Anyone else want to join the list?? I don’t mind doing it. As long as it gets rid of pages of stupid people making stupid comments about how they’re $10 a month is getting wasted on new datacenters instead of building tedious email scripts.
Seriously, I’ll do the emailing, ANYTHING to clean up this shitpile.
March 22nd, 2008 at 2:05 am
Now THAT’S funny! Rational businessmen aren’t whining on blog comments. In fact, they’re not even dealing with downtime right now because they’re not stupid.
March 22nd, 2008 at 2:06 am
@Shawn
Dreamhost can certainly afford 20 extra servers. I also pointed out that when the move was complete, I’m sure they would stick new customers, so instead of investing in the servers later, they should have done it now.
March 22nd, 2008 at 2:06 am
Viva Dreamhost, they are cheap, offer amazing hosting packages and a friendly service. What do you want more?
March 22nd, 2008 at 2:08 am
@Shawn
I assume you mean “foot the bill”? And what in the world do you mean by “showing us how easy it is to spend other peoples’ money?”
You’ve got that backwards. I believe Daniel was suggesting DreamHost spend OUR money, the money we paid to them for this service. See, this is a business, we are customers, we pay for services, DreamHost is the service provider, they spend the money WE gave to THEM to maintain and improve the service.
It’s really not that difficult a concept.
March 22nd, 2008 at 2:08 am
@Shawn
fleshlight.com, xbox.com, kdice.com, etc.
Visit any of these sites. You might have more fun on a Friday night. I’m not even going to attempt logic with you.
March 22nd, 2008 at 2:09 am
Shawn said:
> Your business has already failed because it was never worth more than $10/month.
Not everybody is on the new Happy Hosting plan. Please realise that customers with Dreamhost PS servers are involved as well. They do pay more than the $10/month. I have a PS and website/e-mail is a part of the Spunky cluster.
I’ve read about this scheduled downtime a week ago, so I could inform my site visitors about it. I will not complain about this downtime; in the end it will be worthwhile. I’m sure that Dreamhost has a good reason to move servers to the other data center, so that the reliability and capacity of their service will improve. But I agree with others that an e-mail in case of such a long downtime would have been a nice service to their customers (this is a good candidate for the Suggestions area of the WebPanel).
March 22nd, 2008 at 2:09 am
yeah, fabulous! mission accomplished!! yay!! hurrrrah!! hossanahs in the highest!!
March 22nd, 2008 at 2:09 am
Jesus, both my sites are down and have been for over an hour. Nothing is working and all my peers are going crazy, we cant transfer files, everything is a muck. Should my hosting really be down for this long? Fu*&!
March 22nd, 2008 at 2:09 am
They’ve probably been down for 12 hours.
March 22nd, 2008 at 2:10 am
As the angst roils, and tempers flare, there is a “happy place” for DreamHost denizens and serious Intarweb entrepreneurs to visit when flailing aimlessly away on a blog comments section becomes less than satisfying:
http://fuckdreamhost.com
Visit now … yo know you want to!
March 22nd, 2008 at 2:10 am
@darcy
“building tedious email scripts”
It’s not that fucking hard. 1 SQL query at most. 30 lines of code. Less if you pick your language right.
Shit, I’d write one now. But I don’t work for Dreamhost. I work for another mob.
March 22nd, 2008 at 2:10 am
Daniel G, ever tried moving a webserver down the road? Takes more than an hour you know?
March 22nd, 2008 at 2:11 am
Dreamhost: top-class features, piss-poor performance. What a dilemma. Anyway, at least this move looks like it may take less than 12 hours.
Too bad MediaTemple is so expensive and Hostgator uses cPanel (yuck).
March 22nd, 2008 at 2:11 am
Furthermore… I’d like to attest to the difficulty of what they are trying to accomplish. I don’t have anywhere near the amount of servers this company has in Spunky alone (never mind their whole damn network,) but I can relate to having to move an amount of servers (and all the hardware that travels with them) in the quickest time possible.
When I was with a past employer, one of our major customers was Amex, and when our town flooded (including our shop) we had to move EVERYTHING out of our shop (carefully, mind you.. these things are delicate) into vehicles, in the rain, and to a temporary uplink within the 3 hour downtime window that Amex allowed us per month. We sucked up our entire months allotment of downtime in that one day… it’s hard.
So props to DH for getting this done quickly, letting me know through RSS (which is the RIGHT way to do it, email is old, decayed, and I ignore most emails I get these days anyhow.) If you can’t be bothered to check an RSS feed once a day, which can be included into the daily news you read, and EVERYTHING ELSE YOU NEED TO KNOW…. how are you going to say that you would have read an email among a thousand other emails you get in your box (or is that just me.)
Anywho, back to Wiki.
Matt
March 22nd, 2008 at 2:11 am
Oh wait 7 hours. 5 more hours to go. Prolly on a beer break posing for new front page screenshots.
March 22nd, 2008 at 2:12 am
Daniel, oh yeah, good comeback, pick up the smallest part of my comment, you’re a real smart cookie, I can tell. How’s your IQ going, double digits yet?
March 22nd, 2008 at 2:12 am
@Daniel- Spunky, just like Spacey before, and others they have or will move, are clusters. Now I could be mistaken, but the general idea seems to be that all those machines are tied in together; it would be like having your DVD player and TV set in different states. If that’s accurate enough, you couldn’t just do a partial physical move like some people are suggesting.
March 22nd, 2008 at 2:13 am
We are on dawber and still our sites, mysql, webmail is down for 4 hours.
March 22nd, 2008 at 2:15 am
LOL @ Not Me… that’s the general idea, yes.
Matt