Dreamhost firewall error (Resolving)
Due to a typing error on our primary router while trying to block a denial of service attack, DreamHost is currently offline. This includes all email, web hosting, etc. A technician is about 15 minutes out from our datacenter to undo this mistake.
I apologize for this mistake. I was intending to be editing our non-live access-list, and edited the live one by mistake.
Update 9:54 PM Pacific: We have unblocked the firewall and our routing is coming back online. Sites should start working again as soon as our router finishes loading its tables. I use “resolving” because it is still processing the routes.
.
March 7th, 2008 at 9:35 pm
HOUSE MD
March 7th, 2008 at 9:35 pm
I got $5 that we reach 1000 posts or more before things are working again.
Any takers?
March 7th, 2008 at 9:35 pm
I really hope that nobody will be fired. I don’t understand this anger. We have online shops. Today is woman’s day in Europe, our flower delivery service is down and we can live with that.
March 7th, 2008 at 9:36 pm
http://www.dreamhoststatus.com/category/system-outages/system-wide-outage/
March 7th, 2008 at 9:36 pm
Anyone digg this? lol…
March 7th, 2008 at 9:36 pm
Typos *can* be fixed quickly when observed, but some 45 minutes into this and I’m wondering where my email, web, and hosting panel are. I’m don’t want to be one of these shrill “I’m losing $xxx per minute” folk, but an update would be really awesome.
March 7th, 2008 at 9:36 pm
Someone put a new hamster on the wheel, this one’s dead!
March 7th, 2008 at 9:36 pm
Yeah, everybody guess how many comments there will be before it comes back.
March 7th, 2008 at 9:36 pm
KAO!!!!!
March 7th, 2008 at 9:36 pm
Hello, I’m not hosted on DreamHost, I was thinking to but I was wondering some way to get Google Checkout and the 94 days refund period in Argentina. Now I won’t get DreamHost. If you were a seriours company, this won’t happen. Its like “I brought my dog to the datacenter and he powered off all the servers”. This shouldn’t happen, you represent yourself as professionals, not a free hosting made by idiots OK?
This is so fucking stupid… I would like to know the name of who mistyped the things in the router.
He/she should be fired immediately in my opinion.
Well, this sucks :)!!!
Greetings, maybe if you get smarter employees that know how to use a keyboard, maybe it was not a qwerty keyboard or he was writing with a touchpad keyboard, I can’t understand how a person can be so fucking stupid if not, I can’t also understand with the things mentioned before how can it be SO idiot too.
March 7th, 2008 at 9:36 pm
lame
March 7th, 2008 at 9:37 pm
Whew! Thank goodness this happened. I’ve been modding this darned drupal site for 14 hours straight and I really had to pee! I know Coke and pretzels isn’t super nutritious, but it’s easy to stack on the corner of the desk and ingest for hours straight. But taking a leak means getting up from the desk and going over to the bathroom - and I was afraid I’d lose my groove.
FINALLY the site went down and although I kept hitting refresh for 15 mintues straight, I finally came here to see that the whole server was down. SO I finally made a bathroom break. MAN I feel so much better now.
You know, you have to look at these little setbacks with the right attitude. Heck, if it doesn’t come up within the next 20 minutes, I might just try going to bed. They say going more than 48 hours without sleep is dangerous, so maybe this is a sign.
March 7th, 2008 at 9:37 pm
[quote=”Paul Sweeney”]Typos *can* be fixed quickly when observed, but some 45 minutes into this and I’m wondering where my email, web, and hosting panel are. I’m don’t want to be one of these shrill “I’m losing $xxx per minute” folk, but an update would be really awesome.[/quote]
Yes, ordinarily they can, but not when the network is locking you out. Think before you speak Paul.
-Kirk
March 7th, 2008 at 9:37 pm
Aaahhh …. my life is ending…
Based on last years sales I am losing $8314.75 per day with my site
down. My wife is leaving me because I depend on such luzers for my
business website. What’s worse is that she has the keys to the
cupboard where I keep my stash - maybe she is going to report me …
She has already killed all the puppies.
Help me please, get the site online fast.
March 7th, 2008 at 9:37 pm
I like that people who are making ’serious money’ are still hosting on a $5/month shared hosting solution. Even the VPS is still shared.
Go dedicated, and pay the big bucks for redundancy on redundancy on redundancy. And make damn sure your solutions are hosted in multiple locations. Heck, make them in multiple locations in different countries. Also, host a copy in space in a satallite.
THEN… you have a right to whinge if your site goes down.
Until then stfu and eat a dick.
March 7th, 2008 at 9:37 pm
Ode to The Firewall
In a webhost that had a deep moat
Worked an admin of some incredible note
But without much delay
He made some great hay
By fat fingering a file remote.
March 7th, 2008 at 9:38 pm
Scroll up to the top of the page, genius.
March 7th, 2008 at 9:38 pm
Please don’t tell us it’s going to be fixed in 15 minutes when an hour later it’s still down. That’s it for me and dreamhost.com, lately you guys have been going extremely slow, the mail was just down a couple of weeks ago, and there are other hosts that have the same or lesser prices for way better service. Come on guys, first you charge us all for a year, then the mail goes down, then the sites are running slow, then the whole server is down.
Pathetic, I’ll be canceling tonight.
March 7th, 2008 at 9:38 pm
Yeah, it’s been dugg, http://digg.com/tech_news/Fat_Fingers_Hit_Dreamhost_Again
You guys need to calm down. People screw up once and a while. Go get drunk and laid and quit bitching.
March 7th, 2008 at 9:38 pm
DO THESE FUCKERS HAVE A PHONE NUMBER? I WANT TO GIVE THEM PIECE OF MIND!!! THE TECH IS PROBABLY BUSY SUCKING ON THEIR MOTHER’S TITS
March 7th, 2008 at 9:38 pm
Damn DH, the billing error was one thing, a billing error.
But locking your entire company and customer base out of your entire network with a firewall configuration error is.. embarrassing.
March 7th, 2008 at 9:38 pm
OK $10 that we reach 1000 posts.
March 7th, 2008 at 9:38 pm
If you’re not hosted on dreamhost, what are you doing here bitching? (Much less demanding that people be fired…)
March 7th, 2008 at 9:38 pm
“I brought my dog to the datacenter and he powered off all the servers”.
You chucklehead, it was a ferret!
March 7th, 2008 at 9:38 pm
problem fixed
March 7th, 2008 at 9:38 pm
Ian, what a fucking troll, you trolling for NoDaddy?
March 7th, 2008 at 9:38 pm
Dang… everytime I go to work on my web site Dreamhost seems to go down on me. This is the 7th time it’s happened right when I’m working on designing my site. o_O
March 7th, 2008 at 9:39 pm
50 minutes, and the guy who’s supposed to arrive in 15 mins didnt corrected the typo yet? Something tells me there’s more to this…
Really, It’s repetitive to complain over and over, but dreamhost keep making silly mistakes over and over… I’m really thinking about leaving
March 7th, 2008 at 9:39 pm
WTF? How do you quote something? I thought it was like phpBB’s BBCode on most blogs, but I guess not.
-Kirk
March 7th, 2008 at 9:39 pm
For those who wonder why the typo can’t be fixed remotely: the key to the piggy-bank is in the piggy-bank.
March 7th, 2008 at 9:39 pm
I wonder who is the provider of dreamhoststatus.com as this site is always up?… Now if that could only happen for the paying customers.
March 7th, 2008 at 9:39 pm
Turns out that we and Moe won’t be canceling tonight; we can’t get on the internet.
March 7th, 2008 at 9:39 pm
just typed out 400 thousand lines of code in 550 diff files to complete the greatest website ever made it will be better than myspace, facebook, youtube combined and i went to save and the sites down i lost everything billions of dollars are now gone thanks to this with no backups
i want atleast 10% of my possible revenue back for the problem 10% of $15 billion
March 7th, 2008 at 9:39 pm
This is the first time i’ve posted in all the years i’ve been with dreamhost.
What a shame, another painful error on their part.
Wake up, dreamhost! its time to hire real admins!!
You’ll soon find yourself wondering were all your custy’s have gone too!
March 7th, 2008 at 9:39 pm
What I’d like to know is where is their out-of-band management? They should have ways of getting into their network even when all else is hosed. A dial-in modem even, just for emergencies like this.
March 7th, 2008 at 9:39 pm
HAHA and all the DH posters on here posting links to their sites while they are down HAHAHAAHAHAHA
I told you guys to start putting up Gentoo boxes and get off them 1952 Vacuum tubes
March 7th, 2008 at 9:39 pm
Just thought I’d mention to all of the dumb@ss whiners who are complaining about dreamhost not having redundancy…if you nitwits had redundancy on your sites, you would all be up now wouldn’t you? How could you have let this go unchecked? Your sites are worth millions and millions and millions, and you rely on only one discount 10 buck a month host to insure it’s online 24/7/365? If you’re that stupid, you deserve to be down! Take this as a wake up call and take the downtime as an opportunity to do some research on google on how you need to set up some redundancy for yourselves! Jeez, how could you have been this stupid!
Ok, carry on.
March 7th, 2008 at 9:40 pm
http://www.flickr.com/photos/57668330@N00/485497512/ LOL Cat in ur serverz?
I can haz a damb tipo?
FAIL.
March 7th, 2008 at 9:40 pm
Update — Update — Update –
Least we can expect — Least we can expect — Least wecan expect –
March 7th, 2008 at 9:40 pm
So we killed your sites for a little bit - big deal, GET OVER IT. We are working on it and all will be fixed soon. Babies…
March 7th, 2008 at 9:40 pm
well, can’t comprehend how careless one could be like this!!!!!!!!!!! however, thanks for being honest about your mistake.
March 7th, 2008 at 9:40 pm
It’s back up guys.
March 7th, 2008 at 9:40 pm
GO GO GO
500 Comments
March 7th, 2008 at 9:41 pm
Penis Balls, Penis Balls.
I put my penis in your vagina and you moan!
WHAT A WHORE!
^l33th4×0r p03m bitches!!
March 7th, 2008 at 9:41 pm
@Neo :: You should lose at least $1.5B for not knowing how to keep a backup.
It looks like this only affects the shared hosting customers. A site that I know is on DH dedicated/colo is still up and running.
March 7th, 2008 at 9:42 pm
As a software engineer for a large web company, I am required to say that this kind of mistake should NEVER happen.
March 7th, 2008 at 9:42 pm
Hey All
USE GMAIL for ALL OF YOUR EMAIL … Google Apps is very cool
March 7th, 2008 at 9:42 pm
…Apparently the technician is actually 51 minutes away.
March 7th, 2008 at 9:42 pm
Quack!!
March 7th, 2008 at 9:42 pm
They said a tech was 15 minutes out of the NOC. Believe it or not, it takes something more than a technician walking through the door to resolve an outage, even if they know exactly what’s wrong.
Dudes. Outages happen. Sometimes ’cause someone screwed up. They had a notice up here immediately and copped to it. Breathe calming breaths.