Dreamhost firewall error (Resolving)
Due to a typing error on our primary router while trying to block a denial of service attack, DreamHost is currently offline. This includes all email, web hosting, etc. A technician is about 15 minutes out from our datacenter to undo this mistake.
I apologize for this mistake. I was intending to be editing our non-live access-list, and edited the live one by mistake.
Update 9:54 PM Pacific: We have unblocked the firewall and our routing is coming back online. Sites should start working again as soon as our router finishes loading its tables. I use “resolving” because it is still processing the routes.
.
March 7th, 2008 at 9:12 pm
There should be some sort of conditional “Are you Sure ?” coding put into place for situations like this….
Ok, Accidents do happen, This just underscores the need to triple check your work in situations like this, I just hope the network can be brought up soon without any other hassles….
Dreamhost Lifer….
March 7th, 2008 at 9:12 pm
OOPS, YOU DID IT AGAIN!
Even my crotchographs didn’t get this much attention!!
It’s Britney, bitch!
March 7th, 2008 at 9:12 pm
WTH! I have a huge deadline and use my host for development of already hosted sites. I am losing tons of time, money, and sleep. i have a lot left do!
http://hostmysite.com/ is a good host. A lot of my clients use them, they love it.
March 7th, 2008 at 9:12 pm
200!
March 7th, 2008 at 9:12 pm
what a mistake!!
hurry up, to to solve it!!
March 7th, 2008 at 9:12 pm
Yeah - I’m out, I can live with it. I wasn’t even going to comment, but I feel obligated to now.
“You are kidding me, right? A freaking typing error and all of my sites are down. Bunch of amateurs.”
…and similar comments.
Every company has a primary firewall. It wouldn’t make sense to have 30 firewalls, and have to synchronize all of their block lists every x amount of time.
It’s a firewall error, and since they probably only have 1 firewall (or all of them actually do sync with each other) it’s understandable that the problem caused the entire network to fail.
What I find interesting, is that the datacenter is not monitored 24/7, and the closest tech on call is 15 minutes away… that, does seem like poor planning to me, but hey, for the price I pay and what I get, I shouldn’t expect a personal 24/7 server tech to sleep on top of my rack…and neither should any of you.
-Kirk
March 7th, 2008 at 9:13 pm
Well, I’ve administered servers and routers before and sh*t happens.
Hope things are back up soon. I promised a redesign by tonight and I don’t want to break my word.
March 7th, 2008 at 9:13 pm
My wife just left me over this!
No what am I going to do as a single father with no websites?!
March 7th, 2008 at 9:13 pm
Anyone in Ft. Worth want to hit the bar?
Not with you…
March 7th, 2008 at 9:13 pm
Good thing DreamhostStatus.com isn’t hosted by Dreamhost. hahah!
March 7th, 2008 at 9:13 pm
You all need to relax and Shut the #$%^&* Up. They bend over backwards for everyone, and the minute a mistake is made, you all turn on them like rabid animals. Bunch of ungrateful $%^&*. Shit happens!
March 7th, 2008 at 9:13 pm
Argh. Annoying. You guys really need to be a little more observant.
Good luck getting this fixed though.
March 7th, 2008 at 9:13 pm
do we have any idea what website was the target?
March 7th, 2008 at 9:13 pm
This is very bad for the reputation of dreamhost.
March 7th, 2008 at 9:14 pm
Hey, just cut them some slack, ok? At least they apologized.
Maybe this is the first 15 minutes down time I ever got since I hosted my site here. But it would be extremely serious for some high traffic site. So some kind of compensation for them is appropriate in my opinion.
March 7th, 2008 at 9:14 pm
A fat finger AGAIN?
INCREDIBLE .. ahahahahahha
Only DH do it for you :D:D Enjoy!
March 7th, 2008 at 9:14 pm
I would have left dreamhost a while ago if it wasn’t for the panel. Its so easy to work with, and I havent been able to find any other service that is comparable
Plus I am clueless about moving databases and the more advanced options of other panels 
March 7th, 2008 at 9:14 pm
I aint having a moan, but the whole of dreamhost down, thats quite major for an international hosting provider. People do not like downtime even if it is for 1 minute or 15 minutes. This really is not an acceptable situation regardless of the timeframe of the disruption and the fact that it was brought on by a mistake by a member of staff makes us think that dreamhost is full of part timers that really dont know what they are doing.
cmon guys, get it together
March 7th, 2008 at 9:14 pm
It is certainly very bad …
March 7th, 2008 at 9:14 pm
30 minutes so far. good thing you hire such competent people over there.
March 7th, 2008 at 9:14 pm
I can just imagine the conversation now :
Josh: kelly, you fat-fingered the firewall, you’re fired!
kelly: that’s not fair - the guy who fat-fingered millions of dollars from customer credit cards didn’t get fired
josh: …
josh: carry on with the good work!
March 7th, 2008 at 9:14 pm
joder venga venga todas mis webs offlinee XD
March 7th, 2008 at 9:14 pm
Hey DH people, please bring our sites UP again!!!!
March 7th, 2008 at 9:14 pm
Oh stop your whining already!
March 7th, 2008 at 9:14 pm
lol!
I can’t remember the number of times I used to do that on the cisco 2500s…
have fun!
March 7th, 2008 at 9:15 pm
…give em a break, I have over 100 clients I have hooked up to dreamhost… and I am not panicking… (yes, they are important)
You guys should thank all of us who pushed for this separate status system… most companies don’t have an actual working status system… and also cover up their mistakes.
Dreamhost is one of the most honest, and they continually stay “with it” and pretty feature rich…
I’ve had issues with them through time, but they’ve always come through… and gotten better through time.
March 7th, 2008 at 9:15 pm
Now watch - the technician will get in an accident or some damn thing. Or the guard at the colo won’t let him in, :-]
March 7th, 2008 at 9:15 pm
At least I was able to find the status page on google to see why my server was down. Thank you for the link and I hope you get it on line soon. I feel your pain.
March 7th, 2008 at 9:15 pm
Can someone starting firing the idiots from dreamhost before this company is just a smoking hole in the ground?
March 7th, 2008 at 9:15 pm
Me need help!!!
I do not know what I did wrong, I clicked on a link and then the site stopped coming back, all I see is tis message:
The connection has timed out
* The site could be temporarily unavailable or too busy. Try again in a few
moments.
* If you are unable to load any pages, check your computer’s network
connection.
* If your computer or network is protected by a firewall or proxy, make sure
that Firefox is permitted to access the Web.
Please help me!
Blondi
March 7th, 2008 at 9:15 pm
so the first friday evening i stay home in months just to work on my site and this happens. its not too late tho. if this is going to take all nite plz let me know so i can drive to some party in la and have sex with strangers kthxbye
March 7th, 2008 at 9:16 pm
Ray you smell liek a broken record!
March 7th, 2008 at 9:16 pm
@ 231 - noodz plz
March 7th, 2008 at 9:16 pm
I would be really, really angry… but I’m too busy laughing my head off.
Do what needs to be done. It happens.
March 7th, 2008 at 9:16 pm
AHHHH
SHIT HIT THE FAN!
March 7th, 2008 at 9:16 pm
has anyone ever just kept hitting the refresh button and watched the comment count climb? what?…it’s just as much fun as the lame comments being posted! LOL.
March 7th, 2008 at 9:16 pm
Ok, let’s all write some dreamhost haiku….
Dreamhost where are you?
It is cold and my site’s down
hurry tech make haste
March 7th, 2008 at 9:16 pm
1 year free for all
March 7th, 2008 at 9:16 pm
235
March 7th, 2008 at 9:16 pm
I don’t work much on my sites, but it’s amazing that every time I decide to do something on them, I find DH down. Twice this week. Now that’s a weird coincidence!
It’s been almost 30 min. Hope this doesn’t take all night.
March 7th, 2008 at 9:17 pm
DH is a very good host, I talk to people using other hosting companies and many of them don’t get half the features we get. I’M STICKIN’ WITH DH!
DH 08! Forget the other candidates!
March 7th, 2008 at 9:17 pm
Holy shit, 215 posts already?
Talk about a whinge fest. Go pay more than $fuck.all a month for your hosting if 30 minutes of downtime causes you to lose thousands.
But lets face it, the majority of the 215 people posting here have stupid sites with a picture of them and their cat. Or a stupid free phpbb forum with 12 members giggling over a bit of lolcat copypasta they stole from another forum anyway. Or maybe a guild webpage with the dates of upcoming raids for their nerd mates.
Regardless. Your crappy little site disappearing from the internet for 30 minutes doesnt mean shit. Dreamhost owes you nothing. In fact, the people who whinge about trivial stuff like this need to gtfo of my hosting company and find someone else. That way there will be less internet lusers demanding ferraris for pocket lint putting load on my servers.
In closing, lol.
TRK
March 7th, 2008 at 9:17 pm
Ya really 400 okay???????? Dreamhost will omg i need to type more words before i die. i am going to eventually my cells are dissolving but a system cannot understand itself
March 7th, 2008 at 9:17 pm
250!
March 7th, 2008 at 9:17 pm
LOCUSTS!!!!! FROGS!!!!! DOGS AND CATS LIVING TOGETHER!!!!! MASS HYSTERIA!!!!!! AAAAAHHHHHHH!!!!!
March 7th, 2008 at 9:18 pm
Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle…
March 7th, 2008 at 9:18 pm
250 now
March 7th, 2008 at 9:18 pm
To all you flipping out because they’re “amateurs” and that this is “too much for a silly typing mistake”, get a life and a clue.
The Firewall exists on the border between their systems and yours and, without it, you’d be crying even more. But since it’s a singular point of failure(effectively being a door as opposed to a system that can more easily be mirrored) when it breaks, bad things happen.
And I want to see one of you stupid and ignorant babies configure one of these bloody things -once- let alone to stop some punk with malicious intent from actively attempting to bring you down. Resolution within the hour is impressive even with larger corporate setups. I remember Google being down. I remember Yahoo being down. Hell, I remember hotmail.co.uk being down because someone from MS didn’t renew the bloody thing,
Mistakes happen. Deal with it and stop polluting other people’s webpages or life with your impatient filth.
Probably the same stupid crybabies that can’t get their DLink router to give them ‘teh wifi’.
March 7th, 2008 at 9:18 pm
I need to meet Blodi.. this is Big Jake… Ha Ha. I agree.. 400…
March 7th, 2008 at 9:18 pm
“What I find interesting, is that the datacenter is not monitored 24/7, and the closest tech on call is 15 minutes away… that, does seem like poor planning to me, but hey, for the price I pay and what I get, I shouldn’t expect a personal 24/7 server tech to sleep on top of my rack…and neither should any of you.”
is it a case that while they have 24×7 support, the actual hardware is hosted offsite? The company I work is like that. Operations is run from an office. Hardware is run in a data center, 15 minutes away. When you need to have someone physically go on site, there is a delay (& if its like us, it will take friggen 30 minutes for some security pleb to grant you access).
Ahh well, at least there are plenty who do realise that sometimes shit just happens