Current Time: 15:26:04 PDT

What's Up?

If you are experiencing a problem that has not been reported here, check our web panel for more information.

(Please remember, posting in the comments here IS NOT an official way to contact DreamHost.)

Search

Pages

Categories

Other Stuff

8:47 pm

Dreamhost firewall error (Resolving)

Posted (March 7th, 2008 at 8:47 pm PST) by Kelly

Due to a typing error on our primary router while trying to block a denial of service attack, DreamHost is currently offline. This includes all email, web hosting, etc. A technician is about 15 minutes out from our datacenter to undo this mistake.

I apologize for this mistake. I was intending to be editing our non-live access-list, and edited the live one by mistake.

Update 9:54 PM Pacific: We have unblocked the firewall and our routing is coming back online. Sites should start working again as soon as our router finishes loading its tables. I use “resolving” because it is still processing the routes.

This entry was posted on Friday, March 7th, 2008 at 8:47 pm and is filed under General Outages, System-Wide Outage. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.

683 Responses to “Dreamhost firewall error (Resolving)”

LOL I feel for you hahaha

Well, I guess that’s one way to deny service.

I was wondering for a sec why my site was down

MOTHER FUCKERS!!!! FUCKING LOOSERS!!!!!!!!!!!!!!!!!!!!!!!! GO to school before admin a Server

You really need a terminal server…

“AAAAAAAAAAAAAAAAAAAAAAHHHHHHHHHHHHHHHHHHHHHHHHHHHHH”

All of dreamhost is down? Well, at least I’m the first one to comment.

Wow, dreamhost and typos, for for millions, now you turned yourself off. Invest in typing classes!

Heheh - more fat fingers at dreamhost?

*losers.

learn how to spell before you flip out on people.

you get’em guys! That’ll keep those haxor/suxors out of the system! Deny all!!

damnit, this is the first time in a long time that my site has been down. I pay quite a bit for the virtual private server too :(

LOOSERS? Heh shit happens this guy/girl is being very honest about it.

My site was down for 5 hours Wednesday evening, I wonder how long it will be down tonight.

Gah!!! this is bad! How can you allow one router mistake to bring down your entire service…very very not good.

Arghh! I was right in the middle of a really great blog post!!! It was brilliant, too! :(

Wow, I’m amazed by this quick post. Just minute ago my site was working flawlessly and now it’s not opening and I come here to check, and you guys just posted this 1 minute ago!

AHAHA well, i was the seventh one to comment :)

My site has been really slow and returning a lot of interal server errors in the last few minutes. That explains it… Hope you fix it quickly.

You are fired! It’s that simple! And it’s not a mistake! Never again… with You.

Thank goodness, I thought I somehow effed something up, so seeing this blog post was actually good news.

Taking suggestions for new webhosting services. This coupled with the frequent imap connectivity issues is way too much.

OOOOPS!! So do we get a partial refund now?

Didn’t think so.

I think I’m going to have to switch guys. Your service has become increasingly less reliable… to not reliable at all.

Ah, crap.

I just sent an email to support about this before this was posted here.

AWESOME! I was almost over my bandwidth limit! Thank you, Dreamhost!

AHAHAHAHAHAHAHAHAHA. fail.

WAY TO GO!

oh man. I hope it gets back quickly I just invited a lot of people…. crap, bad timimng

March 7th, 2008 at 8:51 pmmetalforever Says:

guess whos server the DDOS was on…..

sorry guys.

What is with you fools? Did you magically become perfect in the last 20 minutes? NO?! I didn’t think so. Cut people some slack. It’s down for a half an hour. Suck it up.

Delete the internet FTW!

Haha,

Like others have said, shite happens. At least that admitted to it!

Hope you get it up soon!

oh shut up its not like anyone looks at your stupid little sites anyway

It can happen to anyone.

When most of use make this type mistake, nobody else notices. In your case, lots and lots of people noticed!

:)

Ok, we cannot do anything so please be fassssssssssstt…

Thanks

You are kidding me, right? A freaking typing error and all of my sites are down. Bunch of amateurs.

I cant wait to see the number of whinging posts complaining that this 15 minute downtime has caused their business to collapse, puppies to be killed and entire families to die.

Ill bet the hackers are happy though… Their DDOS attack worked beyond their wildest dreams - theyve taken down the whole of dreamhost :P

Seems the masses have all stumbled here ;) Too bad on the fat fingers though. Oh.. well if I may offer a recommendation for those fat fingers… go to the store and buy a bag of bugles - and stick those of your fingers :D Cheers!

wahahahaha…all my sites are down! i just can’t believe why they are allowing unexperienced people to handle the server. this is really really bad..

…WOW. I could handle my site going down, but damn, the entire network?

Just curious, do we get any sort of compensation for this kind of thing? I’m not expecting all of my wasted AdWords clicks to be reimbursed… but something like extension of our hosting plan for a couple of days?

OH, MAN! HA HA HA HA!

Why would you fire the one person who is the least likely ever to make this mistake again?

OMGWTFBBQ. Jeeze. This should be impossible, yet here it is.

I’ll thank you for the credit.

uhhhhhhhhhhhhhhhhhhh

?

good grief

Yeah, word. There was a post here within 2 minutes of the shutdown…I’d say that’s pretty damn good. Of course, it shouldn’t have happened in the first place, but I agree, at least we wern’t sitting here wondering what was up.

Hehe. Typos can happen to anyone.
Best part is it can be solved quickly when observed.

Man, I’ve actually done exactly that.
I know the pain!

this is extremely inconvenient (to say the least). i would like to hear how Dreamhost will prevent this kind of mistake from happening in the future.

Well at least dreamhoststatus.com is still up

This is why I love DH.

Seriously, if this doesn’t make you laugh, you’re a sad, sad person.

GB2NT3.51SRVR

You people need to lay the fuck off. Let’s see YOU do any better. I don’t see you hosting thousands of websites, now do I? Downtime is part of this game. Get used to it or get the fuck off the internet. Crying ass bitches.

March 7th, 2008 at 8:54 pmThe internets Says:

Half of the internets is down, get this stuff back up!

WTH!!!!!!! Sirs, The Simpsuns blog is not good timing for Simpsuns blogging! I demand formal repayment regarding sirs for hosting

Wow, posted 5 minutes ago and we already have 40+ comments. People are watching this problem like hawks!

My http://ww2db.com is still down, and I’m on a roll with traffic today before this point, too! C’mon Dreamhost, you can do it! Bring our sites back up!

Every time there is downtime due to a Dreamhost staff mistake, they should compensate us somehow. That would give them some incentive to be EXTRA careful.

On the plus side the technician successfully blocked the DoS attack :-)

Very disappointed again. Service has been pretty iffy for the past 6 hours or so. Been checking dreamhoststatus.com and this is the first I’ve seen of any problems. Not the first time similar events have happened. Hosting is really great overall, but when outages occur, your response times really are not so good. I really rely on mail, and mail is pretty much always slow. =(

You need better procedures, show some professionalism.

Well that explains it then ;)

To the gulag with the butterfingered admin!

well…atleast it happened on a friday night when traffic is usually fairly low

Anyone recommend a good alternative to Dreamhost?

One word: OOB.

So, what’s everyone’s favorite band?

this is pathetic, seriously….

Wow, another outage.

At least my lunarpages account is still up:
http://www.lunarpages.com/id/drunkenscholarcom

I can has refund on the internetz?

haha damn fat fingers :D

keep it up dreamhost, i believe in you ;)

Shit happens to all of us lol

denial of serice? hmmmm… just one more step before skynet takes over ;)

@In Pain: Compensation? Serious? You want compensation for your site going down approximately 30 minutes?? That’s just greedy….

heh. hehe. hehehehe. that’s actually pretty funny cuz i’ve done silly things like that before…….. :O

go lemurs!

http://news.nationalgeographic.com/news/bigphotos/images/060626-lemurs-africa_big.jpg

this is really pathetic. if you’re going to run a hosting company then you should get your act together.

@Robbie: Yes, I’m serious. Other hosting companies compensate clients for downtime. Why not dreamhost?

Really … I mean, to be forced to get someone to drive to the building to fix this type of issue is really really coming down to bad design.

A simple administrative vpn hosted by different IP space should be a must for you guys at this point, with remote rebooting capabilities and everything else.

15 minutes to drive to the site to fix an acl is a bit tough to swallow … I mean, you were configuring it remotely?? But cant fix it remotely??

BAD BAD BAD planning IMO

The Simpsuns blog!!!!!!! MY LIFEEEE (is over)!!!!!!!!!!!!!!!

“This should be impossible, yet here it is.”

Tell you what, make something like this ‘impossible’ and I’ll be the first one to buy your product.

Honestly, every network related outage I’ve seen over the last couple years has been perfectly normal. Where DH falls down is on the redundancy side of things. But let’s be honest, I’m not paying for redundancy. I’m paying for inexpensive web hosting with a company that has a good geeky culture. If they put the $2 million in a proper highly redundant architecture, trust me, your costs will go up accordingly.

haha, nice one :)

I cant say I have shut down anything the size of Dreamhost, but I have sure had my share as a net tech :)

Good Luck and thank you for the info!

I wondered if I was imagining things…. ha

http://www.NicheStoreScript.com

Time to go out, people!!! ;)

> Tim

Yes Typos can happen to anyone. But they should’nt be the cause of a general crash. There should be some security system to avoid this.
This is not funny.

Hey, we can turn this into a little chat room. I wish I would have bought more tequila

We just need to host our sites where they host dreamhoststatus.com, it never seems to go down ;)

I’m glad that at least the dreamhost.com site is down too. When my site goes down their’s is always up, so this will give them a little extra motivation to fix the problem sooner.

“poop pie Says:
March 7th, 2008 at 8:52 pm
oh shut up its not like anyone looks at your stupid little sites anyway”

Hahah, best comment.

The good part:

- you admitted it and posted it quickly

The bad parts:

- the technician should have been on his way in when the attack happened, so he would be there immediately.
- there should be enough redundancy so that one mistake like this doesn’t knock 500,000 web sites out of business
- what changes will you make to your policies to prevent this from happening tin the future? If this happened during the day, it could be catastrophic to some businesses
- 500,000 web sites are down. This should be used to change the way you do things.

Okay, it’s near midnight on the East coast. Stop whining and Read a book. Watch TV. Or, go to bed early!

Well mistakes happens and most often we learn from mistakes. I sincerly hope that this will not have repercussions on who mafe the error.

Heh, it’s actually pretty easy to accedentally enter the wrong entry into a firewall access list and block EVERYONE (which includes yourself, so you can’t terminal back in to fix the problem.) Cut her a little slack… it’ll be fixed in a few minutes.. all the tech has to do is arrive and edit one little access list and everything will be accessable again.

Simmer folks.

Matt

More comments! 15 minutes of comments. Comment-o-thon!

Please fired some one

Classic. Glad all of my shizzle is off of the DH nizzle…on a different host. All I have left to do is copy over email and then I can close the account…fo shizzle. My advice is make a clean break as quickly as you can…otherwise it will be death by a thousand cuts.

A lot of cash are lost because of this downtime. Please kindly do the best you can do immediately~

In honor of “Bush”’s Comment #4:

http://www.youtube.com/watch?v=K3meil7znjg

As you say in a restaurant when a waitress drops dishes - JOB OPPORTUNITY!! Nah, I totally sympathize… I’ve made similar mistakes myself…

whew… thought it was something I did…. LOL

I installed a script on my site… went to view it, and DEAD! nice timeing…. LOL

I miss my website, snif… freaks.

Stuff goes down, I come here for 30 minutes, read all the comments, then go back to work when the site is back up.

March 7th, 2008 at 9:01 pmSAVE US FROM ALIENS Says:

OMG RUMOR HAS IT THE PENTAGON IS HOSTED ON DREAMHOST, THIS DDOS WAS CAUSED BY ALIENS WHO ARE NOW GOING TO ATTACK EARTH AND THE PENTAGON IS HELPLESS TO PROTECT US… PLEASE CHINA, SAVE US!!!!

March 7th, 2008 at 9:01 pmJudge Ruckus Says:

You cats crack me up! I was worried though, don’t think I ever seen this happen.

todas las web que conozco no entran :D , estan en dreamhost, esperemos que lo puedan solucionar pronto para bien de todos

paaaaaartay! i got nothin better to do on a friday night except chat on here since I cant work on my website atm…. goes to show where my geeky priorities lie. =X

The internet is overrated anyway.

I would love for one day that there be NO internet. How cool would that be? How would we cope?

Hoping it will fix ASAP.

Thanks for the update, I hope you get it fixed soon. ;]

WHT! It sucks bigtime!

The last time someone told me they were 15 minutes away, they took over an hour to arrive.

I expect that refunds will be issued for the downtime.

The fat finger again? When will the next homer simpson blog appear?

Hi Kelly,

You wouldn’t happen to be from Pakistan would you?

LOL, just get us back up as soon as you can

15 min alreaadyyyyyyyyyyy !! c’mon i gottaa peeeeeeee !

bahahahhaha too funny, did someone let Josh play with the routers?

Between that freakin’ hilarious billing error and things like this, I’m slowly growing really tired of DH.

You guys oughta do admin stuff before smoking pot. Now the guy’s going to stop off at a 7-eleven for munchies, further delaying the fix. Grrr.

oh c’mon, these things happen, show them some slack. I’m glad it was because of something funny!

Aren’t you guys running the servers? Why do you have to call in a technician? Don’t the folks who man your datacenters 24/7 know how to configure these things? If you have people making config changes who don’t know enough about what they are doing to fix a problem they themselves created, then they should be out of a job. Period.

Get a clue, guys. Get a big fucking clue, and fast. The billing issue I can actually understand and forgive you for, but this is absurd and unacceptable. Staff properly. Now. What are we paying you for?

Holy crap man, that sucks. I feel your pain, I do contract sys admin’ing. Good luck, and HURRY so that I can finish downloading my backup :-p

Shit happens, like NO ONE is guilty of “fat finger” and makes mistakes ….

People is anyone going to die?

Every time someone at DreamHost screws up, they should be required to post an embarrassing photo of themselves as punishment…and to amuse us.

if you can edit the live access list to bring the servers down, why can’t you re-edit that same list? If it’s as simple as you put it.

I expect footrubs everything there is a problem w/ my inexpensive hosting. Footrubs and dancing girls!

Wow, was wondering why my site was down.

I know accidents happen, but this seems sort of extreme even to me.

Simply wow!

At least you seem to tell us as it is……

There goes the neighborhood!

I am starting to wonder how DH’s uptime really rates compared to other web hosts (services and price being equal) I’ve been with several hosting companies in the past that nickel and dimed me on a lot of stuff and didn’t provide the level of admin control that DH does, but I do not recall ever having this much downtime with any of them, including the smaller hosting companies (which usually annoyingly got gobbled up by larger ones… I think I went through at least three incarnations before my other webhost became web.com)

I’m starting to wonder if DH staff are winging this web hosting thing waiting to either go public or have a larger webhost buy them out ;-)
and while I’m rambling, since I have nothing else to do with my sites down, I wonder why anyone would do a denial of service attack against DH? Seriously! Why !?!!!? LOL!

Who fucked up MY INTERNET!!?

I got a whole box of Wheat thins.

I hope U guys will fixed this, soon..
15 minutes is too long :O
>_

Mistakes happen but the fact that they don’t have out of band access to their routers is baffling.

This is why I am moving to another webhost.

Hahaha. :) It happens. I am glad that status.dreamhost.com is hosted elsewhere… I thought I was going to have to call and NOT be helped by Comcast for a few hours… Again. :D

Anyone wanna come over to my place? I’m about to put Family Ties Season 3 in the DVD player and make a nice big spaghetti bolognese.

BYO bowls and cutlery - I hate doing dishes.

PatrickD,

I like that suggestion

“Every time someone at DreamHost screws up, they should be required to post an embarrassing photo of themselves as punishment…and to amuse us.”

heh ….

It’s 5am where I am so no biggie… hope everything’s back on by morning tho. Mistakes happen - smile everybody :)

I’ve been with you guys for six years now and service has always been top notch. Whatever the problem is, I’m sure you’ll have it fixed quickly. Thanks!

great! now my blog is down

This is by far the dumbest thing I’ve seen on DreamHost. >_

My work is disrupted…. Huhuhu

@eb - I would be very much willing to pay a little bit more for reliable redundancy. It would be worth it, especially when it would not be co-located there in LA. I’m not with DreamHost for the price alone - I paid more in the past - but because of their flexible service with many nice options that are hard to get on other hosts. However, their reliability record drives me away. I’m in the process of setting up a mirror, but it was not ready for the switch, yet.

>>>>>>>>>>
THIS PROBLEM NO SOLVED TOO!!!!!!

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

“Aren’t you guys running the servers? ”

The guy that rides the bike to keep the servers running doesn’t know how to change access lists.

Geeze - if they had to tinker with the servers 24/7, they’d be one shitty hosting company. Be happy that they DON’T have someone there on-site already - means everything else must be WORKING. You’re not dealing with a Fortune 100 company here. And even then, we have lights-out data centers.

Muhahhahaha - 400,000 customers OFFLINE!

(to “me”) - He can’t edit the list because it disconnected him as well

Too funny.

Note to Dreamhost - Need back door to Firewall.

March 7th, 2008 at 9:06 pmRumor Has it Says:

Rumor has it they were having secks in the server room and knocked over the servers.

This is completely unacceptable!!!

Great, now I have to go find some porn sites to keep me busy until my sites are back up. lol

I’m getting fed up with problems at dreamhost - horrible database performance, horrible latency, billing errors, now the whole company is down?

I think I’d rather pay twice as much for half as much pain. I’m not quite prepared to take my business elsewhere, but I’m looking hard for a place to take my business and am definitely going to start migrating stuff off soon.

So tired of the poor service :-/

Guess what? Nobody cares.

^^

Go go go, My sites are all down.

Severity: “Very” High

Or may i say very serious problem? We know mistakes do happen but this one is no ordinary. You guys makes sure that this wont happen again.

#
126
PatrickD Says:
March 7th, 2008 at 9:03 pm

Every time someone at DreamHost screws up, they should be required to post an embarrassing photo of themselves as punishment…and to amuse us.

^^^^
I second that! We need things like that to keep morale high in this chat room while we wait for everything to come back up :D

great! now my site is down

Not impressed. Prorated refunds or credits should be issued.

Presumably the same typo that locked us all out of our sites locked out their remote access as well.
This reminds me of a college fire drill party.

Jesus H.

Come on, let’s get these comments up to 200 before the sites come back. We can do it!

Yes, need photos of suspect….

Well it has been a while since the service was down…
Almost to good to be true!!!
Almost that is….
Until some moron Typo something!
Geez well Don’t delay

Admin Bob
http://quadhits.com
http://globalautohits.com

This is pretty typical of dreamhost.

I have nothing to do since my site is down need help LOL

@Christopher

I also wonder who host dreamhoststatus.com. :lol:

It’s really a shame because DH was about to break an uptime record of almost two months.

@Andrew:

“You are kidding me, right? A freaking typing error and all of my sites are down. Bunch of amateurs.”

Obviously, you’ve never actually administered a network or you’d understand how easy it is to make a mistake like that. They’re human, so mistake *can* happen. Get a fucking clue.

A+++++++ WOULD WASTE MONEY AGAIN!!!!

IIIIIIIIIIII’M NAGAGAGAGAGAGAGAGAGAGAGA

Man. This really hurts esp. on peak surfer night for ads (Friday), this hurts not only millions of people with sites but also business.

“Jenelle Says (March 7th, 2008 at 9:04 pm):

Anyone wanna come over to my place? I’m about to put Family Ties Season 3 in the DVD player and make a nice big spaghetti bolognese. ”

Sounds like a party to me. :D

Man.. and I was just about to move the last few of my sites off of Dreamhost.. Now I’m even more glad I’m doing it!

A good one for LOLcats - “i spillz on yer keyboard” or “catz won, dreamhost zero”

Hopefully we’ll back up any minute, there is a guy somewhere crying a lot.

my dad was right! I should have opened a gas station XD

Someone go suck out the blockage of the Tubes.

As a sysadmin, I feel your pain. Here’s hoping the network comes back quickly!

March 7th, 2008 at 9:10 pmHillary Clinton Says:

When the phone rings at 3am, and the servers are all down, who do you trust to answer the call?

thats stupid. and im annoyed now..

NEVER GONNA GIVE YOU UP
NEVER GONNA LET YOU DOWN
NEVER GONNA RUN AROUND AND DESERT YOU

Looks like dreamhost being down may be the best thing for my social life in years.

Anyone in Ft. Worth want to hit the bar?

someone at night but here is already 11-10 am
Thanks for the honesty but pls do all the best to prevent it in future

Moving to MediaTemple. They seem to have their shit together.

I was a big DreamHost fan a while back but I recently recommended it to someone and then there has been nothing but problem after problem with this hosting company, so I unrecommended DH and we looked extensively for a new host. I migrated his sites, but mine haven’t been done in time for this mess.

How much money and business do you have to lose before fixing your setup?

Well, at least you stopped the DDOS :lol:

Sites still down… Ummm… Does anyone know any good jokes?

Hey guys, is Dreamhost down? Why’s everyone in the chat room, usually I’m the only one in here.

thehun.com is still running…………………. XD

hahahah….the hillary comment is fucking good

It always happens? Why not asked this before? Drugs

Jenelle … good with the food, and I will bring my own silverware and plates. But Family Ties?

@Naga Patel: Hahah,,. that’s just so wrong. A gas station. That’s just a stereotype! :)

Oh, crap… I’ve been RICKROLLED!!!

ATTENTION! ATTENTION!

ALL WHAMBULANCE PASSENGERS PLEASE EXIT DREAMHOST
AT 1_AND_1_HOSTING.

You will be much happier there.

/Heh.
//Yes you will.
///heh …

I question my loyalty to dreamhost. mistake after mistake. I always assume this will be the last one, but it never is. unacceptable. but at least the response from dreamhost will be chipper and funny, right?

“Typoz canz deleet yr toobs - typz safe”

Bleeding hilarious, good thing my sites aren’t busy.
It happens, as long as response time is appropriate, I’m cool.
Now would be good.
deny them all!!

There should be some sort of conditional “Are you Sure ?” coding put into place for situations like this….

Ok, Accidents do happen, This just underscores the need to triple check your work in situations like this, I just hope the network can be brought up soon without any other hassles….

Dreamhost Lifer….

OOPS, YOU DID IT AGAIN!

Even my crotchographs didn’t get this much attention!!

It’s Britney, bitch!

WTH! I have a huge deadline and use my host for development of already hosted sites. I am losing tons of time, money, and sleep. i have a lot left do!

http://hostmysite.com/ is a good host. A lot of my clients use them, they love it.

what a mistake!! :P
hurry up, to to solve it!!

Yeah - I’m out, I can live with it. I wasn’t even going to comment, but I feel obligated to now.

“You are kidding me, right? A freaking typing error and all of my sites are down. Bunch of amateurs.”

…and similar comments.

Every company has a primary firewall. It wouldn’t make sense to have 30 firewalls, and have to synchronize all of their block lists every x amount of time. :P It’s a firewall error, and since they probably only have 1 firewall (or all of them actually do sync with each other) it’s understandable that the problem caused the entire network to fail.

What I find interesting, is that the datacenter is not monitored 24/7, and the closest tech on call is 15 minutes away… that, does seem like poor planning to me, but hey, for the price I pay and what I get, I shouldn’t expect a personal 24/7 server tech to sleep on top of my rack…and neither should any of you.

-Kirk

Well, I’ve administered servers and routers before and sh*t happens.

Hope things are back up soon. I promised a redesign by tonight and I don’t want to break my word.

March 7th, 2008 at 9:13 pmJudge Ruckus Says:

My wife just left me over this!

No what am I going to do as a single father with no websites?!

March 7th, 2008 at 9:13 pmAmazingly cute girl Says:

Anyone in Ft. Worth want to hit the bar?

Not with you…

Good thing DreamhostStatus.com isn’t hosted by Dreamhost. hahah!

You all need to relax and Shut the #$%^&* Up. They bend over backwards for everyone, and the minute a mistake is made, you all turn on them like rabid animals. Bunch of ungrateful $%^&*. Shit happens!

Argh. Annoying. You guys really need to be a little more observant.

Good luck getting this fixed though.

do we have any idea what website was the target?

This is very bad for the reputation of dreamhost.

Hey, just cut them some slack, ok? At least they apologized.
Maybe this is the first 15 minutes down time I ever got since I hosted my site here. But it would be extremely serious for some high traffic site. So some kind of compensation for them is appropriate in my opinion.

A fat finger AGAIN?

INCREDIBLE .. ahahahahahha

Only DH do it for you :D:D Enjoy!

I would have left dreamhost a while ago if it wasn’t for the panel. Its so easy to work with, and I havent been able to find any other service that is comparable :( Plus I am clueless about moving databases and the more advanced options of other panels :(

I aint having a moan, but the whole of dreamhost down, thats quite major for an international hosting provider. People do not like downtime even if it is for 1 minute or 15 minutes. This really is not an acceptable situation regardless of the timeframe of the disruption and the fact that it was brought on by a mistake by a member of staff makes us think that dreamhost is full of part timers that really dont know what they are doing.

cmon guys, get it together

It is certainly very bad …

March 7th, 2008 at 9:14 pmI Wish you were never born Says:

30 minutes so far. good thing you hire such competent people over there.

I can just imagine the conversation now :

Josh: kelly, you fat-fingered the firewall, you’re fired!

kelly: that’s not fair - the guy who fat-fingered millions of dollars from customer credit cards didn’t get fired

josh:

josh: carry on with the good work!

joder venga venga todas mis webs offlinee XD

Hey DH people, please bring our sites UP again!!!!

Oh stop your whining already! :-)

lol!
I can’t remember the number of times I used to do that on the cisco 2500s…
have fun!

…give em a break, I have over 100 clients I have hooked up to dreamhost… and I am not panicking… (yes, they are important)
You guys should thank all of us who pushed for this separate status system… most companies don’t have an actual working status system… and also cover up their mistakes.

Dreamhost is one of the most honest, and they continually stay “with it” and pretty feature rich…

I’ve had issues with them through time, but they’ve always come through… and gotten better through time.

Now watch - the technician will get in an accident or some damn thing. Or the guard at the colo won’t let him in, :-]

At least I was able to find the status page on google to see why my server was down. Thank you for the link and I hope you get it on line soon. I feel your pain.

March 7th, 2008 at 9:15 pmOH FOR CHRISTS SAKE Says:

Can someone starting firing the idiots from dreamhost before this company is just a smoking hole in the ground?

Me need help!!!
I do not know what I did wrong, I clicked on a link and then the site stopped coming back, all I see is tis message:
The connection has timed out
* The site could be temporarily unavailable or too busy. Try again in a few
moments.

* If you are unable to load any pages, check your computer’s network
connection.

* If your computer or network is protected by a firewall or proxy, make sure
that Firefox is permitted to access the Web.

Please help me!
Blondi

March 7th, 2008 at 9:15 pmkekkleskates Says:

so the first friday evening i stay home in months just to work on my site and this happens. its not too late tho. if this is going to take all nite plz let me know so i can drive to some party in la and have sex with strangers kthxbye

Ray you smell liek a broken record!

@ 231 - noodz plz

I would be really, really angry… but I’m too busy laughing my head off.

Do what needs to be done. It happens. :)

AHHHH
SHIT HIT THE FAN!

has anyone ever just kept hitting the refresh button and watched the comment count climb? what?…it’s just as much fun as the lame comments being posted! LOL.

Ok, let’s all write some dreamhost haiku….

Dreamhost where are you?
It is cold and my site’s down
hurry tech make haste

1 year free for all

I don’t work much on my sites, but it’s amazing that every time I decide to do something on them, I find DH down. Twice this week. Now that’s a weird coincidence!

It’s been almost 30 min. Hope this doesn’t take all night.

DH is a very good host, I talk to people using other hosting companies and many of them don’t get half the features we get. I’M STICKIN’ WITH DH!

DH 08! Forget the other candidates!

Holy shit, 215 posts already?

Talk about a whinge fest. Go pay more than $fuck.all a month for your hosting if 30 minutes of downtime causes you to lose thousands.

But lets face it, the majority of the 215 people posting here have stupid sites with a picture of them and their cat. Or a stupid free phpbb forum with 12 members giggling over a bit of lolcat copypasta they stole from another forum anyway. Or maybe a guild webpage with the dates of upcoming raids for their nerd mates.

Regardless. Your crappy little site disappearing from the internet for 30 minutes doesnt mean shit. Dreamhost owes you nothing. In fact, the people who whinge about trivial stuff like this need to gtfo of my hosting company and find someone else. That way there will be less internet lusers demanding ferraris for pocket lint putting load on my servers.

In closing, lol.

TRK

Ya really 400 okay???????? Dreamhost will omg i need to type more words before i die. i am going to eventually my cells are dissolving but a system cannot understand itself

250!

LOCUSTS!!!!! FROGS!!!!! DOGS AND CATS LIVING TOGETHER!!!!! MASS HYSTERIA!!!!!! AAAAAHHHHHHH!!!!!

Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle, Twiddle…

To all you flipping out because they’re “amateurs” and that this is “too much for a silly typing mistake”, get a life and a clue.

The Firewall exists on the border between their systems and yours and, without it, you’d be crying even more. But since it’s a singular point of failure(effectively being a door as opposed to a system that can more easily be mirrored) when it breaks, bad things happen.

And I want to see one of you stupid and ignorant babies configure one of these bloody things -once- let alone to stop some punk with malicious intent from actively attempting to bring you down. Resolution within the hour is impressive even with larger corporate setups. I remember Google being down. I remember Yahoo being down. Hell, I remember hotmail.co.uk being down because someone from MS didn’t renew the bloody thing,

Mistakes happen. Deal with it and stop polluting other people’s webpages or life with your impatient filth.

Probably the same stupid crybabies that can’t get their DLink router to give them ‘teh wifi’.

I need to meet Blodi.. this is Big Jake… Ha Ha. I agree.. 400…

“What I find interesting, is that the datacenter is not monitored 24/7, and the closest tech on call is 15 minutes away… that, does seem like poor planning to me, but hey, for the price I pay and what I get, I shouldn’t expect a personal 24/7 server tech to sleep on top of my rack…and neither should any of you.”

is it a case that while they have 24×7 support, the actual hardware is hosted offsite? The company I work is like that. Operations is run from an office. Hardware is run in a data center, 15 minutes away. When you need to have someone physically go on site, there is a delay (& if its like us, it will take friggen 30 minutes for some security pleb to grant you access).

Ahh well, at least there are plenty who do realise that sometimes shit just happens

Are we there yet? =)

“has anyone ever just kept hitting the refresh button and watched the comment count climb? what?…it’s just as much fun as the lame comments being posted! LOL.”

I’ve been doing that for about 20 minutes now. It’s Hee-larious stuff!!

Good job once again, DreamHost.

anyone else notice the internet get a little bit faster :p

ASL?

246 and counting….uh oh…i’m wearing out my refresh button…having so much fun.

Sure anyone can make a mistake but not repeatedly as effectively as dreamhost.

what i didn’t get 250 i lose lets see what happens when the sytem is robbed labordaay holiday major weakness litterbug gelatin i am a spambot but you need not fear

It’s 6 am in europe and I couldn’t care less about the downtime. :)

my blog’s five readers
yearn for my half-assed ramblings
dreamhost strikes again

You all need to relax and Shut the #$%^&* Up. They bend over backwards for everyone, and the minute a mistake is made, you all turn on them like rabid animals. Bunch of ungrateful $%^&*. Shit happens!

Its now OVER 30 Minutes! A short downtime for a mistake such as this might be acceptable but >30 minutes, more than double your reported time to resolution. You have already made me look bad with my clients, now you post an overly optimistic resolution time and make me look worse! I just spent 30 minutes looking for a new host.

Dreamhost sychophants are pathetic, They just host unimportant blogs so they don’t care if it goes down.

March 7th, 2008 at 9:20 pmGrammar chick Says:

Oh thank God someone knows about “couldn’t care less!”

Yeah u sure right about reading these idiotic comment lol Crack me up pretty Good LOL

the border is a mexican border? shut up guyz we are not crying enough let us rejoice in our loins

Let’s all count to 1000

“my blog’s five readers
yearn for my half-assed ramblings
dreamhost strikes again”

lollerphone.

You all are a bunch of fucking idiots, learn how to spell when you are trying to yell about something. It tends to help. Get a life, shit happens. LIVE WITH IT!

NICE DAN

As usual, all we will get for Dreamhost’s screwup is a “sorry”. I am so glad I moved most of my critical sites to different hosting. Now all I have to do is move my blog (which is where most of my income comes from - thanks a bunch, DH ). And to think I paid in advance for three years of this crap.

Well at least this typo hasn’t billed us for multiple years…. yet

hala madrid

i cant believe i’m actually going to go be productive and do my laundry now…. …. O_O

I think we’ll click over 1000 comments on this blog entry. Its going to be more popular in this one 30 minute downtime window than most peoples sites are in the entire life of that site :P

I wish my site was back so I could hotlink some more porn though. Cause thats what the net is about imo, sharing porn everywhere.

OMGWTF even http://dreamhost.com/ is offline!
EVERYTHING!!!!!!!!!!!!!!!!!!!

The technician must be stuck in traffic…

hey chuck are you nothinghappens?

I think you need to compensate your 400,000 customers for this outage. It’s unacceptable and not the first time.

oh crap what now the way will be paved with ice cream? labor daay holiday again i said did anyone hear me? i don’t say these things without a place to leave my toepocket linnnnnnnnnnnnnnnnnooolllllllleum

March 7th, 2008 at 9:22 pmDreamhost hostee Says:

Wow, that was smart. I hope you compensate the thousands of site owners in some way.

Ha!

You know, I respect you guys a lot more for *admitting* when you make this type of mistake.

I have confidence that you’ll get it fixed pretty soon.

the bill-everyone-accidentally mistake
now the take-down-the-network mistake

whats next?

Hum…
Posted 33 minutes ago (March 7th, 2008 at 8:47 pm PST) by Kelly

33-15 = 18 min

So, in 18 min, nothing has been repaired?? It’s just a typo, isn’t it?

judi estas buena?

The world will keep turning. What are we coming to, that even 1 hour without it turns so many into nasty people? Time to get an analog life… I’m going to stop working online and read a book!

So, err, we’re talking inside job…

“If you’re a company that routinely has reliability issues, maybe you don’t post pictures of your employees having fun and goofing off?”

Dunno but i’m getting tired of the emo-fagtastic photos they post. Seriously. The fad is over. Fix my god damned site. Jesus Christ.

Slowest 15 minutes EVER. This 15 minutes is already 34 minutes long!

VOTE HILLARY

“A technician is about 15 minutes out from our datacenter” stumbling drunk and rolling in dirt naked.

Looks like they’ve stopped announcing their routes altogether… traces don’t get beyond 3 hops trying from home and my office.

what’s is this fuck about? i need to work out here man.

whooops, the fat finger strikes again. We all do it, but most of us aren’t taking down a whole hosting service. ;)

kanjeroo kanjeroo

Shaun T. Erickson where did you move your sites to?

I am so fucking pissed, that is enough, i am fucking changing fuckin dream host. I was doing a great promo tonight due to this fucking showdown, my 2 week’s hard work is gone. FUCK YOU DREAM HOST!!! MOTHER FUCKER LOSERS

hee-hee, LOL…well, I’m going to bed. Night all.

I just came back to Dreamhost after scorning it because of incidents like these. Ahh, cheap cheap hosting, how badly you treat me…

every second this stays down i lose money…get your shit together

It takes the guy 15 minutes to get there, 15 minutes to get down to work and probably another 15 to fix it. I don’t think we’ll be up for a while, just DO SOMETHING ELSE. Me, I’m having fun eating cheese and watching the world flip out :3

#40 Zathman: you owe me one new laptop. I sprayed my beverage, LOL

Meanwhile we’re on our way to DDOSing http://www.dreamhoststatus.com! BWAHAHAHA

Its still not UP.

Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it

Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it
Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it

:(

GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity GARRETT funcking fuckity

lo, que, representa
la niña esta en mi cabeza, esa niña…
la q esta liando zapatero

My kids are screaming because my sites are down! They can’t play their videos!

D.O.S. attack
Dreamhost warriors shield us all
downed sites are quite safe

maybe the typo is rm -rf /
and all file servers are mounted below /
so……..

lol PWNED by a typo

Obviously the typo was a cover up for Something …
God know what they done again!

Other then break the streek of almost 2 month without down time!
Just another to piss everyone off

“And I want to see one of you stupid and ignorant babies configure one of these bloody things -once- let alone to stop some punk with malicious intent from actively attempting to bring you down. Resolution within the hour is impressive even with larger corporate setups.”

I’m a CCNP so I do have a clue about configuring routers. The first thing you make sure of (especially with a border router or firewall) is that your out of band access is working before making any emergency changes to a production router. Yes, it is very easy to lock yourself out when you goof up an access list. That’s why you always make sure you have a way to back out the changes before you start making them.

an hour already wooooowwwwwwwwwwwwwwwwwwwww

GHETTO SUPERSTARRRR TAHT IS WHAT U AREEEEEEEEEEEEEE

March 7th, 2008 at 9:25 pmJudge Ruckus Says:

For the record I am still happy with DH, this is the first real issue I have had in the past couple of years.

Anyone started typing up a news bit yet?

I’ve lost $3 million in revenue from this down time.

Gonna go eat some candy cigarettes. Call me when they’re done.

FUCK DREAM HOST I AM DONE WITH IT. I AM GONNA CHANGE MY HOST TOMORROW.

every second this stays down i lose respect for humanity

Dreamhose strikes again.

Why the frik is there not someone there full time who can deal with these sorts of issues, for all the customers and money you must lose each time this happens isn’t it worth it?

Wow, I’m glad that my sites aren’t critical… Seeing as I have made this mistake before, I am not mad at ya, thanks for telling us… Oh, and I am kinda surprised that you all don’t host your “Dreamhoststatus” page, or do you and you just don’t have it firewalled… interesting… well, I guess it’s smart to host this somewhere else if thats what you all do… Hmm, well, hope you get it back up soon!

“Money Blue Book Says (March 7th, 2008 at 9:24 pm):

Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it”

Only the Professor can fix it! ;)

la la la la la

fat finger!…..

Posted 37 minutes ago (March 7th, 2008 at 8:47 pm PST) by Kelly
This is not serious!

This is funny, I have been building websites for 12 years and the one thing I found was this. The people who bitch and complain the most are the same ones who pay the least. AND they have the least amount of visitors to there website. Its funny how people can say I am loosing thousands of dollars because there website is down when they only get a few visitors and they dont have ecom or any forms / quote requests. just my happy thoughts :)

Oh shit, barackobama.com is down.

I feel for you - that shit-in-your-blood feeling when you realize that you’ve just screwed up really, really bad, is no fun at all. Anyone who has been in IT for any length of time and had responsibilities, has done something like this. Kudos to you for owning up to it.

That said - cyclades has a great range of products which would be useful in this situation, so your guy doesn’t have to have physical access. Put the console servers on a separate (and I mean, REALLY separate) admin network, VPN in to the console server, and there ya go. Add to that a clueful datacenter tech who can follow direction and you’re golden.

March 7th, 2008 at 9:26 pmCrazy Capitalist Says:

For every second my site is down, I’m losing $.000003 in Google AdWords revenue!?!? Damn you! I was planning to buy a beer in 2009!!!

hurry the fuck up!

Doooooooood…….

You’re telling us that one typo on one server brought down your entire service?

Everything?

What steps is Dreamhost taking so this doesn’t happen again?

I feel your pain, I have been the victim of a typo that took out a major tv provider for about 2 hours… If any one had dropped service durring the superbowl. sorry, it happens

the problem fix in 24 hours. thanks.

Bob, that’s nothing - I’m losing $3 million a minute! Damn you, Dreamhost!

“As usual, all we will get for Dreamhost’s screwup is a “sorry”. I am so glad I moved most of my critical sites to different hosting. Now all I have to do is move my blog (which is where most of my income comes from - thanks a bunch, DH ). And to think I paid in advance for three years of this crap.”

Hilariously enough, I moved all my “critical sites” *to* DreamHost, because they still have better speed, and generally better uptime, than anything else I’ve got. :P

-Kirk

Hurry up please.. we are all losing business here.

HELLO DREAMHOST STAFF

I AM NOT HAPPY WITH THE FERRARI YOU HAVE SOLD ME FOR POCKET LINT PRICES.

PLEASE TO BE GIVING ME 5 YEARS CREDIT FOR THE 10 MINUTES OF DOWNTIME I SUFFER EVERY 6 MONTHS.

I AM LOSING $11 MILLION DOLLARS FOR EVERY 2 SECONDS MY SITE IS DOWN I WISH FOR YOU TO COMPENSATE WITH ME FOR IT OK

GOOD BYE

Error because of a typo.

I was writing an awesome blog post.

ANd then the screen went crazy.

I was baffled for a sec, thingking what could be wrong.

A friend of mine showed me this.

So I read.

My blog post is gone.

I am sad

:’C

Fire whoever made the typo. This is ridiculous.

Every minute my sites are offline = dollars out of my pocket. :S

Hahahaha…Friday night…a couple of drinks…see what happened? hahahaha…anyway…CTRL-ALT-DEL it´s not a good combination of keys…CHEERS!!!

my site was down earlier in the week - I emailed support and by the time they got back to me it was up again - tech said to write back if it happened again - it happened again - checked dreamhoststatus.com and nothing - so I wrote back that it happened again - came back here and see this - misery loves company, I guess - coming up on 40 min, I think, since I noticed - ah well

These mother fuckers kept deleting my posts, but son of bitches wont go and fix the problem, GO FUCK YOURSELF LOSER AND FIX THE PROBLEM SEE WHO IS FUCKING YOUR MOTHER!!! GOD DAMN I AM SO FUCKING PISSED

Ahh, I’m just kidding.

So you’ve lost $3MM in 30 minutes? What do you sell, Crack?

Stop cryin’ kids!

Any of yawl ever f’d something up?

Why the hell did Dreamhost get rid of their dedicated host support number?
Can’t handle the heat?

“FUCK DREAM HOST I AM DONE WITH IT. I AM GONNA CHANGE MY HOST TOMORROW.”

lol, noes! I think you people just like kicking up dust and seeing what kind of conflict it leads to.

-Kirk

OK YOU ARE SO DONE!

This is just not worth it.

Tomorrow I’m moving my heart monitoring and bank vault security system to a better $10/month service. I might even move my missile control system next month!

Error because of a typo.

I was writing an awesome blog post.

ANd then the screen went crazy.

I was baffled for a sec, thingking what could be wrong.

A friend of mine showed me this.

So I read.

My blog post is gone.

I am sad

:’C

Sorry, the assignment was to write a haiku. No credit.

Will the outage last long enough to bring down this blog?

Dear All:

Your blogs suck. You don’t make money off of your dreamhost hosted websites. You are pathetic. STFU.

Wow, talk about Murphy’s Law, I JUST found out the Spam block has for some reason quarantined a LOT of my legitimate email for some reason. Now, here’s the funny part. I JUST this week changed the settings to only send me the quarantine list once a week, on Friday, so that’s why I just now saw it. PLUS, I shortened the time to keep the files too (because until NOW, they had all been crap and I was tired of looking at them, but OF COURSE, now that it is REAL mail that is going to be thrown away very soon, unless I can log in to webmail and white list it, I CAN’T get in to do it!Q@@0 Do you see how funny it is?? I mean funny in an ironic, frustrating, tear your damn hair out kind of way, not Ha Ha.

Posted 41 minutes ago (March 7th, 2008 at 8:47 pm PST) by Kelly

Hey, is there a pilot in the plane?

That’s going to be a lot of email.

Error because of a typo …

rm -R /*

???

:p

I think for $10 a month it’s gonna happen every once in a while…the freaks that expect perfection need to open their wallets, not their mouths, and buy themselves a perfect world to go live in…or just drink less.

I don’t understand why someone has to come to the network center because someone made a typo?!? Have the guy call someone on a frickin’ phone and tell him what to type to fix it! How can you possibly be down for this long because of a TYPO!!?? Just hit UNDO or something, CHRIST!

And to the moron posters: It’s LOSE, not LOOSE!!!! Gah!!!

My sites are back up!

LOL, I’m joking!

Okay, I’ve just gotta know - is there an IRC chatroom for this sort of occasion?

dude this sucks :((

Dreamhost is up FINALLY!!!!!!!!!!!!!!

Hey atleast this is not as bad as a typo bringing down a space shuttle. (some genius put a + instead of a -

Looking back through this status blog is depressing. In the first 18 months of use, dh has been the least reliable hosting provider I’ve ever used (since 1995). If my entire job was to keep computers running, you bet your sweet ass they wouldn’t be down more than 12 hours every 1,000 years. Hopefully you’re not counting on hacking fixes for all the other known ISP failure modes as they’re occurring — and going home before testing them.

Thank God Dreamhose isn’t in charge of our nuclear arsenal.

Dreamhost is not working now.

Everyone cries loudly in their large beer.

Bitch better have my money!

DanVanWinkle, putting this site NOT in their hosting makes perfect sense. Same with site monitoring - those pretty much have to be external to be of any use at all. If you’re watching them from inside, and someone backhoes your feed, you’ll not know until the phones start ringing. Measure the system from outside, just as your customers do.

Same thing for a status or support site, very effective to be able to have that on an entirely different network. Can you reach this one? No? How about that one? OK, if you can’t reach both, that tells us (thing), if you can’t reach just one, that tells us (other thing). If the status site wasn’t outside, we’d all be wondering WTF just happened and not know so - I’d say it was a good decision on their part.

That said, as someone else mentioned, I’m losing 0.00000000000000009 cents a minute in adsense revenue here guys, hurry up and all that (bleh…whatever).

Wait, now I have a question, where in the world is the secondary firewall during all of this stuff? Can’t you just fall back to the secondary, or did that typo screw that up also?

Yo Verb - I don’t think Christ works there…back to the perfect world thing…

You’re telling us that one typo on one server brought down your entire service?

Everything?

What steps is Dreamhost taking so this doesn’t happen again?

Monday, 9am Pacific Time - all DH employee have their fingers off, of course.

At least we know the firewall works!!!!!!!!!!!!!!!!!!!!!!! GOOOOOOOOOOOOO FIREWALL!!!!

For the price, DH is great, but downtime comes at the worst times. lol

@ #326 Cal: You’re a moron. Ever think some people might have hundreds of dollars worth of PPC ads running to these sites.

Just because you haven’t figured out how to make real money online, doesn’t mean other people haven’t.

DAMMIT!!! I am updating my site, now it’s not even up!?!?!?!

it’s okay i can wait. Hope they fix it soon!

March 7th, 2008 at 9:32 pmAngry customer Says:

I really hope someone is getting fired over this. This is completely unacceptable!

“Will the outage last long enough to bring down this blog?”

That’s only happened once to my knowledge. There was one major outage though - I forget the cause of it - where there was so much traffic to dreamhoststatus.com that they converted it to static HTML because the server was being overloaded with PHP requests. :P

-Kirk

I wonder where ‘DreamhostStatus.com’ is hosted?

I highly recommend “XP Programming” when working on critical systems like this. With two pair of eyes, it is much easier to spot mistakes before they happen.

i am loosing $100 billion/sec

Jesus people, some of us pay $100+ for VPS here. We’re not all on the $5 plan

I’m not worried, I know things will get back to normal (sooner than later I hope). On the other hand, I was just thinking that with all the back and forth that goes on in these comments, it’d be really cool if the links weren’t rel=”nofollow”

Update? Please?

@ #337 - The Red Krawler

Hahahhahahaha! Freaking awesome.

Shit happens. Hope you will get it sorted soon.

Taking the scenic route, huh? It’s been a LONG 15 minutes to get there. Stopping to grab dinner, dessert, a few donuts and a coffee?

I probably won’t cancel my subscription, but you’d better believe I’m NOT going to recommend Dreamhost to ANYONE and will definitely NOT be using Dreamhost for any “serious” hosting.

These outages are getting to be ridiculous. Every few weeks I have to email support because PHP5 has been blocked yet again, every few months the entire site becomes inaccessible due to some stupid mistake.

“I wonder where ‘DreamhostStatus.com’ is hosted?”

According to my traceroute, it’s hosted with http://www.servepath.com.

-Kirk

This is ridiculous. I know people shouldn’t be so upset. But proper precautions weren’t taken. I had been keeping a couple of sites on dreamhost with the idea of moving them all off, but I drug my feet. Bad move. I guess I will be moving them off to my other server. I know it sucks, but one hour of downtime is a bit rough. This is the third time in the last several days that I have suffered enough downtime with Dreamhost to affect me financially.

RonPaul2008.com is down!

UPDATE: The tech guy was caught in the traffic.

I find this all really funny, actually. Give them a break. It could happen to anyone.

I wish all those jumping up and down about looking for a new host would realize what whiney cheapskates they are making themselves out to be. I’m not a sycophant but I don’t hate Dreamhost either. I just recognize it for what it is: ridiculous amounts of storage and tons of features for next to nothing.

Sometimes things go pear shaped but for the price I’m not going complain a bit. I’ve had other companies promise better support and uptime but they also want to charge $$$ for limited storage, databases, access, etc, etc… For my businesses that requires multiple redundancies and engineers on-site 24/7, I pay out. But for the operations that don’t, I accept the risk with Dreamhost.

“If you are experiencing a problem not reported here, check our web panel for more information.”

*clicks*

*waits*

“Oh, right!” :D

Carl Lumma, pls send your resume to josh@dreamhost.com

Carl Lumma, your quote of “If my entire job was to keep computers running, you bet your sweet ass they wouldn’t be down more than 12 hours every 1,000 years.”, makes it pretty clear to those of us whose job it IS to keep computers running, that you don’t have the first clue of WTF you’re talking about.

Please, don’t now respond with the usual tactic of “how much does Dreamhost pay you to blah this blah that whatever” tactic. Just don’t. We both know I don’t work for them.

HAHA This is great!!! Block the whole world from DH!!! I love it man, blame it on the typos or the crack or you guys moved to crank by now since you are close to Mexico where they have the big Meth houses :P.

Anyhow as they say sh@# happens! HAHA love this though, look at the responses, seems the $10/mo nitwits are crying again. :P Hope to see DH back online, at lease Link is taking a break though!!! Poor linky has had a tough week. Hope you all get it back up because I’ll send out my invoices before long too you guys for the downtime :D Where is Josh when you need the poor guy?

shouldn’t editing a live access-list for hundreds or thousands of site’s be harder than a TYPO?

I’m guessing that the typo’d router is preventing them from remoting into their data center. You can’t undo something you can’t connect back to.

Kelly, mistakes happen. Have a few beers during the weekend and you’ll be right as rain. :)

“RonPaul2008.com is down!”

No it’s not, it’s working fine on my end, and DreamHost still isn’t.

-Kirk

HOUSE MD

I got $5 that we reach 1000 posts or more before things are working again.

Any takers?

I really hope that nobody will be fired. I don’t understand this anger. We have online shops. Today is woman’s day in Europe, our flower delivery service is down and we can live with that.

Anyone digg this? lol…

Typos *can* be fixed quickly when observed, but some 45 minutes into this and I’m wondering where my email, web, and hosting panel are. I’m don’t want to be one of these shrill “I’m losing $xxx per minute” folk, but an update would be really awesome.

Someone put a new hamster on the wheel, this one’s dead!

Yeah, everybody guess how many comments there will be before it comes back.

KAO!!!!!

Hello, I’m not hosted on DreamHost, I was thinking to but I was wondering some way to get Google Checkout and the 94 days refund period in Argentina. Now I won’t get DreamHost. If you were a seriours company, this won’t happen. Its like “I brought my dog to the datacenter and he powered off all the servers”. This shouldn’t happen, you represent yourself as professionals, not a free hosting made by idiots OK?
This is so fucking stupid… I would like to know the name of who mistyped the things in the router.
He/she should be fired immediately in my opinion.

Well, this sucks :)!!!

Greetings, maybe if you get smarter employees that know how to use a keyboard, maybe it was not a qwerty keyboard or he was writing with a touchpad keyboard, I can’t understand how a person can be so fucking stupid if not, I can’t also understand with the things mentioned before how can it be SO idiot too.

Whew! Thank goodness this happened. I’ve been modding this darned drupal site for 14 hours straight and I really had to pee! I know Coke and pretzels isn’t super nutritious, but it’s easy to stack on the corner of the desk and ingest for hours straight. But taking a leak means getting up from the desk and going over to the bathroom - and I was afraid I’d lose my groove.

FINALLY the site went down and although I kept hitting refresh for 15 mintues straight, I finally came here to see that the whole server was down. SO I finally made a bathroom break. MAN I feel so much better now.

You know, you have to look at these little setbacks with the right attitude. Heck, if it doesn’t come up within the next 20 minutes, I might just try going to bed. They say going more than 48 hours without sleep is dangerous, so maybe this is a sign.

[quote="Paul Sweeney"]Typos *can* be fixed quickly when observed, but some 45 minutes into this and I’m wondering where my email, web, and hosting panel are. I’m don’t want to be one of these shrill “I’m losing $xxx per minute” folk, but an update would be really awesome.[/quote]

Yes, ordinarily they can, but not when the network is locking you out. Think before you speak Paul. :P

-Kirk

Aaahhh …. my life is ending…
Based on last years sales I am losing $8314.75 per day with my site
down. My wife is leaving me because I depend on such luzers for my
business website. What’s worse is that she has the keys to the
cupboard where I keep my stash - maybe she is going to report me …
She has already killed all the puppies.
Help me please, get the site online fast.

I like that people who are making ’serious money’ are still hosting on a $5/month shared hosting solution. Even the VPS is still shared.

Go dedicated, and pay the big bucks for redundancy on redundancy on redundancy. And make damn sure your solutions are hosted in multiple locations. Heck, make them in multiple locations in different countries. Also, host a copy in space in a satallite.

THEN… you have a right to whinge if your site goes down.

Until then stfu and eat a dick.

Ode to The Firewall

In a webhost that had a deep moat
Worked an admin of some incredible note
But without much delay
He made some great hay
By fat fingering a file remote.

I would like to know the name of who mistyped the things in the router.

Scroll up to the top of the page, genius.

Please don’t tell us it’s going to be fixed in 15 minutes when an hour later it’s still down. That’s it for me and dreamhost.com, lately you guys have been going extremely slow, the mail was just down a couple of weeks ago, and there are other hosts that have the same or lesser prices for way better service. Come on guys, first you charge us all for a year, then the mail goes down, then the sites are running slow, then the whole server is down.

Pathetic, I’ll be canceling tonight.

Yeah, it’s been dugg, http://digg.com/tech_news/Fat_Fingers_Hit_Dreamhost_Again

You guys need to calm down. People screw up once and a while. Go get drunk and laid and quit bitching.

DO THESE FUCKERS HAVE A PHONE NUMBER? I WANT TO GIVE THEM PIECE OF MIND!!! THE TECH IS PROBABLY BUSY SUCKING ON THEIR MOTHER’S TITS

Damn DH, the billing error was one thing, a billing error.
But locking your entire company and customer base out of your entire network with a firewall configuration error is.. embarrassing.

OK $10 that we reach 1000 posts.

If you’re not hosted on dreamhost, what are you doing here bitching? (Much less demanding that people be fired…)

“I brought my dog to the datacenter and he powered off all the servers”.

You chucklehead, it was a ferret! :-P

problem fixed

Ian, what a fucking troll, you trolling for NoDaddy?

Dang… everytime I go to work on my web site Dreamhost seems to go down on me. This is the 7th time it’s happened right when I’m working on designing my site. o_O

50 minutes, and the guy who’s supposed to arrive in 15 mins didnt corrected the typo yet? Something tells me there’s more to this…

Really, It’s repetitive to complain over and over, but dreamhost keep making silly mistakes over and over… I’m really thinking about leaving :(

WTF? How do you quote something? I thought it was like phpBB’s BBCode on most blogs, but I guess not.

-Kirk

For those who wonder why the typo can’t be fixed remotely: the key to the piggy-bank is in the piggy-bank.

I wonder who is the provider of dreamhoststatus.com as this site is always up?… Now if that could only happen for the paying customers.

Turns out that we and Moe won’t be canceling tonight; we can’t get on the internet.

just typed out 400 thousand lines of code in 550 diff files to complete the greatest website ever made it will be better than myspace, facebook, youtube combined and i went to save and the sites down i lost everything billions of dollars are now gone thanks to this with no backups

i want atleast 10% of my possible revenue back for the problem 10% of $15 billion

This is the first time i’ve posted in all the years i’ve been with dreamhost.

What a shame, another painful error on their part.

Wake up, dreamhost! its time to hire real admins!!

You’ll soon find yourself wondering were all your custy’s have gone too!

What I’d like to know is where is their out-of-band management? They should have ways of getting into their network even when all else is hosed. A dial-in modem even, just for emergencies like this.

HAHA and all the DH posters on here posting links to their sites while they are down HAHAHAAHAHAHA

I told you guys to start putting up Gentoo boxes and get off them 1952 Vacuum tubes :P

Just thought I’d mention to all of the dumb@ss whiners who are complaining about dreamhost not having redundancy…if you nitwits had redundancy on your sites, you would all be up now wouldn’t you? How could you have let this go unchecked? Your sites are worth millions and millions and millions, and you rely on only one discount 10 buck a month host to insure it’s online 24/7/365? If you’re that stupid, you deserve to be down! Take this as a wake up call and take the downtime as an opportunity to do some research on google on how you need to set up some redundancy for yourselves! Jeez, how could you have been this stupid!

Ok, carry on.

http://www.flickr.com/photos/57668330@N00/485497512/ LOL Cat in ur serverz?

I can haz a damb tipo?

FAIL.

March 7th, 2008 at 9:40 pmStatusReplyRobot Says:

Update — Update — Update –

Least we can expect — Least we can expect — Least wecan expect –

So we killed your sites for a little bit - big deal, GET OVER IT. We are working on it and all will be fixed soon. Babies…

well, can’t comprehend how careless one could be like this!!!!!!!!!!! however, thanks for being honest about your mistake.

March 7th, 2008 at 9:40 pmBorn yesterday Says:

It’s back up guys.

GO GO GO

500 Comments ;-)

Penis Balls, Penis Balls.

I put my penis in your vagina and you moan!

WHAT A WHORE!

^l33th4×0r p03m bitches!!

@Neo :: You should lose at least $1.5B for not knowing how to keep a backup.

It looks like this only affects the shared hosting customers. A site that I know is on DH dedicated/colo is still up and running.

As a software engineer for a large web company, I am required to say that this kind of mistake should NEVER happen.

Hey All

USE GMAIL for ALL OF YOUR EMAIL … Google Apps is very cool ;-)

…Apparently the technician is actually 51 minutes away.

Please don’t tell us it’s going to be fixed in 15 minutes when an hour later it’s still down.

They said a tech was 15 minutes out of the NOC. Believe it or not, it takes something more than a technician walking through the door to resolve an outage, even if they know exactly what’s wrong.

Dudes. Outages happen. Sometimes ’cause someone screwed up. They had a notice up here immediately and copped to it. Breathe calming breaths.

GO GO GO Fixt the darned problem already!

“Anyone digg this? lol…”

i saw this new via digg

Not only do I host my personal website, but the school I am the technology director for hosts with Dreamhost for free as a non-profit. Free isn’t worth the 4h outage in 3 months.

I wrote to the support team and they basically told “it’s going to go offline f*ck off”.

I just bought my hosting plan today and I’m thinking about canceling. I hosted with Crystal Tech for 5 years and my site was never down once.

I’d like to say that I do understand. Typos happen, and when trying to block a DoS, you tend to get a tad bit flustered and rushed in the heat of the moment. Personally, I’d like to find out which group of people were DoSing a site hosted here and wring their necks.

God, you are all the biggest fucking whiners I’ve ever, ever seen. Internet is broken? Jesus fuck, go outside for a while, what the hell is wrong with all you douchebags?

THIS IS ANNOYING!!!!!!

I want to see a website with big money. Maybe I learn something.

“What I’d like to know is where is their out-of-band management? They should have ways of getting into their network even when all else is hosed. A dial-in modem even, just for emergencies like this.”

Exactly. Changes to a border router or firewall should never be done without OOB management in place.

#418 Wrote:

> Please don’t tell us it’s going to be fixed in 15 minutes when an hour later it’s still down

Nobody said it would be fixed in 15 minutes. That’s how far out the tech was. Fix time wasn’t mentioned or estimated.

The Red Krawler: Go fuck yourself, money is money $10 or $100. If they take $10 it doesn’t mean they have to be down that often. Some people don’t need dedicated servers to run simple websites, which makes them money, alright fucktard?

NERD FURY!!!

March 7th, 2008 at 9:43 pmI Love Dreamhost! Says:

Yeah baby, gimmie some of that down time!

Haha! lol. Good job ;) I’ll label you a terrorist now :-p

Naw, but stuff like that happens. I’ve brought down my own personal home server more than once by screwing up a file or two. Oh, and NEVER try to chmod the boot directory on *nix ;)

We all make mistakes. I think that DreamHost really needs a better sort of backup incase of mistakes like this.

Born Yesterday’s right! IT’S BACK UP!!!!!! Oh, wait…that’s only if you’re INSIDE the hosting facility…

#429 Kirk - like this.

Everybody, I have video of the outage occuring:

http://www.youtube.com/watch?v=eBGIQ7ZuuiU

No one is PERFECT. so errors occur sometimes…

Just solve it ASAP

I am sorry but i have to say this all of you claiming to be loosing Millions are SO FULL OF SHIT!!! if you were really making that kind of money we would not be reading your posts here, we would be talking to your tech guy / girl. ALSO everyone already knows your Lying because to make that kind of money you have to be SMART and no one that is smart would put an important website like that on DREAM HOST, dont get me wron I love dream host for the small low traffic websites.

hey don’t be pricks people make stupid mistakes.. but hey dreahost get this stuff going again wtf
, wtf wt6wfwtlkasdl;kfjasdjf;laskdjf its been much longer than 15 minutes

Seriously… it takes an hour to undo a typo? You guys just can’t seem to do anything right

Woops,

Don’t sweat it, we’ve all made mistakes that affect others.

Ephesians 5:15-16 says: “Then watch how carefully you walk, not as unwise, but as wise ones, redeeming the time, because the days are evil.”

This is one of the “days are evil” moments, when everything goes to crap. So now it’s extra important to remember to redeem the time. Each moment has value, don’t waste it worrying about this mistake. Praise God that we are alive, and don’t sweat what happened.

A little something to keep people entertained during the outage. Here Comes Another Bubble! http://www.youtube.com/watch?v=I6IQ_FOCE6I

I hope it comes back soon.

dreamhoststatus.com is up.

all other sites r down, including blog/panel…..

Thanks for working so hard guys! We appreciate you! I’ve been a member almost ten years, and this is the first serious downtime I can remember in at least the last five years. Dreamhost has an excellent record and does great business. Thanks guys!

Cal, we’re joking - making fun of people who whine that they’re losing important amounts of money, but run there businesses off of dirt cheap webhosting.

DH should give us 1 free year for each 30mins OFF!

So… Take it easy with the fixing… :P

I kinda hope they don’t get it straightened out quickly. I mean, sleep would be good. I noticed that I’d been getting kinda paranoid lately - just sitting at the PC, changing PHP code to reverse the columns on my site for days on end without sleeping. Well, I wasn’t just changing code columns, I was also making a nifty banner rotator. That kept me up all Wednesday night alone.
So, if the servers stay down for a little while longer I’ll be forced to give up and go to bed.

If they’re down when I wake up, I might even splurge and try to squeeze in a shower.

i want my site hosted where this one is. :(

Thanks for giving the timely status and for being honest, I’m sure a lot of us here who are also admins have been through similar things as well haha.

It’s past the 15 minutes. Site back up yet? No.

Tick-Tock…Tick-Tock…Tick-Tock

Time’s-A-Wastin’…

Thomas :(

what the hell is going on…… problem is not resolved yet……. gurrrrrrrrrrrrrrr………………

Cal, we’re joking - making fun of people who whine that they’re losing money, but run their businesses on dirt cheap webhosting.

only this domain is up.

all others r down.

Here you go cry babies:

http://www.vandertramp.com/INTERNETDOWN/

Watch that video and cry some more :P

Nice. It’s been far longer than 15 minutes now guys. Can we get an update?

Beverly: Who is this? some inside staff of dreamhost? LOL! nice one!

How come this blog is still active???

You know the funny thing? I only had about 6 pages left to code out of over 300 since our last host crashed and we moved to DH. So close to finally being able to have our site back to normal and the new host is down…

twiddling thumbs…..

Anyone can make a typo but there should be safeguards to prevent typos from bringing down an entire NETWORK. I’m a software engineer and to allow a manual typing error to cause this much chaos is incredible incompetence. Don’t blame the guy doing the typing. He just exposed a weakly designed, fly by the seat of your pants system. A similar typo a couple months ago caused massive overbilling, in many cases overdrawing customers bank accounts. Thought maybe you guys would have learned a lesson from that one.

Your programmers (if you have any) should be busy putting checks into your systems to prevent these kind of catastrophic errors.

No wonder you had to cut your rates by half. Another Dream/Nightmare Host mega-blunder. You guys should write a book on how NOT to run a hosting company.

Found this on Google

DreamHost Status » Blog Archive » Dreamhost firewall error
Due to a typing error on our primary router while trying to block a denial of service attack, DreamHost is currently offline. This includes all email, …
-1 - 16 minutes ago - Similar pages

Well, I guess this is one way to “take the night off”! :(

It’s past the 15 minutes.

FOLKS!

Fifteen minutes TO GET TO THE DATACENTER!

Not fifteen minutes to fix the problem!

Just when I was getting motivated to do stuff.

500

There once was an admin at Dreamhost
Who was stuck too late at his post
To fix the firewall
He made a change small
But too late because it was toast

I love how many fucktards are whining about “loosers” who don’t know how to admin servers, or that one server could bring everything down.

Learn what a fucking firewall is, and what it does (hint: they’re not running Windows Firewall here, probably either a Cisco or Juniper). Now you learn how to administer one from the CLI. Too hard for you? SAD, STFU & GTFO.

You know, I yell louder than most when my site goes down and there is no quick response from support with a time table and a solution. When it’s something like this thats quickly reported and every effort is being made to rectify it, I can only chuckle at the perfect folks that whine about the outage. While the down time affects me badly, I have complete faith it will be fixed as soon as they possibly can and not a second later. (Or sooner.)

“Steve” says, “As a software engineer for a large web company, I am required to say that this kind of mistake should NEVER happen.”

As a leader of a team of sysadmins for a large IT company, I wish that software engineers would stick to their code monkey work, and not pretend they understand how infrastructure works. Go write some buggy code please, and leave the sysadmin work to the big boys.

People screw up. Shit happens. Get over it. As others have pointed out, if your stuff is so damn important, why are you hosting for 10 bucks a month? I’ve been using DH for a bit over a year and this is the first actual outage I’ve seen that touched my stuff. And you know what? Tomorrow the sun will rise, birds will fly, and life will go on. Your precious site will be back up just fine. GET OVER IT. Dude screwed something up. These things happen.

Ever write a bug, Steve?

1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!
1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!! 1 HOUR OUCH !!!!!!!

GG DH.

I’m losing almost a half cent a minute! Hurry up and fix it already!!!

March 7th, 2008 at 9:49 pmsurprise surprise Says:

my fault for not migrating off already, this is the third or fourth major downtime in 2 years. dreamhost has gotten terrible, just to state a fact known to its long-time (7+ year) customers.

@charm we are in the middle of enrollment season at my school, I could care less about the internet, this is costing us enrollment and by direct association MY JOB. which not coincidentally is directly tied to keeping our website running.

@Kirk

Hey Kirk, I do know what it’s like to lock yourself out of a system, and I’ve pulled a similar trick by restarting sshd with a malformed configuration on a remote server.

That being said, for one hour in, I don’t think it’s out of line to ask for at update if they’ve got a tech on the scene, reconfiguring the firewall.

Come on Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it Fix it

Juzt Fix it!

Sincerely Fix it!
Christ!

heh time to reroute email.

To the people flipping out at the top of the comments:

I think it’s time for evening meds.

To those keeping their sanity wrapped around themselves:

Kudos.

To Kelly:

C’mere and get a hug. :D

it’s back up

very rapid

Working again?

IT’s up now.
SEE y next down time!

hey! it’s taking too long now!

Phew for a second there i thought DH was running off my laptop i reboot from updates and come back to see DH doesn’t work!!

March 7th, 2008 at 9:50 pmBorn yesterday Says:

Like I SAID, it’s up.

Ouch… 1 hr and counting :(

I think it’s great you guys are honest about this stuff. I feel for you. At my first (real) job I built a web system for tracking customer data for a large cellular company. The web was new back then and ops didn’t do backups on this server and the production server was the same as the development server. Anyway I did an rm -f on what I thought was just some development stuff, but it was taking a while. You can guess what happened. My boss was fairly cool and was able deflect at least some of the heat by blaming ops for not having a backup.

IT’S BACK UP FOR REAL! MY SITE JUST LOADED!

They are probably jamming screwdrivers into and jerking out cards from their cisco 7500. Bang on it with a rock, and maybe that loud fan won’t buzz anymore. If I didn’t get a Terabyte of oversold space for $9.00 a month, I would be outta here. Thanks Dreamhost for teh awesome.

It is back!! my websites are loading up now.

Thak god it back up !!!!!

Good luck everyone else!
Lol

All better

Everything seems to be back to normal now guys. Go check your sites and if they aren’t back up just keep clicking refresh a few times.

Well, it’s late and I’m sleepy.

Good night to all and to all a good night.

-Yo’ Daddy

Has anyone ever thought of “social networking hosting”? Hosting companies that are run by the very community that they serve! HAH! That would be something else… Because the community always seems to know how to run a business better than these “dumbasses” that do “nothing but fuck up” and still manage to take our $10/mo!

My mail’s working again, and my site is back up.

Good thing. :-)

Sites back up. Email too.

Do not ASK me what I am doing on the internets at 12:51am. Maybe it was because _Jumpers_ kinda sucked…

aaaaaaaaaaaaaaand we’re back!

it’s over. all is well with the world and we can go back to making our millions

*shrugs* My sites up now. Seems to be fixed??

Its back now, faggots.

Fifteen minutes TO GET TO THE DATACENTER!

Not fifteen minutes to fix the problem!

If the problem is what they’re describing, an incorrectly entered firewall rule, it should take a minute to fix. (Actually, it should take 5 seconds or so, but we’ll give them a bit.) Just remove the damned rule. Done. Fixed.

Then you can re-add the correct rule to work around the DDOS.

It should not take this long to remove a broken firewall rule.

Yup, it’s up now.

REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!
REMIND ME AGAIN WHAT I’M PAYING YOU GUYS FOR?!?!?!?!?!?!?!?!?!?!

Well, it’s late and I’m sleepy.

Good night to all and to all a good night.

-Yo’ Daddy

Just checked and things are up. Someone could’ve made 10 bucks!

Wooohoo! Back to normal! Thanks for the rapid response to a colossal oops!

It’s up!

Someone found the emergency bottle of Viagra!

Now remember, if it stays up for more than 4 hours, call your doctor!

Ehh, again?!
Dreamhost has crap uptime…everyday its down atleast once…its starting to really piss me off

373
Nic Says:

March 7th, 2008 at 9:32 pm
@ #326 Cal: You’re a moron. Ever think some people might have hundreds of dollars worth of PPC ads running to these sites.

Just because you haven’t figured out how to make real money online, doesn’t mean other people haven’t.

Hello Dumb Ass - i was talking about the people who are saying they are making millions, they are full of shit and you should learn how to read and understand before you respond and post. The world if full of jack asses like you - talk shit

hahahaha i love watching you little pussies cry

WE ARE ONLINE AGAIN!!!!

Yeaaaaaaaaaaaaaaaaaaaaaaaaaaaaaah!

Mine is still broke

I really don’t understand this anger. We had often problems and the Dreamhost support team helped us each time
Some where our mistakes. Are you more happy if soembody is fired. Try to be a little mere human. It isn’t the end of the world and neither the end of your online business. I think we will go far beyond 1000 posts

Yay it’s back!!

my site is up again

YAY! My site is back up and running!!!

Look, sh*t happens. I’ve done that exact mistake too… you can do something like save to running-config and not startup-config with an automatic reboot in 30 seconds or something.

Anyway, this ain’t ok. Refunds are in order. You need to send the message: “we know this hurt you, but this hurt us more, it cost us x00,000 dollars.” or you’re going to loose customers… starting with me.

props on dreamhoststatus.com working as it should.

So maybe DreamHost should just have a server admin on-site 24 hours? Kinda like most fire departments, the firefighters live at the firehouse and rotate shifts for a couple days at a time. Then, when there’s a meltdown of any magnitude, the server admin will already be there.

OHHHHHH

MYYYYYYY

GODDDDDDD !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

tech: whats the problem?
dh: oh, i deleted some stuff.
tech: did you try ‘ctrlZ’?
dh: dude, light my spliff.

Seriously? Seriously?!? Seriously?!?! YOU TOOK ALL OF DREAMHOST DOWN BY A STUPID TYPING ERROR? After the “typing” error, billing issue in January, you’d think there would now be systems in place that would prevent one dumbass from making a mistake like this. How about some redundancy? Or making sure at least two techs are double checking when you’re screwing with something mission critical of this kind? I appreciate much about Dreamhost and the way the service is run. It’s very affordable and the transparency and honesty is a wonderful thing. But the absolutely major, inexcusable kinds of mistakes are mounting, and I am realizing that the good qualities of Dreamhost are meaningless without a basic level of competency. GET IT TOGETHER!!! NOW!!!

sage goes in every field

March 7th, 2008 at 9:56 pmAnthony Ogburn Says:

LOL @ all the idiots who don’t understand the problem / enterprise networking

@Kelly: It happens, don’t beat yourself up. I’ve done it.

…but really, where is the OOB access?

i understand that feces happens… it does.

what i truly appreciate about dreamhost is their willingness to be upfront about the situation.

i have a few hosting accounts that i use… dreamhost is the only one that will admit problems.

rp

site: back up. finally. now to look for another host.

ITS FIXXXXED!!!!

My sites all running, fast and perfect.

Nice day guys.

My sites are running now…thanks Dreamhost….Please BE MORE CAREFUL. It was a lucky strike that this happened at midnight on a weekend, and not in a weekday, in a morning, on a Monday….

There, now everyone can stop crying.

I’d blog about this - but - my site is down! DOH!

I’m sitting here chuckling, with my face almost split in half by my smile. The number of posts on dreamhoststatus.com has climbed incredibly out of proportion to any previous outage. It’s historic. This is google-news BIG! Or - maybe not.

Charm is right - it’s time for us all to take a step away from our little blue screens. Stop eating the Doritos or ice cream or snickers. Let’s all take off our spock ears and get out the hackeysacks. It’s not the end of the world, right?

Right? It’s not, is it?

Finally I can put in a support ticket for my site being down.

Oh, wait…

My site is back up again.

Now I can post my blog again.

Thank you for copy/paste

and Thank you to God for the healing.

I am happy now

=D

GJ!! DH staff

My mail and webs allready back on!!! Cool…hope other services i pay for works like this…telling me what´s happening and work on it…Goverment for instance…hmm

see what happens when you give the server viagra– it’s back up ;)

My site is up! Thank you!

“A technician is about 15 minutes out from our datacenter to undo this mistake.”

It’s been over an hour. How long does it take to undo a simple typo? I mean, here in Ohio we have six inches of snow on the ground and can’t drive over like 15 mph, but DreamHost is “Partly cloudy, Lows in the mid to upper 40s, West winds 5 to 15 mph.”

whinin’ and complanin’ wont do anything right… lol

Every NOC should have an admin there unless they have 3 servers? :P

I’m up!

March 7th, 2008 at 10:00 pmkekkleskates Says:

yay back up

ty

oh well, it’s back.. hope this wont happen agan…

That was a close one… I almost made human contact in the downtime.

Site’s back, but mail isn’t. Wonder how long that’ll be. Not mad, just curious!

they r lyting abt the real problem!!

up!!!!!!!!!!!!!!!!!!

The one lesson from this fiasco is: the people that pay the least, scream the loudest.

Omg, tell your people to make their test on training routers or something, I lost about 2 hours of weekend productivty, what am I going to tell my clients tomorrow morning ? “Someone at the host was playing with the routers” ?

Please make sure this doesnt repeat, it’s vital for alot of ppl that you stay alive

Dreamhost_uptime–;

to end with a wonderful 94%

cheers

Okay, it’s back and the posts did not reach 1,000. Someone owes us all $10.

thanks it’s now solved :D

$5. our daddy owes us $5.

Thanks for gettin it back up.. mmm Candy cigarettes are the best.

Ive been with Dreamhost since 2000, wouldnt go anywhere else. Thanks for resolving this quickly. To those who are whining, try somewhere else for awhile and see how you enjoy life, or better yet, buy a server and host yourself. A++++ to the dreamhost team for getting this delt with quickly!

There was a typing error at Dreamhost

As we all found out from this shocking post

Bringing down 400,000 sites

And locking up thousands of terabytes

More than any DOS attacker could boast.

Thank you Dreamhost - you inspired me to write a limerick in the middle of structuring my website tonight!

And I met all these wonderful people.

How does one write a Haiku?

Again problems? =(

So we FAILED to make this post 1000 comments before it was back up!

March 7th, 2008 at 10:12 pmAddressed to Eric Says:

Hey Eric,

FUCK YOU

While it’s down you can play my game
http://www.kejut.com/bedasama

(This is a paradox, you know?)

Share the pain … be a part of the screaming and yelling … do it NOW! at http://fuckdreamhost.com !

@babs: A woman made a simple, forgivable mistake so it’s obviously a coverup? Go you!

ps. http://www.dictionary.com

one typing error
destroyed the firewall
inspiring haikus

Well now that the sites are up can anybody show me his millon dollar website?

“nizzle Says:
March 7th, 2008 at 10:02 pm

That was a close one… I almost made human contact in the downtime.”

LMDAO

“SWB Says:
March 7th, 2008 at 10:03 pm

The one lesson from this fiasco is: the people that pay the least, scream the loudest.”

That is the truest thing said on this thread. My worst clients were the ones I cut a “break” on the price. I don’t do that anymore, not for anyone.

March 7th, 2008 at 10:21 pmHold your horses....... Says:

Everything is not totally back—-just tried to update some files through FTP & it is not currently taking….
might still have some bug a boos…..also mail & forms are down

FTP up for me, at least…mail too.

it happens..

it happened again..

something is bound to happen, yes, EVEN AGAIN, eventually..

Frustrating, can be.. thats for sure..

human? (as in error)..

most definatley.

I would place bets on ‘people (not)being ‘happier’ with ‘other’ hosting companies,

… if ONLY THOSE people could be as HONEST as Dreamhost has (always) been…

instead of ‘blaming’ DH, blame the phuking script kiddies that start the DDOS’s….

oh, and as Always,
MAKE *YOUR *OWN *BACKUPS, AND PLAN *YOUR OWN* SURVIVAL.

THANKS DH! UROCK.

Haiku: 5 syllables, 7 syllables, 5 syllables.

Yay dreamhost! I hope no one gets fired. I would be so sad. :(

Phew. That was close.

What I liked was the instant post on dreamhoststatus.com about what went wrong, the apology that accompanied it - and most of all - knowing that so many crazies like me were up tinkering with their websites right at this moment.

Welcome back Dreamhost. We missed you like hell.

Anyone who pays that little for a host and expects it to be good is an idiot.

The fingers you are using…are too fat.

To obtain a special dialing wand, please mash the keypad with the palm of your hand….now.

Ever think some people might have hundreds of dollars worth of PPC ads running to these sites.

If you were smart enough to make money online, you’d be smart enough to know how to pause campaigns.

WOW YOU GUYS OFFICIALLY BLOW!!!!!!!!!!! I THOUGHT NETFIRMS WAS BAD I WAS WRONG!!!!!!!!!!!!!!! GET YOUR F***ING ACT TOGETHER AND STOP CLOWNING AROUND!!!!!!!!!!! I HOPE ALL THE SEARCH ENGINES FIND THIS, DO NOT BUY DREAMHOST HOSTING!!!!!!!!!!

Someone call Ryan’s mommy so she can come change his diaper.

DREAMHOST IS THE WORST HOSTING ON THE INTERNET!!!!!!!!!!!!!!!!!!!!!!!!!!

i dont think i will renew with DH this year…

blog still not working. Says database error

Dreamhost is hardly the worst hosting on the Internet. I don’t know of any other hosting that is as transparent about what goes wrong when it goes wrong. Granted, I wish things didn’t go wrong. On the other hand, Dreamhost *is* budget shared hosting. I don’t run a business on it and would not put anything mission critical on it. For me, its for experiments, some development, and my personal website.

If you choose to run a business on budget shared hosting, you have to weigh the sometimes higher risk of downtime vs a dedicated managed solution. The latter costs more but probably gives much better uptime. In my experience, Dreamhost has about 1 really really huge bad thing that happens a year like this. Their blog *is* really funny, though. Its just a balance.

Dreamhost, try not to do this particular dumb thing again. Thank you.

Glory Glory be to he his name on high. For he hath delivered the people of Raptah! Jeezuhs! to thy promisssed
LAAAAAAAAAAAAAND of bootylicious and cream.

GET. MAH…CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANE!! BIASCH!!!!

i {heart} dreamhost.

awesome!

Thanks for working hard to get our sites up and running. All is forgiven!

DH get your hands together!

I will leave dreamhost,looking for other web hosting

Many of my websites can’t work.what’s wrong?

STUPIDS !!!

lmao Matt

I’ve always found Dreamhost good, and I like they are at least honest about things going down.
But really there seems to be more f’k ups lately, at least ones that I notice.

Ive made stupid mistakes like this myself, and its great its all fixed up.
but it just makes me realize that dreamhost shouldnt be used for any serious websites.

Seriously, someone NEEDS TO BE FIRED ASAP.

Such mistakes can not happen on ANY company not matter how CHEAP it is.

Also, closing the entire network firewall by “mistake” it’s just plain… stupid, really.

First rule of a sys admin… think twice before hitting enter, and before that, think twice again.

After being with DH for almost a year, I am no longer surprised. There is at least 1 major outage per month, guaranteed.

Severity: High -> Classic!!! it’s like ‘Hmm, everyones down… should we…hmm let me think, no, no..hmm … um no definitely, yer definitely yep, lets set this one to high’ ;)

fuk your heart must have hit the fuckin floor like a steam train, you poor bastard, I think I heard it here in London.

I hope you recorded that first phone call for help, I can hear it now ‘FARAAARRRRRKK DUUUDDDEEEEEE FFAAAARRRRRRRKKK’…

Was thinking it would be good if you could just redirect our sites to this blog on downtime, bet we wouldn’t have one unhappy customer ;)

It’s a crying shame to have a site go down, but so worth it for this blog

Glad I slept thru it

No le veo la gracia e estos tipos. Nosotros no tenemos nada que ver con sus problemas y entiendo que los que hacen este tipo de ataques no son bien vistos entre sus colegas, ya que es una de las formas más fáciles de ataque!!!!!!

I’ve been with Dreamhost since 1999. I love their service. I’ll stay with them. They are a friendly bunch of folks who worked hard to build a local business (I am obviously a California person). Every blue moon, they make a mistake — as do all humans. The real downside to their growth is the fact that they now have to host lots of very evil people’s stuff. Some of the comments posted here are ridiculous.

“I’m a CCNP so I do have a clue about configuring routers. The first thing you make sure of (especially with a border router or firewall) is that your out of band access is working before making any emergency changes to a production router. Yes, it is very easy to lock yourself out when you goof up an access list. That’s why you always make sure you have a way to back out the changes before you start making them.”

I’m a CCNA and if you’re a CCNP, you should know that shit happens. If the Firewall was borked due to the access-list having an error, it’s possible he wouldn’t have noticed the error until later. Especially if he thought he was editing a non-live list as was claimed.

The very fact that there -is- a non-live list indicated that there were multiple lists saved within the device. the -fix- once he got there was probably just a simple copy-over and waiting til’ the routing tables did their thing.

It sounded as if he did the edit, drove off home, got a cellphone call once the first alerts starting coming in to the monitoring center(which of course would have been delayed), turned his vehicle around, drove back the 15 mins he was away, uttered a number of profanities, copied over the backup list and waited for propagation while people freaked out claiming damages in this one hour that isn’t seen on Fortune 500 companies (one of which I’ve done work for).

No doubt trying to extort money from a simple unfortunate glitch that could have happened to anyone and cost 1 measly non-peak-hour’s downtime.

@RighteousIndignation: ROFL

Is there still an issue - everything seems to be down (except dreamhoststatus)?

Yes, everything is down again. Let’s see…

All my sites are still down (9:15 PST). How much time does the router need to load all it’s tables?

everything down, including the panel :(

Hahahaha. Seeing these posts is pretty hilarious now that I’ve moved all my sites and services to companies that actually manage to properly do the job of maintaining an available network.

For the dude who got a VPS at Dreamhost, heh, bad decision pal. If you can stand CentOS, check out ServInt — they are excellent.

I think a lot of other hosts would have invented a less embarrassing reason for the outage. At least DreamHost is honest about it. :-)

“MOTHER FUCKERS!!!! FUCKING LOOSERS!!!!!!!!!!!!!!!!!!!!!!!! GO to school before admin a Server”

LOL, are you kidding? Go to school and learn how to spell and speak with proper grammar to convey a thought. It’s spelled “losers”, not “loosers”. Dumbass.

Also, why did you capitalize the word “Server” at the end of your sentence? Usually you capitalize the first letter of the first word of the sentence.

You truly are a moron.

Yes, it was bad that Dreamhost was down last night for a while. But s**t happens. However, I really appreciate their honesty in posting news of the problem so quickly.

Ironically Google’s blogspot has been down for 20 minutes today as I write this and all you get is an error message. I The only news about it is in a forum in India.

So, Dreamhost is better than Google at keeping users in the loop.

OMG!!! You run one of the top 10 hosting companies in the US and you block your entire hosting service??? DUUUH!!!!

next up:

sorry everyone, I was carrying a tray of muffins and my foot got tangled in this cord, so most of the sites we host were dark until after breakfast.

or…

oops, I fell asleep admining the servers and my head fell on the keyboard. but I’m awake now!

cue the keystone cops!

DH posts a lot of “a technician is on their way to our datacenter” msgs. Why doesn’t this company, which is obviously doing a large business, simply staff the datacenter 24/7??????

Oh Sweet Jesus, can this get fixed now, please?

I was directing business contacts to my website yesterday and if my site is down for any length of time, the assumption will be that I’m off the ball for not having fixed it.
People aren’t patient when taking a first impression of a potential business partner.

I already lost money on bank overdraft fee and the conversion rate when my “misappropriated” renewal payment was taken and paid back… now I’m potentially losing face as well as business.

Really not cool guys.

… and it’s back! Phew.
Best of luck to everyone else waiting/confused/other.

First major outage for me. I’m having fun though reading through all of your posts. Of course, my clients aren’t too happy that their sites are down, but I can’t really do anything about that now….

Things like this happen. Things will be back on top soon enough!

Haha, just finished hitting the “Submit Comment” button, and my site loaded. Good deal!

For the dude who got a VPS at Dreamhost, heh, bad decision pal. If you can stand CentOS, check out ServInt — they are excellent

I’m not surprised you’re spamming for them, since they are spam-friendly. I’d never give those scumbags a penny of my money.

They were home to the famous “Mail Gravity” opt-out spammers for years, even got busted for being sneaky about moving them around on different IPs. They kept very silent in public about that while getting called out on it.

Even when they’d try to keep a spam-free image by booting the little guys, the big spenders were safe there.

Still, my other hosts are never down and also have >100.000 and >300.000 customers, strange huh? Proof: http://tofu.he-hosting.de/uptime.html - I still wish my total DH uptime will reache 99.5% at some point.

would this have anything to do with why my Mail program won’t connect, either POP or IMAP????

since yesterday, unable to connect either way. :( bumming..
staying with DH under these conditions is like flogging oneself.

I mean… I’m not a million dollar customer.. but I want to read my freaking email… I’ve done NOTHING to my Mail program settings.. all of a sudden,,, nada, neinte, nunca.. nothing…. won’t connect… bsh*t.

Still, my other hosts are never down

ALL hosts have downtime.

I love reading all the people who hate on DH when things go down… I could easily spend hours here laughing at them.

I love reading all the people who hate on DH when things go down… I could easily spend hours here laughing at them.

Yeah!

When we had problems with our old ISP (they did not give us our address back and closed on us) I was strongly leaning towards dreamhost as I manage another site here. I was sold when my monitoring service reported a problem with the other site …. and it was solved an hour later. Most places would have just shrugged and said “Monday issue”.

I am done with Dreamhost. You people need to become much better to achieve “unprofessional” status.

Boohoo.

ALL MY SITES DWONTIME NOW.

This looks like to be a major outage, the email system has been down continuously for nearly 24 hours. Not sure if the error is as small as it has been made out to.

Also the main page shows the erroar as Resolved: Yes ????

My websites are down again.

Pargat - you should generate a support ticket. All my email was back over 24 hours ago - a little more than an hour after the reported problem. If yours is not yet back up, your problem be be unrelated.

All my sites are down!!!!!! Email seems to work though…

Any news???

Thanks for the sugestion “rlparker”. Will do so right away.

March 9th, 2008 at 4:01 amRunning Out of Excuses Says:

Down for an hour and a half this morning..after a bit more than an hour yesterday. This time no explanation, though.

Support ticket seems to be offile, when i try to submit one after the tests it returns me a blank page

i have many website on my account. http://www.7×7news.com work but http://www.7gadgets.com is down.

The server niagara appears to be out.

Kudos to Dreamhost for honesty. It would have been much easier to lie about the problem. Let’s hope the cackling lusers don’t dissuade Dreamhost from being open with its customers.

Seriously, a lot of you need to calm down.

BTW, megaman is back online.

It’s cheap, you have NO RIGHT to complain!!!!!!

Looks like there are still a lot of problems. Site connectivity is horrible, as is panel, mail and http://FTP. *SIGH*

All of my websites have been down now for at least two hours, probably closer to four. First reported via support panel two hours ago, haven’t heard anything in reply.

What I don’t understand is why dreamhost, given its huge size now, doesn’t use redundant servers & routers. How can there be so many single points of failure? It’s getting old. I can’t figure out if they are trying to be a serious business or if they just want to have fun. Witness the monthly newsletter — not very business-like. And then mistakes like this one, although impressive how quickly we were notified of the error — just indicate that the whole service is just cobbled together without standard IT best practices, like redundant routes and infrastructure. They are too big now to be just going with the flow.

Six+ hours of downtime for all of my websites, no response from DreamHost and I see nothing here on status about issues. So must just be my virtual server. This is maddening to say the least.

I got a respond from DH. All my website are up now! Thanks Dreamhost!

You stupid batch of fucktard amateurs. That also goes for the people who are here constantly defending Dreamhost. I don’t care how much it costs or doesn’t cost, the 20% uptime is so cool! yeah!

I only use DH for non-critical websites that don’t need an 99.99 uptime…never email (with an occasional email forward for forms).

Even so, I have Dreamhost PS enabled so few hundred I do host here get a bit more stability. This is the first downtime/slowtime I’ve experienced since I switched to PS.

I don’t consider myself an amateur…and my uptime is actually closer to 96% here, not 20%. Admittedly 24 hours in a row offline is deplorable but my math says 1 day down out of 30 ≠ 20% uptime.

here’s a tip

when working on a router - use the “reload in [m]” command, where [m] equals the time it takes to do the work plus 10 minutes. This way if you screw something up, the router reboots in [m] minutes and reverts to the previous config. If your work is complete and you are satisfied with the job, use the “reload cancel” command.

CCNA level stuff really.

I can certainly understand having some downtime.

However, I am becoming increasingly concerned as none of my sites have come back online yet.

I’ve been using dreamhost since about 2000 and typically they have reasonable amounts of uptime (although definitely not as high as it used to be) and always extremely friendly staff. I think the staff are still really friendly albeit there’s a lot more of them now.

So, while I’m still happy enough with dreamhost, I would still like to know how much longer it will take before everyone’s back up and running?

Any ideas?

still down, whats the status

Fixed? My sites are still down…. :(

Sick to fucking death of you cretins. Hire someone with a clue. What a total fucking moron.

 
© 1996-2008, DreamHost.com
Entries (RSS) and Comments (RSS).