Power sag in our primary datacenter (Update! Again!)

We just experienced a power sag in our primary datacenter. The affects of this are being investigated at this time. (It happened <4 minutes ago.) We know that many servers rebooted and are on their way back up on their own right now.

Sorry for the delayed update. After some finagling with our internal database servers, a switch failing, and other fun stuff, service is coming back up to a more normal level. We are going to continue to monitor the sitation and see how things are looking. We will post a final update soon!

We believe we are up past 95% of services restored. If you are still having problems please submit a technical support request through our web control panel:

https://panel.dreamhost.com/index.cgi?tree=support.msg

We apologize for the downtime, and the extended time bringing service back up.

.

195 Responses to “Power sag in our primary datacenter (Update! Again!)”

  1. Llynix Says:

    Nexus down and trying to come back up now. Just submitted my site to digg too. Hopefully everything will be a-ok in a couple of mins.

  2. Nick Says:

    Hey guys, this is a bit unusual isn’t it? A power sag shouldn’t be happening internally at the datacenter. Please post the causes and remedy measures taken once available, for my peace of mind.

    thx

  3. Baba Says:

    I noticed…

  4. PoRtCuLLiS Says:

    My site is down and can’t reach panel. I think my server is called baht.

  5. homeun Says:

    Pinging mysql.homeun.com [208.113.158.62] with 32 bytes of data:

    Request timed out.
    Request timed out.
    Request timed out.
    Request timed out.

    Why??

  6. Tony Crouch Says:

    Hooray! I was just getting ready to make a support ticket. My sites are on Dinar and it has been acting a little funny for a few weeks. I hope this doesn’t kill anything. Seems like power problems are what caused the last spate of hardware failures.

    Nice to know that someone is there to tell us what happened.

  7. Jon Says:

    I should host my site on a laptop, at least then it will have a battery back up :)

  8. Lucky Says:

    *sigh* :o|

  9. Dave Says:

    Site is up, but having latency reaching some images within fs. Server is qbert.
    Webmail is still not able to connect to MySql though

  10. Weiran Says:

    My site is still down, I’m on grant.

  11. Naina Says:

    Schilling’s down too. Can access via ftp but blogs and website not accessible.

  12. LR Says:

    crenshaw server

    website = up
    mysql = down (access denied error message)
    webmail = down

  13. Martin Says:

    My databases are down and the panel is extremly slown…

  14. ARQ Says:

    How long it will gonna take? Ritz is still down

  15. Llynix Says:

    It looks like it’s that way with all of us. mysql down, panel loading but no images, my site throws a wordpress error (because of mysql) and well.. I don’t use webmail :)

  16. Croll Says:

    Alondra server

    website is up
    mysql seems to be up

    but nto webmail :(

  17. Pietro Says:

    Webmail is still down.
    This is the error:

    Warning: mysql_pconnect(): Can’t connect to MySQL server on ‘192.168.10.10′ (4) in /usr/local/squirrelmail-1.4.6/session_mysql.php on line 61
    # Can’t connect to 192.168.10.10 as squirrelmail
    # MySQL Error: Can’t connect to MySQL server on ‘192.168.10.10′ (4)

    panel.dreamhost.com is also down too!

    Bye

  18. Lee Says:

    Dreambook Control Panels are down too as far as I can make out…

  19. pff Says:

    my site is down again pffz
    ftp = up
    mysql = down
    website = down
    webmail = down

  20. ciyara.gen.tr Says:

    hillhurst server
    http://www.ciyara.gen.tr Request timed out :S

  21. HK Says:

    Europe here.
    Indeed, problems accessing our corporate website (during day hours, not very nice for our customers…) and the webmail (POP3 is working fine though).
    Please investigate the reason for the power problem, this shouldn’t happen too often, if you know what I mean…

  22. HellHoster......... Says:

    Hmmmmmmmmmmmmm.. Webmail is DOWN!

  23. ARQ Says:

    I’m getting frustrated.

  24. HellHoster......... Says:

    AGAIN.

  25. HellHoster2......... Says:

    Honestly, I don’t care if Dreamhost is employee owned. I would be better off putting up a box at home. Even if my house burned down weekly it would be up more often then Dreamhost.

  26. Jens Says:

    My site is up,
    Mysql is up.
    Didnt check webmail as I have it elsewhere
    Panel Down.

    Jawbreaker server

  27. Dave Says:

    Guys…it’s been 30 minutes now…can we please get an update at least as to where we’re at?

  28. Daniel Says:

    I think malt is still down.

  29. William Says:

    Cannot login into my panel .. is this related?

  30. Bob Says:

    web up, mysql down, panel down,

    not a very good last few days!

  31. a-jacks Says:

    I cannot connect to the web panel either (5:57am EST). Thanks for the status, though. Loading, loading, loading…

  32. Tagrel Says:

    Dedicated server still down here as well… Estimate on when they will be back up?

  33. Vic Says:

    My domain is pingable and can be opened in FTP, but the site and panel are not loading. Related?

  34. Eli Says:

    Was wondering what was going on with my site :)
    Hopefully it will be fixed for me soon.

  35. stefan Says:

    websites seem to work, mysql for my websites also seems to work, panel is slow but working, but webmail is down. just to let you know :)

  36. Bob Says:

    Website down. Can not logon in to server to find server name. Getting mysql error when logging in to Web mail.

  37. mod Says:

    panel down, so I cannot contact support.

  38. ARQ Says:

    The clock is ticking and I don’t see any changes (at least at ritz). Why power problems are affecting so many computers?

  39. tom Says:

    come on its been a while now wake up have a cofee and fix web mail. I need to workkkkkk….

  40. William Says:

    the panel seems up right now. Just logged in.

  41. ROJAS Says:

    hello, cannot acces to panle.dreamhost.com. either!

    all my sites are down!!!!!!!!!!! come back!

  42. Naina Says:

    Schilling seems to back. Everything’s fine at my end now.

  43. Richard Philpott Says:

    MySql down here.

    Website on ralphie running, but very slow (probably because unable to connect to MySql).

    First errors at 10.19 GMT, so down for nearly 50mins now …

  44. mod Says:

    ok i got on panel now, reported problem. As if they need ME to tell them

  45. Simon Chaung Says:

    Hello, all my sites are down … Please help…

  46. Iarwa1N Says:

    mysql = down
    website = down
    webmail = down
    panel = too slow
    waiting …..

  47. ROJAS Says:

    im on badillo, and nothing is working. Just entered the panel, but its very slow-

  48. CosBeta Says:

    ………….. I don’t need timeout!

    Pinging mysql.homeun.com [208.113.158.62] with 32 bytes of data:

    Request timed out.
    Request timed out.
    Request timed out.
    Request timed out.

  49. Jessica Says:

    Notice how we only seem to come ’round when there’s a problem? IMHO, Dreamhost does the best job out of any hosting company I know to keep us updated on the latest, as well as informed on EXACTLY what is happening as soon as they possibly can. If I had to bet - they are working very hard to resolve this issue, and will give us an update ASAP.

    We all have work to do, and yes, we are all affected by this. I dislike my personal and business sites down just as much as the next customer. Just keep your pants on, and I have confidence that the Happy-Dreamhost-Major-Outage-Team-members will update us shortly… =) I live, eat and breathe high level tech support and know what it’s like to be in their situation. Let’s just hope for the best and know that we will have answers soon.

  50. Lucky Says:

    One site is up, (the totally non-essential one, go figure) but the other 6 important ones are down….

    Somebody pass me some Lithuim.

  51. Drew Says:

    Someone needs to fix the time here…it’s still on PDT…

  52. William Says:

    Though the panel is up, it seems it is still not connected to server. I change the setting of htaccess of my site, it used to reflect the change in a sec. Now I have been waiting more than 10min. but still the change does not reflect on file server yet.

  53. JJ Says:

    googled
    dreamhost outage november 2006
    and this blog came up.
    curiously, this blog’s mysql source is active and available, but mine is not.
    oh well, can’t be helped. machines break.
    If anyone is expecting better uptime, they’d best be spending the dough on dedicated servers and stuff like that. So no whiners!! You do get what you pay for. I’m sure they’ve got somebody on it.
    for all the whiners: try working in any computer facility that is always or nearly always on and available and used by the public. Things break, things wear out, and these are the places where the percentage of bad items that pass QC inspection at hardware manufacturers get discovered.

  54. Bob Says:

    someone needs to stop ‘livin it up’ and start administrating their servers…

  55. ST Says:

    Hillhurst is still down :(

  56. Peter Says:

    [quote]
    # David Krug Says:
    November 10th, 2006 at 4:18 am

    Peter,
    You know its perfectly fine for people to vent. In fact its human nature. As someone who studies psychology I know that its not wise to tell people who have emotional feelings of angst to chill. It makes them want to do the opposite. I do know that dreamhost doesn’t manage their servers well. They cram as many people onto a server to maximize profits. That’s fine. They probably dont care about users. Also fine.[/quote]

    To put things in perspective, I have both a Psychology and Sociology degree and I manage a team of people in an IT business.

    It is human nature to vent, but it would be apt to be realistic and take full account of all circumstances before starting to scream murder. When you have finished your study you will realize that all you are doing is demoralizing the few people who are trying to actually help you. It’s really not constructive - reserve harsh judgments until they are justified. At this point, they are not.

  57. ideha Says:

    Warning: mysql_pconnect(): Lost connection to MySQL server during query in /usr/local/squirrelmail-1.4.6/session_mysql.php on line 61
    # Can’t connect to 192.168.10.10 as squirrelmail
    # MySQL Error: Lost connection to MySQL server during query

    NOW WHAT?!

    :|

  58. Pacman Says:

    AHhhhhhh!!! …. Well, I just hope no data will be lost…. :)

    Keep up the very good support.

  59. Drew Says:

    I work in a large datacenter (7000+ servers, 60,000SF all for one company) and if we have a major problem like this, especially at 3am, it sure would take more than an hour to resolve all issues. For us, we have to find people to run database consistency checks, the servers may be running fsck’s on their own, some services may not be autostart for some reason, takes time to go through everything.

    That said, you get what you pay for…it’s cheap hosting, and it’s fairly reliable. In fact, it’s so cheap for me, that I don’t pay for it. for the basic package, if you refer 2 people in 2 years, it’s paid for..in fact they’re actually paying you $4.60 to host. But I don’t expect 100% uptime either.

  60. Martha Biggly Says:

    Thanks for letting us know what is going on and keep up the hard work!

    However, I am absolutely stunned by the censorship of some of these posts. None of them used swear words. I have four tabs open with the comments on each and posts that are against Dreamhost have been removed!

    Very concerned.

  61. Cian Says:

    Panel = up but too slow.
    SQL = Down.
    Webmail & Pop3 = down
    Site = Down

    Waiting anxiously…

  62. ciyara.gen.tr Says:

    Hello;

    My Site Hillhurst Server;

    http://www.ciyara.gen.tr uptime Thank You DreamHost Support :)

  63. Kolo Says:

    What you all are talking about? Half an hour of dead mysql is a problem? Buy your own server ;-) But this will cost much more 10$/month.

    Big thanks to DH Team for post about problem within 4 (!!) minutes. They really do hard work.

  64. bob Says:

    [quote]Martha Biggly Says:

    November 10th, 2006 at 4:29 am
    Thanks for letting us know what is going on and keep up the hard work!

    However, I am absolutely stunned by the censorship of some of these posts. None of them used swear words. I have four tabs open with the comments on each and posts that are against Dreamhost have been removed!

    Very concerned.

    [/quote]

    Try to paste in a new comment…

  65. Jessica Says:

    At this point I’m seeing major issues with Cox broadband as well. I’m wondering if there’s more to this outage than meets the eye… A lot of companies seem to be affected.

  66. Eric Says:

    To the people posting cut-n-paste error messages… um, duh!

    Anyway, these people are here at 3:30 *am* PST. Would *you* go to work at 3:30 am to fix a server or 10 for a bunch of ungrateful ingrates?

  67. Kentut Says:

    1 st post is 1 hour 12 minutes ago
    and still all my 10 site still down

    damn….

  68. Tagrel Says:

    Actually, I am paying dreamhost for dedicated service and my server is still completely offline. Still - I understand these sorts of issues, and have to say as long as it comes up soon, I’m happier with a 3am crash, than one in the middle of the work day.

  69. ROJAS Says:

    all my sites are up and working…

    http://www.argentinoz.com
    can anybody see whats happening in http://www.eferretto.com.ar ??

  70. bender Says:

    hey man i’ve worked as a systems administrator, i feel your pain!!!
    good luck fellas and thanks for answering my emails today!!!
    it’s 10:47pm here in australia. just random trivia…. :)

  71. Martin Says:

    Well, here in Europe it’s 12:50 am in the middle of a work day…

  72. Nick Says:

    @Eric

    Its the nature of the business. The service is 24/7 not 9am-5pm like call centers and the like.

    I can sympathise with DH on this one though, I’d just like to get at my sites.. dads is pinging and my site is.. but nothing..?

  73. leisa Says:

    it’s the middle of the day here, a few days out from the event our website it promoting and all our PR is kicking in… well, it was. it’s causing a bit of stress over here to have our site down for this long. (of course, i have the same situation as others where I have two other sites that can be down for an hour or so here or there and it’s no big deal… Murphy’s luck it’s the critical one that’s down whilst the others are up).

    thanks everyone working over there at 3am. I’m really hoping to see our site come up soon!
    (SQL on barqs seems to be the problem)

  74. Longmen Says:

    Recently, your system have many problems!!
    I can’t connect to my website frequently!!
    And now, it looks like having a big problem!

    I pay you money, and what I need is a stable server!
    If you don’t improve your service, I will move to another wbehosdting server and never recommend any of my friend buy your service!

  75. Bulbe Says:

    Bonjour moi c’est un autre probleme il est 12 am ici en france

    Hello I it is another probleme there are 12 am here in France

    http://www.directory.conua.com

  76. Kentut Says:

    1 hour 30 minutes…….. and still down…..

  77. nuzzaci Says:

    Dreamhost team, thanks for letting me know! Hope you guys get it sorted before the weekend.

    keep it up.

    /n

  78. oodLes Says:

    Longmen, eat a dick buddy. Where else does your bandwidth and disk space get upgraded weekly for free as well as doubled / tenfleded or whatever. DH is great value, and a power outage is usually never their problem from the errors Ive seen before. Also, threatening DH that you’re going to leave isn’t going to help you out getting your server up and running faster.

  79. GAWD Says:

    YOU HAVE WAY TOO MUCH DOWNTIME
    THANKS FOR WASTING MY PPC MONEY

  80. Karnov Says:

    http://webmail.kafeantzokia.com is not working right now. Nor the MYSQL related Movable Type instalation.

  81. Adam Says:

    damn it. Why mcclure down again!

  82. jj Says:

    for those who are starting to realize how this stuff goes…
    when you have a “mission critical” site that is also “time sensitive” and must be available and accessible, in the future, look into multiple hosting.
    In other words, use more than one host to mirror the thing. Few affordable hosting services will have distributed server/data centers in multiple geographic locations with enough redundancy enough to cover all contingencies. That’s called google or yahoo or amazon or the army.
    but you can fake it on the cheap with a mirror site of yours. It takes a little more in the way of server side Apache tweaks to tell the thing to go to mirror 2 or mirror 3 or other when the main site is busy, but it’s totally doable.
    do it for yourself if you need it.
    that will keep you in business in such contingencies.
    that said, this is stuff that does happen.
    Life.
    There is not always a backup for everything.
    a few months ago the Yamanote line (train looping around central Tokyo) here in Tokyo stopped for a few hours on a weekday. Needless to say, things got congested as all get-out all over the city and in a few hours the economy of the city literally had a slowdown and lost some money.
    All due to one 20 inch bolt that snapped after several decades.

    and for those who have UPS or even a notebook pc at home, a power sag or brown out can kill a battery permanently. Worse than an outright outage.

  83. Dave Says:

    I’m up and running…site, webmail, mysql, etc…Great Job Happy-Dreamhost-Outage-Rescue Team!

  84. Peter Walter Says:

    My sites at http://www.expandonline.co.uk and http://www.esmith-consulting.co.uk are down

  85. LithiumDoll Says:

    I just (literally - maybe a couple hours before it went boom, fell down) bought hosting on here … moving from my old server because of the downtime. The universe, she laughs.

    But, as much as downtime sucks (and it sucks monkey through a short straw, I know), perspective - it happens. Everywhere. Unless you’re on a host with failsafes that cost a whole lot more than any package on here.

    You buy a car but you don’t expect that money to protect you from accidents, or sudden unexplainable engine melting incident that are in no way your fault and totally shouldn’t get you grounded - that why you have extortionately expensive insurance. Same principle kinda applies.

    2 cents and it’s mine, all mine! ;)

  86. Thedragonman Says:

    As a veteran IT person I see the outages are just the nature of the beast.
    I am very impressed with the service for the price.
    Anyone with a little electronic knowledge knows a power sag can wreak havoc on electronic components.
    If everyone would sit back and be patient the servers will come back up once they have been checked for any damage.

    Keep up the good work

  87. SickOfIt Says:

    I do not even know the name of the machine that my sites are on but it is still down! I was on Saltine but that server was a mess and dreamhost finally decided to move everybody to a new machine yesterday… Now all of my sites are MIA… For the love of…
    Just bite the bullet and move to a new data center

  88. VietStudio Says:

    I don’t know when I visit my site.
    I see die,
    WHo can tell me why my site I can’t visit it.
    thank

  89. Racechick20 Says:

    We’re on seamus. I hope our site being inaccessible is related to this problem. I DO APPRECIATE how open, honest and upfront DH are when it comes to problems. These things happen and I’m just glad they keep us in the loop. Our previous host liked to pretend nothing ever went wrong and it was a royal PITA, I can tell you. Thanks DH and good luck with the fix.

  90. Douglas Says:

    Only my MySql is not working…

    I hope there will be no problem with the data inside it! (lol) Because I dont have made of my Wordpress database this week!

    Waiting…

  91. GAWD Says:

    time to move to a new webhost

  92. calum Says:

    trying to create a new mysql database, but the error NTERNAL ERROR CREATING DB: connect_admin failed for ren:xue. Please let support know! is being returned.

    I am guessing this is down to the current problems, but can anyone tell me different?

  93. Llynix Says:

    I’m so glad I’m staring at a full backup of my database on my desktop :)

    Hope all the rest of you get your data back.

  94. J Fielek Says:

    Everything is down for me. Three websites down, no webmail access, etc. Host was kenobi, but may have chnaged recently.

    garageofxanadu.com
    quibbles-n-bits.com
    thefieleks.com

    Thanks…

  95. aaa Says:

    leeloo is offline to (mysql)….

  96. Vic Says:

    Wanna go and move to a new host? I wish you all the best in ever finding a provider with this kind of services for the little price you pay. DH… don’t let these whiners get you down. Dreamhost.com rules in my book!

  97. This shouldn't happen Says:

    Dreamhost should charge more, but at least have diesel generators, power backup, cluster configurations so that that can offer 100% availability like Mosso or Media Temple.

  98. Nik Says:

    It appears to be only the SQL servers that are down, everything else seems fine. If you have any purely static html sites, they’re probably running fine. All your MySQL driven sites will be down right now.

    At least that’s the case here.

    (server: barqs)

  99. AngryUser Says:

    This server goes down more often than a cheap prom date!

  100. astral Says:

    I see that webmail access is up, www is up but still mysql is down …

    It’s not good …

  101. Diego Says:

    this service is so unreliable.
    time to move to a new host.

    i’d rather pay a little more and deal with a REAL customer service (with an email i can write to and a phone number i can call to).

    this kind of service is just unacceptable.

  102. Cian Says:

    Nope, my purely HTML site is still down on Orbital.

    I’d love to pay extra $$$ to get better backup facilities to avoid events like this. I couldn’t possibly leave dreamhost though, wouldn’t find the same level of exceptional service elsewhere.

  103. Steev B Says:

    I have my own site and work very closely with another, both on Dreamhost. Since the initial outage, web and webmail services are back, just MySQL stuff left to go so WordPress blogs can come alive again.

    Sucks to be DreamHost right now, especially given the fun-filled last few months, but this is the first time my activity has ever been affected by all the troubles. I’ve been impressed with the preparedness to communicate openly with their customers and have faith the issue will be fixed in a timely manner, shortly follwed by a witty and honest blog entry.

    Good luck guys.

  104. Mark Says:

    I’m down on Grant… 10 sites

    erggggh

  105. Kentut Says:

    2 hour 10 minutes……. still down…….

  106. Deano Says:

    My HTTP is still down. Believe im on peso, been like a yoyo the last couple of months…

  107. Biscuitz Says:

    mysql.biscuitz.com -> DOWN

    Please fix that

  108. Matthew Says:

    Diego Says:
    this service is so unreliable.
    time to move to a new host.

    bye then

  109. Ian Mikutel Says:

    boards.thewiire.com –> DOWN

    Please fix ASAP

  110. Linda Says:

    My site is still down at 7:41 EST

  111. jj Says:

    Hey, for those who don’t know, mysql databases are often installed and run from your diskspace on the same server as the web site they serve. There is such a thing as a data server for this with a web server as the front end to the internet. but in the first case, and most likely, it is probably not your database that is hosed, but PHP. For those who have ever installed PHP manually, it’s a doozy. Everything has to be in just the right place on the system and all the symbolic links gotta be right. Not to mention any additional modules… Your mysql is not part of a monolithic database we are all on. It would be a much bigger problem when problems occured that way.

  112. Morloi Says:

    mysql.dragooscuroforum.morloi.org still not working

  113. Nou Says:

    mysql.pronosoft.com down, please fix, this is the peak time usage in France! Please!

  114. Suz Says:

    Mine too… fidget… 6:47 a.m. cst… Can’t we get some updates? Please?!!!

  115. Cian Says:

    All back up again on orbital - sql, and website.
    Two hours isn’t too bad, but i’d rather it didn’t happen.

  116. Douglas Says:

    Some sites posted in this comments (like http://boards.thewiire.com/) is up, so I think the Dreamhost team is solving the problem…

  117. Dennis Says:

    There are hosting companies in Iraq with more up time than Dreamhost.

  118. Paul Says:

    All my sites on server ruppee are all down

  119. Brad Says:

    It appears sanspoof is still down. All my stuff on bill is running fine.

    Despite these every-so-often outages, I still defend DH like a Mac groupie defends his Apple.

  120. Eduardo Mercovich Says:

    MySQL server “db.mapeo-rse.info” is down. Please check it out, we are starting our work day here in Argentina.

    Thanks…

  121. Daniel Says:

    Webmail is back up, but www is still down, on malt.

  122. Alex Says:

    What’s going on? All of my sites on dreamhost are down right now. This is NOT good.
    This better be fixed very soon or I’m switching hosting companies.
    While I’m on the topic, does anyone recomend a hosting company with really good uptime?
    This is ridiculas.

  123. Daniel Says:

    wooot, www is back up on malt, cool. Let’s hope it stays up :)

  124. Paul Says:

    All my sites are now back up on server ruppee!
    Thank’s Dreamhost.

  125. alesh Says:

    8:04 EST, EVERYTHING’s BACK UP for me.

    still . . . ‘blah.’ no updating my blog today…

  126. Felix Says:

    Here in Spain now it’s 2:04 p.m. All the work day with our webs down, 15 websited down, horrible service and someone of our customers are furious.

    We need a quick solution!!!

  127. Suz Says:

    Fidget seems to be back up.. My server and mail is now working.. Thanks DH!!! (*fingers crossed*)

  128. Lucky Says:

    Thank you.

  129. Filipe Says:

    down @ 13:08 GMT

  130. Soroush Says:

    We are not talking about our home ! It’s a datacenter, Is there any meaning for power sag in datacenter’s dictionary ?

    Anyway my sites are on burns and it seems that file server came back but mysql server is down.

  131. Shawn Says:

    Saw the recent update on the blog but we still have a load of my sites down - http://www.bestvideos.org, http://www.qksite.com etc

    Appreciate your efforts…

  132. Davide Salerno Says:

    I’m a bit nervous because my mysql database is still down and my wordpress blog doen’t work
    14:13 (UTC+1, Italy) still down !!!

  133. Stefano Says:

    We still have problems connecting MySql here.

  134. Iñigo Says:

    Everything is fine now. All my sites worked; but I couldn’t connect to other hosts outside Dreamhost; now I can publish videos again.

    Thanks.

  135. Djordy Says:

    Websites are still down of Caesar, as is the Subversion service. Need this asap, otherwise I could rather send all my employees home for the day.

  136. Baldur Says:

    No MySQL connection here either.
    This is way bad :/

  137. leisa Says:

    barqs still down (with my SQL database) so my blog still down :(
    middle of the working day…

  138. Bob Says:

    Please STOP speaking about the low cost of DH services… people who pay for dedicated hosting have sites down exactly like others!
    Please STOP speaking about technicians working at 3.00AM local time, DH has customers from all around the world and the visitors of the hosted sites come from the whole globe too!

    If you are happy with this quality of service please… tell us that is YOUR opinion and it is a worth for YOU!

    There are others, while you are reading this post, still loosing money from DH crash! Is DH loosing money too??? I think no! The only thing we could really appreciate is the work to solve this issue as quick as possible and then a report to explain WHY is happened and if it could happen again…

    I apologize for my english…

  139. Douglas Says:

    My mysql database still down

    (mysql.gravateiros.com.br)

  140. proxy Says:

    drpepper

    web up
    mysql down
    webmail up

  141. Jon Says:

    Almost sent out a big marketing email today to point our customers to the launch of the new version of our site - I’m glad we chose to “double test” over the weekend and wait until Monday. It will all be working by Monday, won’t it?

  142. Rene Says:

    Still not working for me!!!

  143. Racechick20 Says:

    seamus: Our site is a vB forum and it’s still down - MySQL problem, I reckon. Thanks for the update though.

  144. Jony Says:

    pleeeeease.. a lot of custormers are calling me =|

    mysql mysql mysql mysql !!!!!!!!!!

  145. astral Says:

    Well, sprite.dreamhost is UP ;) It seems that everything going to normal…

  146. Bill Says:

    from the recent newsletter…..

    “In the meantime, we’re spending our sultry nights with the new gal in town, Alchemy.net’s new LAX facility………All this two-timing will probably lead to better performance all around!”

    ha ha ha

    tough luck DH…i think you still provide a very good service. these things happen from time to time.

  147. Ricardo Says:

    morgan is up now :)

  148. Racechick20 Says:

    Woohoo!! WTG DreamHost. All back and working. Thanks, guys!

  149. Filipe Says:

    tab completely nuts!!!!
    Why Linux? I want my… I want my… I want my… FreeBSD!!!!

  150. Peter Says:

    Finnaly!!

  151. Jeff Says:

    Site back up, but it’s 5-10x slowerrrrrrr than normal.

    We use Joomla and I;m guessing the myslq server is having issues still? Anyone at Dreahhost looking at performance issues at this point?

  152. Robin H. (aka freedom) Says:

    Is this sort of thing going to happen again?
    This just wiped out a civil liberties forum after it’s issues were debated in Parliment, and now everyone’s rushing to get their last contacts of the week in.

  153. PoRtCuLLiS Says:

    Good job getting things back up and running DH.

    2hrs 25mins of downtime is still a bit of a stinger though.

  154. Woo Elephant Yeah Says:

    Whilst this happened, a long time forum members user account has miraculously disapeared and dropped from the MySQL table.

    I know this because he was definitely not deleted through the phpbb ACP, and it’s buggered up all the postings in the forum :o(

    Can anyone advise what I can do to retrieve both the users account and their posts, as everythign is now out of synch.
    If I hear nothing I suppose I’ll need to raise a support request, but Dreamhost are unlikely to admit that this caused the problem.

  155. why Says:

    And things were just starting to look up yesterday evening. Hopefully we’ll get a good blog on this one and see what you’re doing to avoid it. Hopefully not too much equipment was affected.

    All of you threatening to leave. Thanks for letting support know that it’s not urgent to fix your servers. That way those of us staying can get back up faster.

  156. Shawn Says:

    Looks like butler is still down, huh?

  157. Lightwaves Concept Says:

    It’s 9:26am here in New York and still waiting for MySQL server to come back up.

  158. Bish. Says:

    I’m still down …

  159. LR Says:

    yep crenshaw mysql still down for me..
    4 hours downtime… and counting :(

  160. SIBA Says:

    still down. :-(

  161. Beth Says:

    Well, battery backups or not- I’m tired of the downtime. It seems as if out of all the sites I view, mine (or dreamhost hosted) are either slow or down. I’m moving to a new host. I’ve put up with excuses for a year.

  162. Doctor Macenstein Says:

    Not important, really, but our stats haven’t haven’t been updated since the 6th.
    What’s up with that?
    -The Doc

  163. Ruby Says:

    SQL still down. :-(

    Can’t connect to MySQL server on ‘mysql.connectuscommunity.org’

    Folks, I’m looking bad at work for having chosen Dreamhost in the first place, and for not having moved to a new host yet. This is bad.

  164. miss fidget Says:

    I just hope this is a hiccup. We all know it was pretty shaky a few months ago-but all in all it’s been way better since then. I just hope this is a hiccup.

  165. Thomas Says:

    Give them all a break. A power sag doesn’t always trip the generators, but can be enough for the servers to go offline. Blame the power supplier to Dreamhost, if you must.

    Happily,
    Tom

  166. Trent Says:

    I’ve been satisfied with how this situation is being handled. Given their rates, five nines of uptime is not very reasonable; if you want that, you should have your own datacenter. They’re doing what they can to deal with a problem outside of their control and keeping the userbase informed; that’s a lot better than other hosts.

  167. Nick Says:

    @4113

    Whats the point in your bandwidth and diskspace going up if you can’t view your site?

    DH Fanboys are mad.

  168. Ana Says:

    I was accessing via ftp a few minutes ago, now I can’t. Why don’t you update again? Is pretty obvious some things need to be solved so I guess the 5% of the users that are having problems worth an update about the situation.

  169. Plegestre Says:

    My sites are still not back up, and I’m on a dedicated server. I probably wouldn’t be annoyed except that last week it took DH four days and two requests to fix a trivial problem that was blocking all email on my server. I’ve learned from past experience that some webhosts go into a customer service “death spiral” as they grow, and that it’s advisable to get out before getting burned by lost data or long-term outage. So I’m wondering if it’s time to quit DH and move elsewhere.

  170. Sterling Says:

    8:42 in Los Angeles and still nothin’…. I gotta say that I’ve been a big supporter of Dreamhost so far through all the ups and downs, but it is starting to get a little ridiculous.

  171. Aleman Says:

    Why is it that people will put ‘critical systems’ on very cheap shared hosting, “Oh my business is suffering!”, “Oh my companies mad at me for recomending DH”

    Well do what we’ve just done Spend 1.5Million UK POUNDs!! on two datacenters running stretched SQL clusters with UPS and Generators at each site. The web servers are split between each location and traffic is load balanced between the two sites via a pair of Cisco 6500 boxes with CSM’s and FWSM’s.

    Oh and the dark fiber links between the two sites are provided by TWO companies using TWO independant routes in town.

    And even then we are not going to guarantee 100% uptime.

    Thanks DH for the service you do provide, It does hit my site (Particularly as its all mysql driven :( ), but hey! It’s not life or death for us if its not there. If It was I know where I would be hosting :)

  172. Mitchell Says:

    Do we seriously need the 100+ posts, telling us your site is still down. I
    am sure DreamHost have monitoring in place, and are doing their best to
    bring things back up as soon as possible.

    We all know that outages are inconvenient, and threats to find another host
    don’t help anyone.

    If you seriously think you can find better service elsewhere, then please do
    so, rather than complaining about it.

    I have worked for 3 or 4 hosting companies in a system administrator
    capacity over the last 7 years, and have seen some pretty nasty incidents.
    From this perspective I think the DreamHost guys do an outstanding job, and
    are very quick to respond to issues.

    So how about some words of encouragement, and be happy for your 718 hours of
    flawless uptime, rather than the 2 hours caused by an incident that no one
    could have anticipated.

  173. Norm Says:

    Amen, Mitchell…. Amen! :)

  174. mine Says:

    I’m moving to (mt) Media Temple, the hell with this!

  175. Wags Says:

    Dreamhost is not alone in what went down today from the datacenter! http://log.perl.org/

    From dreamhost:
    “We believe we are up past 95% of services restored. If you are still having problems please submit a technical support request through our web control panel:”

    https://panel.dreamhost.com/index.cgi?tree=support.msg

    Please, if your site(s) is/are still down, the only way dreahost support can know that your site is still down, and the only way the will do anything about it is to use the above link. This is only for those who are sitting here watching these posts wondering why no one knows their site is down.

    I second the amen to Mitchell!

    Rock on Dreamhost!

  176. george Says:

    There have been an excessive number of outages recently, but DH team has generally been very responsive and quick to remedy the problem.

    Speaking as someone who uses DH but yet have my own server hosting setup, I can see from their perspective — also, the posts about service and monthly fee are on the mark…

  177. sm00ve Says:

    Listen, I am not going to play it off like it didn’t upset me to be down, but I have been waiting while biting my ails like everyone else, and just wanted to give hope because my site just came up after being down since the incident was announced. All data is intact.

    Expensive hosting vs. cheap does not matter in my opinion, as a customer, if we are late with payment, DH serviced is stopped without any understanding (I am on auto payment, so before the bomb shell go off with this one …) , so as a customer we should be able to vent without ridicule. If everything was always “peachy” from the customer, what does a company measure against? Just food for thought. I’ve been with DH since they started.

    DH is working on it, and I would asumme that if your site is still down, it will be back up …

  178. Suz Says:

    Fidget is down again… Anyone else?

  179. Jon Says:

    Mine:
    Download ‘Servers Alive’ and set it to check mediatemple’s homepage, or a customer’s site, like sofake.com. Keep it running and see how often it goes down. It’s normally a few times a day.

  180. Razorfang Says:

    My site was running a few minutes ago, now it’s down again.

  181. Beth Says:

    Can’t access dreambook to edit. Panel says I don’t have a guestbook!
    Humm, I can see it on my website….just can’t reach it:(

  182. Omm Rafiq Says:

    I cannot access the admin site for my list and no emails from it are going through. I hope you will have this problem solved soon. Thank you.
    Mrs. Sadiqa Abdul-Alim

  183. Omm Rafiq Says:

    When I try to access my site I get this message:
    Bug in Mailman version 2.1.6

    We’re sorry, we hit a bug!
    Please inform the webmaster for this site of this problem. Printing of traceback and other system information has been explicitly inhibited, but the webmaster can find this information in the Mailman error logs.

  184. Lee Says:

    Further to my previous entry, the Control Panel on my Dreambook is accesible now, but still does not work correctly. I am told there are 0 (zero) entries in the Dreambook at http://books.dreambook.com/westier/rehoming.html. Anyone who visits it will see that that is not true. Without having tested it, I suspect also that visitors cannot post an entry into the Dreambook - that’s what happened last time this occurred.

    So still lots of issues then…

    Doesn’t look like I’ll be hosting my web sites with Dreamhost either…

    Again.

  185. freerick Says:

    what is a sitation / did you make it up? Either way, it’s cool.

  186. Games Says:

    I’m actually probably more worried than Nick. I might not have been around when this actual data sag happened but I’m here now and it makes me think twice about whether I should be. Would guys please be more specific when you talk about these types of problems? Nick is right…you shouldn’t have a sag at the internal data center. There’s something seriously wrong there. And considering my poor, old computers and servers have their own lags to deal with, I’m not sure I can take you guys having them too. So if you wouldn’t mind, I would really super appreciate it if you would just start posting all of the details, whether they embarrass you and make you look bad or not. I have to know what’s going on on your end to keep things bright, shiny and lucid on my end. If I can’t do that, who knows what kind of trouble I, and a lot of other people might be in.

  187. Portrait artists Says:

    Are you referring to the Garland Building power failure? That is supposed to be an excellent place for data centers considering that Companies like iPowerWeb, Media Temple, BroadSpire, and even MySpace (now the most popular website in the whole US!) are in there. Sometimes I’m thinking that it was possible that this building will run out of power considering the companies it houses. By the way, what’s the assurance that the engineers and the staff are giving to these companies? Will the owner of the building raise their rental fee in case there’s a need to invest on more UPS or generators?

  188. Omm Rafiq Says:

    My monthly automated messages haven not been sent for many months now; when changing a password, members do not get the email confirmation; the welcome message is not sent nor the auto message when someone unsubscribes. I have enabled these messages from the admin site, but they are not being sent.

    Omm Rafiq

  189. Satilik daire Says:

    Turkish Properties villas, houses and apartments for sale. Whatever you are looking for, we will do our best to try and find it for you,Erdogdu Construction & Real Estate company can help you for all your needs in real estate in Istanbul - Turkey for residential and commercial properties,Kusadasi Real Estate And Property For Sale , Either a Ladies Beach luxury villa, an apartment in Kusadasi center, a holiday villa in Long beach, a village house in Kusadasi , a property in Pamukkale ,

  190. kale kapi Says:

    Satilik good text nice thank you

  191. Bahamut Says:

    Thanks you dreamhost for the great work done. Dreamhost Rocks!

  192. araba Says:

    for residential and commercial properties,Kusadasi Real Estate And Property For Sale , Either a Ladies Beach luxury villa, an

  193. radyo dinle Says:

    No MySQL connection here either.
    Why?

  194. NBA Says:

    I cant access the admin site for my list and no emails from it are going through. I hope you will have this problem solved soon…

  195. istanbul kobi Says:

    istanbulkobi…

    thanks…

Leave a Reply

Comments posted here may not be viewed by DreamHost staff at all. This is not a way to contact DreamHost.