File Server Issue

A file server is having an unknown issue at this time. We are working to resolve this issue, and will update as soon as we know more.

Servers that are possibly affected are:

7up amp aquafina arizona barqs bawls boba brisk cactuscooler calpico cappuccino caprisun chai clamato codered coffee coke crush crystallight culligan dads dasani dietrite drpepper eggnog endless espresso evian fanta fetish1 fiji frappe fresca fuze gatorade geyser gingerale hansens hi-c hiball horchata ibc inko izze jolt koolaid lipton martinellis milk minutemaid monster mountaindew mrpibb mug musclemilk nehi nesbitt nestea niagara odwalla oj optimizer orangebang ovaltine pellegrino pepsi perrier pom powerade propel punch redbull refresco riptide rockstar rootbeer schweppes seagull seltzer shasta silk simpledollar slice slim sly smoothie snapple sobe sparkletts sprite squirt stewarts sunkist sunnyd tab tampico tang tea tejava tizer tonic tropicana v8 voss welchs wishserver worldtown yoohoo

We apologize for the inconvenience.

Update: We have found the cause of the outage and have resolved it. There appears to be an inefficiency with this type of file server regarding how it treats backups. We will be investigating this issue further and will be preventing it from happening again.

.

87 Responses to “File Server Issue”

  1. Tim Says:

    Rockstar is indeed affected.
    The world needs to read about corporate social responsibility and I need my site to be running.

    Thanks

  2. goatse Says:

    Just when people where being mass goats’ed!
    Don’t you have no heart ? ;)

  3. Bruno de Oliveira Says:

    So this could be the cause my sites are so slow ?
    Cause every ‘ls’ command on console it takes about 15 seconds to list on a single 4 files directory.
    there’s some connection problem too ?
    Cause these days the bandwidth of the server is very low!

    hope it back soon
    hugs,

  4. Bruno de Oliveira Says:

    I mean, this issue could be exist more time before….
    Cause i’ve been notice that file listing,creating,deleting is a little bit slow these weeks

  5. Bruno de Oliveira Says:

    Sunnyd-Doo Where are you? =/

  6. gio Says:

    Looks like my Web Directory is lucky! :)

  7. CoffeeDaze Says:

    My site has been slow to unresponsive for over a week now. I really wish they would fix these issues. It’s pointless to have a site that only runs once in a while.

  8. On Says:

    It does look like someone hacked the server.
    Are we expecting mass defacement?

    On

  9. watson Says:

    i have been with dreamhost since one year this is the first time i had noticed that my site’s are down. hope the will be up soon

  10. John Says:

    “On” - what evidence are you offering for “the server” being hacked? The file server? I would be shocked if OnTap had been remotely exploited in a meaningful way. One of the many clients of the file server listed in the list above? I’m very interested in hearing evidence for this assertion.

  11. Laurens Says:

    Well, I’m at nesbitt, and I don’t appear to have any trouble (yet) - fingers crossed…

  12. Amar Says:

    pellegrino *is* down. So is my email.

    … and for the record - I hate gio and laurens for being lucky :-)

  13. Kazuya_UK Says:

    I’m on tea, and both the sites I run are down… hope it won’t be too long before it’s fixed!

  14. Douglas Says:

    I have blogs on tea and slice and in these blogs on both servers are down! :(

  15. Amar Says:

    btw everyone - I use pingdom [ http://www.pingdom.com ] to check my downtime.

    This is the downtime report so far [times are in IST - it is 19:48 here]
    # From: To: Downtime
    1 18:35:03 19:15:03 40m 0s
    2 19:40:02 19:45:03 5m 1s

    Uptime for September was 99.41% (4h 9m of downtime).

    Ciao.

  16. dreamhost user Says:

    @Amar: I used pingdom too for a while. PIngdom reports much more downtime than there actually is. I have several VPS and a business hosting package and all of those have virtually 100% uptime with other uptime services. But according to Pingdom they are down for few seconds or minutes every day, even though I’m logged in via SSH and everything is fine. I stopped using Pingdom.
    Of everything monitored, DH still has the most downtime, there is no month without downtimes. My site was down three times the last week and every downtime lasted longer than an hour.

  17. Prav Says:

    sunny-d? ain’t sunny here! Second time within past 2 weeks - do we know when it will come back up?

  18. Bruno de Oliveira Says:

    Really, Sunnyd is on vacation I guess cause its no online yet!

  19. Shoji Says:

    We are on 7up server and I cannot access to the server yet.

  20. Jonathan Says:

    “gingerale” still down, fyi

  21. brasscrest Says:

    @Jonathan - the site you linked in your post is giving a 500 error - since DH has marked the problem “resolved”, you should put in a support request - same applies for everyone else who is still having problems. Looks to me like they may have prematurely “resolved” the issue - a flood of support requests might make them realize that things are not as they should be.

    Is anyone else disturbed by the update to the original post - “this type of server has an inefficiency with backups”? This is the first time they’ve tried to back up this filer? I find that hard to believe.

  22. Jay Says:

    My site is on culligan and for the last one week it has become so slow that most of the time either it unable to connect or take around 30 seconds to open a simple static page. webmail, ssh and ftp has become 20 times slower. I have sent e-mail to support multiple times, and some time got response saying it will be fixed…it is hard to run the business if downtime or slowness remain for such a long time

  23. mike Says:

    I have had many difficulties with DH for the past week, slow site, too much traffic, so they throttled my domains! That really upset me since I am a paying customer and see no point in having a site that accepts only a limited number of users,and is down over 2 times a week.

  24. John Says:

    Monster is still not responding, none of my sites are currently working at least :(

    I assume this “filer” issue probably has something to do with the emails too? Or is it just that all my DH services are broken today (as they were yesterday… and sunday)

  25. Gury Says:

    Is it 10th birthday of DH? so is downtime a gift?

  26. Umar Says:

    My site is on culligan and for the last one week it has become so slow that most of the time either it unable to connect or take around 30 seconds to open a simple static page. webmail, ssh and ftp has become 20 times slower. I have sent e-mail to support multiple times, and some time got response saying it will be fixed…it is hard to run the business if downtime or slowness remain for such a long time

    I am in the same boat as you Jay - culligan here too. Today has been a nightmare, trying to work on a few sites and they have been going on and off - on and off - on and off

    I sent a pretty pissed off email letter. If it happens once ok - it has been off and on the whole day maybe 5 times now

  27. Brain Hsu Says:

    I’m also on culligan, and its unix load seems abnormally high and made the website/FTP/ssh so slow after this file server issue solved.

    [culligan]$ uptime
    08:38:33 up 14 min, 4 users, load average: 198.81, 132.26, 62.52
    [culligan]$ uptime
    08:44:04 up 20 min, 4 users, load average: 219.33, 183.67, 105.98

    Does anybody know what happened ?

  28. Umar Says:

    My message to DH - Hello,

    No offence guys, I sent a complaint email last week too - again my site isn’t responding but your service is seriously becoming a piss take now.
    It comes on - it goes off - it comes on…
    On the IPforums, you guys have been getting some seriously neg. feedback and
    I really think you have got to sort yourselves out. I really am considering
    just pulling out of DH now with other guys I recommend here. It is become a
    joke now

    Their reply -

    It looks like the monster server was just rebooted about 40 mins ago,
    there appears to be a continued problem with it’s connections. Our admins
    are looking into it and will get it fixed as soon as they find the cause,
    also Umar, you make it sound like we’re doing this on purpose… trust
    us, we’re not, c’mon man do you really think we want unhappy customers?
    do you really think we want to not get these issues fixed? we are working
    on this issue but it’s a lot harder them just flipping a switch or
    installing an update, theres a huge network and with the network changes
    we are making theres bound to be issues, Sorry that you being effected.

    Thanks!

  29. Nate Says:

    I’m on culligan as well. Same issues here. On the whole the experience has been extremely frustrating and doesn’t speak well for Dreamhost’s service. This isn’t the first time these servers and their network connections, power connections or just about everything else has been flaky.

  30. dreamhost user Says:

    this is a nice load:

    11:54:56 up 32 days, 1:31, 6 users, load average: 1023.23, 977.69, 852.53

  31. Bruno de Oliveira Says:

    GUYS OF DREAMHOST A TIP

    When reboot you could just send a “wall” msg on console, so we dont get unwarned

    =/

  32. Robert Says:

    Does anybody know of Dreamhost uses LVS in their cluster setup or how that works?

  33. andres Says:

    that’s why I only drink “water”

  34. TorridArt Says:

    I have had my share of downtime on nestea. But overall, based on what I read on dreamhoststatus, I feel that we have been fairly lucky. Our business plan was to keep this site here for one year, to get the business going, then move to a dedicated server. With that plan, DH has been a fine startup host with an acceptable cost/performance ratio. I have sites on other hosts who are awesome by comparison. But my site on DH has nudity, and not that many really good hosts allow that.

    IMO, even though DH is going through a difficult expansion, it occupies a valuable place in today’s market.

  35. Shoji Says:

    The server issue has not resolved, as far as 7up server is concerned. Our website have been down for at least an hour.

    I don’t understand why this issue is tagged as “resolved.”

  36. Jay Says:

    Even culligan is still slow/unreachable. So I also do not know why this issue has been tagged as “resolved”

  37. Amar Says:

    @dreamhost user

    Any monitoring service you recommend? You’re clearly more clued up than me !

  38. Santiago Says:

    tab server still out of service, the issue is not resolved!!!

  39. Eileen Says:

    Still having issues with sites on Brisk. Is there a tie in to forwarded domains as well?

  40. Chris Says:

    Still getting a lot of general slowness on Dr. Pepper

  41. RB Says:

    TAB still wacky… :-)

  42. RB Says:

    TAB kickin’ butt now - Thx

  43. VOO Says:

    The Lord thinks the idea of naming servers after brands only perpetuates our issues of corporate dependence and culture. He would suggest naming them after common, natural objects such as dirt, shroom, seashell, or commonly found but non-branded objects would be fine, such as cupholder, curbfeeler, mexicandashboardballs and so on.

  44. FX Says:

    Sunnyd still down!

    Actually it has been in/out for several months. Not always responsive.

  45. Mike Says:

    koolaid is still broken. can’t get onto webmail. can’t pickup e-mail using a pop3 client either. DH suggested to purge my trash folder which supposedly has 1000 messages in it (don’t know why the messages are collecting!)… but I can’t even delete the messages in there because my webmail drops connection when I try to do anything IF I can get logged into it. Sucks.

  46. leaving Says:

    Hey I got the same canned reply as the guy above. Thats hilarious! Speaking of hilarious, my site has been down for nearly all week.

    My message to DH:

    > Down again, twice in one day. Not even a system status message anywhere.
    > This server should be called Roller Coaster, c’mon this is getting funny.

    Your telling us, it looks like the monster server was just rebooted about
    30 mins ago, there appears to be a continued problem with it’s
    connections. Our admins are looking into it and will get it fixed as soon
    as they find the cause, also Adrien, you make it sound like we’re doing
    this on purpose… c’mon man do you really think we want unhappy
    customers? do you really think we want to not get these issues fixed? we
    are working on this issue but its a lot harder them just flipping a
    switch or installing an update, theres a huge network and with the
    network changes we are making theres bound to be issues, Sorry that you
    being effected.

    Anyway, i’m in the process of moving to bluehost. Great package and features, with a 99.9% uptime money back guarantee. That should be like music to your ears if you’re with DH right now. Like someone above me has said, whats the point of having a website if its only up once in a while? This service is crap.

    My only problem is actually getting my files off of DH servers so I can transfer sites. DH won’t stay up long enough for me download anything.

  47. Jono Says:

    How many servers is that? I cant even count.

  48. Why Says:

    Leaving - It’s a shame that two hours after your “Leaving” message your site looks great.

    “Down a week” - when you peddling autodialers? You should be down forever, but if you’re paying dreamhost I won’t put you out of your misery. Now, bluehost might not be as understanding of your content - note that they are surprisingly against “blue” sites. ( Look it up or ask your Mom if you don’t know what “blue” as an adjective means - and it’s not “sad” )

    P.S. You’re the reason that no machine I set up has an enabled dial up modem on it.

  49. Why Says:

    VOO - Great idea for naming the next cluster.

    I can see it now… toiletbrush, doily, guestsoap, guesttowel…

  50. VOO Says:

    Why Says:

    “Down a week - when you peddling autodialers? You should be down forever”

    Why, only moments ago I was here ready to post about that. I wanted to say something like “You are a piece of shit and I hope The Lord takes your sites down forever… it is your kind of crap that makes the web suck sometimes”, but I decided not to. I am really glad you did it for me, thank you very much… it saved me from having to cross boundaries of negativity that I generally try to avoid!

    Also, you are on a pretty good server naming roll yourself there, Why! To that I would add, mildew, funkyfunkbuildup, emptytoiletpaperroll, grannysshowercap and stuff like that!

  51. leaving Says:

    Ha you guys are all morons. DH couldn’t host that site for a minute. I’m not as stupid as you seem to be.

    Tell me this, what is the point of including a website on a post when it’s never up in the first place? This place is a joke, only a little more laughable than the religious nut.

  52. VOO Says:

    I’m not as dumb as you think either… I had ran the site you linked through Domain Tools beforehand and knew it wasn’t hosted here. I just think you’re a piece of shit for linking and promoting it no matter where it is hosted, and would genuinely love for The Universe to smite it permanently. Thanks for adding to the bad in the world rather than the good, fucknut.

  53. leaving Says:

    Ha, see you’re just a normal guy after-all. That was easy.

    Shouldn’t you have clocked out yet? Or does employee-owned mean that you guys all live at your hosting facility?

  54. VOO Says:

    “Ha, see you’re just a normal guy after-all. That was easy.”

    You sir, are obviously mistaken.

    “Shouldn’t you have clocked out yet? Or does employee-owned mean that you guys all live at your hosting facility?”

    Who are you talkin to dipshit… I work for no-one but The Lord, and the only times on my clock are birth and death. Dreamhost works for ME, at the dirt cheap rate of $119.40 per year.

    All to easy… to quote Darth Vader.

  55. Jay Says:

    Lord has mercy….Culligan is still unresponsive….

  56. Paul Says:

    My sites on gingerale are down.

  57. ozgu Says:

    mine http://www.newoxxo.com up

  58. Jay Says:

    Does someone have website on culligan?? and is your site responsive? I have mailed multiple times to DH but they said there is something wrong in my network as everything looks good on their side on culligan.

  59. John Says:

    This is just terrible, WHAT IS GOING ON DH! I would use the support system but i’m getting no replies, not even an acknoledgement email after 12 hours.

    Monster is still spitting out pages at a rate of one a minute, even slower sometimes and i’ve had NO email access for over 2 days!! How can you possibly say this issue is resolved? This is nuts.

    What’s more the fancy new “PS” product, I have been told will STILL SUFFER due to filer problems, which in my opinion makes it not worth a cent more than the normal shared package.

    PLEASE dh, all we ask for is reliable (I know i’m pushing it now) but at least working email and web access. I would even settle for “intermittant” IMAP or webmail access ;)

    Everyone who is still suffering speak up! DEMAND A HARDWARE REPLACEMENT FOR THIS FILER! please. This issue is NOT resolved and verging on Critical severity.

  60. FX Says:

    I’m with John, this is well beyond any tolerance.

    What’s the official way for demanding a hardware replacement? Support hasn’t answer my mails.

  61. Alejandro Says:

    I also agree with John.

  62. John Says:

    Everything has all gone down again. It would seem I can’t even jump ship to another host because now I can’t even download my site backups.

    I did eventually get a support response tho which summed up as “we’re looking in to it”

  63. Sheff Says:

    It’s Saturday morning and I’m still down. What’s the deal? I had enough uptime last night to post, but that was about it.

  64. flywheel Says:

    Dreamhost has fugged up my email for a couple of days and they’ve been amazingly unresponsive about it. So last night I googled “Dreamhost sucks.” It got 14000 hits, exceeding any other ISP name or corporation name -sucks by a factor of 100 or more.

  65. Relatively New Says:

    I’m on Culligan and running a website that uses phpBB board and I currently can’t access that and have had intermittent down time for the past week. I’ve been told its been a high server load issue that they’ve been trying to fix. They offered to move me as an accomodation for the time being to help my uptime. I took them up on the offer so long as it won’t be time consuming for me.

    This downtime has been a real bummer, but support has always been quick to reply despite the recent bout of cattiness in my requests. Not bad for 6.99 support wise. Would like to see an improvement on uptime though. I’m relatively new to the game actually administrating a website so I really don’t know what the realistic expectations are for uptime with a shared hosting plan. Especially one willing to take on an mysql db of more than a gig.

  66. AJ Says:

    Well, I did not even notice this.

    Looks like things were not too bad on server milk.

  67. Relatively New Says:

    Well the dreamhost support guys moved me to a new server and we’re running great. Thanks guys.

  68. matt Says:

    @ flywheel

    you have a confound: number of users.

    consider that the number of “juryriggeduphosting sucks” hits is six — but that’s because they host like 30 people. your measure, however, ignores the fact that 20% of their customers hate them enough to post that they suck.

    baselines, dude.

  69. Flywheel Says:

    For matt

    Here’s what I just checked on Google

    1and1 sucks - 132
    Hostway sucks - 171
    verio sucks - 194
    Hostmonster sucks - 266
    network solutions sucks - 713
    godaddy sucks - 847
    Dreamhost sucks - 14,300 (up 300 in less than a day)

    All your baseline are us.

    and, FYI

    IBM sucks - 3,410
    Yahoo sucks - 29,000
    HP sucks - 38,000
    Google sucks - 40,000
    Microsoft sucks - 98,700

  70. Relatively New Says:

    funny my search hits are radically different:

    1and1 sucks - 42,900
    hostway sucks - 9,430
    verio sucks - 32,300
    Hostmonster sucks - 806
    network solutions sucks - 1,530,000
    godaddy sucks - 357,000
    Dreamhost sucks - 514,000

    I guess we can conclude that network solutions is statistically three times suckier a host…

    What do we see in google’s tea leaves for November ‘08…

    Rudy Giuliani for president - 2,270,000
    John McCain for president - 2,190,000
    Barack Obama for president - 2,250,000
    Hillary Clinton for president - 12,100,000

  71. Jack Says:

    Yoohoo’s still having problems:
    19:12:22 up 16:24, 3 users, load average: 857.58, 1015.33, 491.54

  72. VOO Says:

    Relatively New Says:

    “Hillary Clinton for president - 12,100,000″

    May The Lord help us all…

    Ron Paul for president - 6,440,000 … not too shabby.

  73. Flywheel Says:

    Yes, I was kind of surprised that network solutions came out so low in my search. It’s got so many more reasons to suck, after all, and it’s been doing so for quite a long time. FWIW, I ran my searches with quotes around the strings.

    A DH tech wrote me Saturday night with a workaround to my issue. Apparently, just one guy actually had a clue about what was going on. It turns out he wasn’t even at work on the day that the DH folks assured me that a “team” was “investigating” my issue.

    So here’s another reason dreamhost sucks. If mail that comes through DH is being blocked by ISPs (including some real big ones like Bellsouth and Earthlink), shouldn’t they let their customers know? They don’t think so. Instead, we’re supposed to find out after the fact, one at a time, after important mail has disappeared. DH isn’t looking out for your interests. The tech’s recommendation was to forward to gmail (I found a different workaround since I need a POP solution), but what will happen if gmail starts blocking DH as well? SOL.

  74. FX Says:

    The load on servers is still sky-high. My site takes around 30-40 seconds to output a php/mysql result.

    Where are all you guys moving?

  75. FX Says:

    (oh, it looks like my comment is being treated as spam — duplicate comment msg)

    The load on servers is still sky-high. My site takes around 30-40 seconds to output a php/mysql result.

    Where are all you guys moving?

  76. ahmed Says:

    server load high my site is very slow

  77. Cuauhtémoc Rojas Says:

    I have two sites in culligan. both of them work at very short periods. =|

  78. Jacob G Says:

    Mine too, has been for days, and I haven’t received any response from DH since Oct. 4. I am on monster.

  79. FX Says:

    My site was on sunnyd, then I was offered to move to chai last friday (supposedly better cpu average use).

    Nothing, nada.

  80. H-BES Says:

    [QUOTE]
    I have two sites in culligan. both of them work at very short periods. =|
    [/QUOTE]

    Same problem for me, on 10 websites in the last 6 days! :(

    Saluti
    BES

  81. bofh Says:

    My website is on Yoohoo. There is something wrong with it (or related to it) since 2 hours (well, to be honest, since I am using Dreamhost): lots of 503 errors , site unreachable at all…. : I don’t think that it’s normal, even for a 6 $ / month web hosting. PLEASE : give us 10 GB storage, 1 TB Monthly Bandwidth but ->99.9 uptime.

  82. John Says:

    Monster is still playing, and apart from a brief period over the weekend I still have no email access. I have requested that my account be moved but as yet no response. The last few support emails have taken ages to be responded to.

    Come on Dreamhost, if your not going to replace the hardware at least give us an update about what you ARE doing (if anything)…

    Or if you just tell us what s going on that would be good, or just change the blog status of this problem back to “open” at least that is some recognition that you are still doing something.

  83. Sheff Says:

    Down again. Tuesday 8:50. This is getting really bad.

  84. FX Says:

    Same with me, 2 hours down and counting (server = Chai). I only get error 500 each time.

    Come on, this is crazy.

  85. sasho Says:

    culligan is having much problems too, but i’m not sure if this is the problem since my static (non mysql) pages are working alright… any ideas ???

    but i must say this is the first real big problem i have since i joined dh… all the best in solving it, guys…

  86. wow gold Says:

    http://maineindymedia.org/newswire/display/6043/index.php

  87. Guaranteed SEO Says:

    I’m waiting for you other articles

Leave a Reply

Comments posted here may not be viewed by DreamHost staff at all. This is not a way to contact DreamHost.