Filer problems with blingy cluster. |
We are currently having a problem with a filer which has crashed and is recovering at this time. While this is happening some customers in the blingy cluster will experience problems loading their websites/email. We apologize for the outage and service is expected to return to normal as soon as the filer recovers.
UPDATE 3:01:AM PDT
The filer has finished recovering and all services are back up and running. We are working with the filer vendor to find the source of the crash to prevent any further outages.
Update 24/03/08 10am: We’re working on the file server again to alleviate the load that’s causing problems with web, mail and mysql services. Sorry about that.
Update 27/03/08: We are doing emergency data moves to quell the stem of problems recently caused by your file server. During these moves, your data may be inaccessible. We are moving as we can off as fast as possible. Very sorry about the continued inconvenience!
Update 27/03/08 This series of moves has finished. We are going to keep an eye on things to see how much it helped and may have to do more moves tonight and tomorrow morning to get everything working smoothly again. This post will be updated with more information as soon as possible.
Update 29/03/08
We are continuing to move data off of the problematic file server but it’s a bit of a catch-22 because customers on that machine are continuing to add data at a very high rate. It filled up this morning for a while causing device full errors as well as mail problems and issues serving websites (when these fill up it causes problems across the board). To explain in more detail, when we move data it does not immediately disappear (there is a ’snapshot’ created of the old data that remains in case there was a problem with the move - that ensures that we do not lose customer data but until the admin team can check the move to make sure it went through properly we cannot delete the old data). We just did some of that and have some breathing room again and of course more moves are still in progress but we are asking customer on this cluster to help us by holding up on any non-essential uploads of data for the next couple of days. As soon as we have a significant portion of the data removed the problematic file server will begin to function properly (and additional moves will go much more quickly and smoothly) but right now we’re having trouble moving data more quickly than it’s being added by people. If everyone could please limit uploads to absolutely essential data until we reach the turning point where everything is working this will be resolved much more quickly (in other words if for example you are setting up a repository of large files you’ll actually be better off waiting a couple of days and getting the all clear from us on this issue because you’ll be able to access that data reliably instead of cramming it on there now and slowing the recovery process).
In the meantime we’ll be doing everything we can to safely and quickly move data off and get things back to normal.
Added information: Some of the people recently moved to the new file server are seeing errors because the data did not get set up completely (loading the site will work but just show an empty index). The admin team has been running an rsync that will fully restore all data and should hopefully finish by 9 PM PST - once that is finished all site and email data will be available for those users.
Update 30/03/08
We’re still racing to keep ahead of new data being added so any help we can get on that front is greatly appreciated (we’re still asking for customers to limit uploads as much as possible to speed up the recovery process). Some customers who are being moved are seeing blank directories still but those are due to moves in progress and the data will be fully restored when those complete.
Update April 1, 2008
We seem to be ahead of the curve right now, we are moving data off the primary volume and on to a secondary one faster than new data is being uploaded. The volume hasn’t filled up completely in a few days. We are working closely with the technical support team to see how we can speed up the process further. Thank you for your patience.
Update, April 1, 2008
I apologize for the late update but we’ve been going over our options (while moving data of course). While we’re not seeing any real relief in terms of data uploads we do have some very large moves that are almost complete. Once those finish we can start deleting the data (for example one is around a half TB or around 500 GB which will be 4-5% of the total but it’s going to take until around Friday to delete it all, so we’re dealing with a ton of data). Tomorrow’s update should be earlier in the day and hopefully we’ll have some progress to reports from the large moves being complete.
Update, April 3, 2008
The data moves to other file servers has been running constantly, but last night and this morning some complications happened with the moves, requiring admin attention. To clear up some space there had to be a short interruption in file serving, this is now finished, space is available and the moves are continuing. The admins are fixing up the last of the web servers which were having issues after file serving was restored. Our apologies again for the continued issues.
Update, April 4, 2008
Today has been a pretty good day of progress. We were able to complete even more moves and free up more data from the file server. Moves have been going quicker and stability is dramatically improving. Monitoring of the servers and email in the blingy cluster today have shown a significant decrease in problems. Issues do still exist but the problem is noticeably getting better. We are also pleased to note that we have more storage that will be coming early next week. We believe that this will go a long way in helping us fix this major problem.
Update, April 4, 2008
Things are continuing to improve today - when I got in I was pleased to see that we had held firm and even gained a percent (the effected file server was down to 95% which is as low as I have seen it in the last week and since I have been working it has dropped to 94%). Performance should improve as we gain ground (this will speed up moving data off as well). This progress, along with the added storage space we are expecting early next week should hopefully allow us to restore service for our customers to normal.
5:45 PM PST : The moves we started just a while ago seem to be causing server problems, we’re looking into it and should have it resolved shortly (they were run just like the ones that had completed so we have to determine why these specifically caused an issue). Update: this resolved itself before we could detect the cause but we’re monitoring the situation to ensure that it’s not a recurring issue (we have no indication that it will be).
Update, April 8, 2008
Please see our other posting for details on the work we did on the effected file server:
http://www.dreamhoststatus.com/2008/04/06/30-min-blingy-downtime-tonight/
We are also continuing to offload data and are making good progress (it’s never as fast as we would like it to be of course). There’s excellent detail here in case you missed it:
http://blog.dreamhost.com/2008/04/07/another-anatomy/
which chronicles the situation and fills you in pretty much up to today. We’re seeing the data dip to 90% so we’re hoping to have it down in the 80’s by the end of the week (every percent we gain helps and as performance improves we can speed up the rate of moving but we’re still looking to hit critical mass where you get the proper level of performance).
Update, April 9, 2008
As we had hoped progress is speeding up as we free up more space - while the file server is showing 95% usage, around 11% of that is data that has already been moved and is no longer in use. Due to a software issue we haven’t been able to remove it yet (the admin team is working on the best way to execute that), but once that is gone we should be around 85% usage which is another large step forward.
In terms of effect, I have already seen improvement in site function for many customers as well as greatly increased speed in moving chunks of data off as well as receiving reports that mail is functioning quite a bit better. That said this issue remains at the High severity rating and in unresolved status as we have not reached a normal level of service. I can’t stress enough how sorry I am that our customers have had to put up with this but I thank those of you who have stuck with us (check the newsletter for details on what we’re doing for Blingy customers) and look forward to providing you with the level of service we strive for at DreamHost.
Update, April 9th, 2008 21:59 PDT
Unfortunately, we need to unmount the volume again to kill these snapshots before they leave us with 0 bytes of free space. In 2 hours (midnight) I will be taking the problematic volume offline to delete the phantom snapshots. Total downtime will be between 10 and 30 minutes. Sorry for the short notice and additional outage!
Update, April 10, 2008
Well the snapshot mentioned yesterday is gone and we’re actually at 83% used today which is below where we were hoping to see marked improvement (85%). Of course we’re still moving data off (which increases the usage on the file server) so that won’t fully translate to customer usage improvement but it should be quite a bit better and keep improving until we stop moving data.
Update, April 14, 2008
Okay, we’re finally getting ready to mark this as resolved.. things have seemed pretty much okay for a while now. But, just to be sure, we’re dropping the severity to Medium for now and leaving it as unresolved.
Update, April 17, 2008
We’re still hearing some reports of site slowness - we were able to resolve an issue causing high loads today which should help but we’re not going to consider this resolved until everyone is receiving good service.
| Severity: | Medium | Resolved: | No |
March 19th, 2008 at 11:44 pm
god!!!
How usually thus??
Please quick Repair~~
March 19th, 2008 at 11:44 pm
This issue of the filer not working properly needs to be solved!
March 19th, 2008 at 11:48 pm
OH my GOD!!
I am going to move my websites to Bluehost.
Dreamhost is so SUCK!
March 19th, 2008 at 11:52 pm
Oh.. Sh*t !!!
I’ts a long NighmareHost
March 19th, 2008 at 11:52 pm
blingy cluster. is Ill-starred!!!
March 19th, 2008 at 11:52 pm
Hey Dreamhost, I have an idea. TRY NOT TO OVER LOAD THE SERVERS and maybe you WOULDN’T have this problem.
March 19th, 2008 at 11:54 pm
Bingly.. Bingly and Bingly..
Only Bingly. Look at the list of dreamhost status msgs. Its always about bingly cluster. Those of you who are on Bingly were born with a f***ed up fate. Go wherever you want, your bad luck will follow you. Its not our fault. You may try other hosts and comeback to us
March 19th, 2008 at 11:56 pm
“Bingly.. Bingly and Bingly..
Only Bingly. Look at the list of dreamhost status msgs. Its always about bingly cluster. …”
Therefore say that it is ill-starred
March 20th, 2008 at 12:04 am
There’s no such thing as Bingly :p its Blingy.
This is starting to get very annoying though…
March 20th, 2008 at 12:05 am
Hi Jinlong Feng
Our sites are not working..
so lets have a chat here.
When did you start hosting on DH? I joined on february, and had been facing so much of problem since then. Previously I was on a free host 110mb.com. I am ashamed to say that my illfate drew me to DH. The free host 110mb.com is atleast 5 times faster than DH. Now I am thinking of shifting over to Hostgator. Anyone ant experience with them?
Btw since how long are you here? When did this bingly cluster problems started showing up?
March 20th, 2008 at 12:07 am
I have been here since Janurary and it’s been a problem since then.
March 20th, 2008 at 12:09 am
I am thinking about going with ipowerweb.com, I can get it for like $71.40 and it cant be worse than this.
March 20th, 2008 at 12:10 am
blingy
I’ve an account on deblume (not on blingy), it was ok and I created another account (without - $97) to have dedicated VPS for some important domains. And yes, you guess it, the latter is on fox (blingy)
Not good time.
March 20th, 2008 at 12:10 am
@Ken
ohh yeah..
Thanks for correcting me. We should know our enemies names corectly
Blingy.. u suck
March 20th, 2008 at 12:11 am
How do you tell exactly which cluster you are on?
March 20th, 2008 at 12:14 am
Skillz: in webpanel, click on “account status” at top right, it’s on email server. Another way is to ssh, then type “df”, you’ll see your filer.
March 20th, 2008 at 12:14 am
@skillz
go to http://panel.dreamhost.com
on the right top corner there is a dropdown menu: account status
Your email server is most probably your cluster’s name
March 20th, 2008 at 12:17 am
@jcisio
How is/was the performance on deblume?
Any difference with the page load speed?
I guess the mysql server phill is causing lots of problem. My HTML pages loads very fast even on blingy. But the PHP pages using MySql loads very slow.
March 20th, 2008 at 12:18 am
I have full faith that this will be resolved.
March 20th, 2008 at 12:18 am
omg..
March 20th, 2008 at 12:23 am
hi~~ suckinghost.com
my is January buy DH hosting~~~
sites are not working.. me want go Sleeping~
dream~ Just ~~~
bye~~
March 20th, 2008 at 12:23 am
@skh.com: it was and is ok, even sometimes it’s slow. But rarely downtime, now deblume is up for 39 days. There’re some MySQL servers, I don’t remember if I’m on phil or not, but this site http://4u.jcisio.com/ is now running very fast though it has a database of about 200-300 MB.
March 20th, 2008 at 12:25 am
Oh I see, thanks guys. Would be much easier if the crap wasn’t so slow. Where can I tell which MySQL server I am on?
March 20th, 2008 at 12:28 am
I also love how the Severity of this is set at “Low” yet, my site(s) are taking in excess of over 200 seconds to load a single php page (phpbb forum at that) but it’s ok, the severity is “low”; no big deal, go have a donut and drink some coffee, we’ll get to it in a little while.
March 20th, 2008 at 12:32 am
does anyone have any experience with hostmonster? I think i might try switching to that one soon.
March 20th, 2008 at 12:33 am
@Skills
Same as checking what cluster you are on. And you’re lucky, my site is not loading at all.
March 20th, 2008 at 12:35 am
not again!!
March 20th, 2008 at 12:37 am
DH SUCKS!!
I am on janky and same problem with me..
Oh boy blingy people are “privileged” people on DH it seems!
BTW how about shifting to $20 slicehost…good option guys?
March 20th, 2008 at 12:40 am
This is bullshit… I’ve been a member since January and blingy has been nothing but problems for the last two months. Is there a way to switch clusters? Seriously… I hate downtime as much as the next guy. I don’t run anything critical (so backup mirrors aren’t crucial), it’s just annoying to not get what I paid for.
Load times of 380+ seconds should NEVER happen, EVER.
March 20th, 2008 at 12:40 am
I’m considering getting MediaTemple, hearing good things about them.
March 20th, 2008 at 12:41 am
Using the SSH method, or using the panel.dreamhost.com method? My site wasn’t loading at all for a minute, but now it does.
This is how long one page load just took
[ Time: 70.4274s - Memory: 5654 K ]
March 20th, 2008 at 12:43 am
Ah I am on ryoohki mysql server.
March 20th, 2008 at 12:43 am
I’m a patient man, but these issues with blingy are definitely testing that.
March 20th, 2008 at 12:46 am
DreamHost sucks!!! My site has been down for a long time and I am losing a lot of money. DreamHost better pay me !
March 20th, 2008 at 12:48 am
I’m rapidly losing confidence in Dreamhost. Liked them at first, but the number of disruptions of various aspects of my service in the last month has been over the top.
March 20th, 2008 at 12:53 am
I can’t belive why something such this takes hours to repair.
March 20th, 2008 at 12:53 am
@jcisio
Your site: http://4u.jcisio.com is running very fast. If I get that kind of speed from DH.. I will never leave them. But are you hosting this site on dreamhost? I thought in future I may get lucky to have my sites running as fast as your http://4u.jcisio.com . So I did a IP lookup, and it looks like you have hosted it on 1and1 I checked it here: http://who.is/whois-com/ip-address/jcisio.com
Could you please tell me in which cluster/server/mysql server/ is that site hosted? That will help me decide whether to change my host or to stay with DH.
March 20th, 2008 at 12:55 am
I must say I’m very disappointed in DreamHost. My site has been effectively down for 5hrs, but support won’t even respond to my messages.
March 20th, 2008 at 12:56 am
Filer problem? I don’t even know what that means…
Here’s some info from the panel’s account tests:
2008-03-20 01:42:26
Item Type Result
http service for xxxxx.info error Your website does not appear in the Apache configuration file.
http service for yyyyy.info error Your website does not appear in the Apache configuration file.
http service for zzzzzz.org error Your website does not appear in the Apache configuration file.
shell service for user xxxxx on ratchet error Your home directory does not exist on your web server.
http service for xxxxxx.info warning Your website took longer than 5 seconds to respond.
http service for yyyyyy.info warning Your website took longer than 5 seconds to respond.
http service for zzzzzz.org warning Your website took longer than 5 seconds to respond.
ratchet notice Your web server has been rebooted in the last week.
ratchet notice Your web server did not respond to our tests.
Something is seriously wrong here… My sites are unavailable at the moment, and load times have been unacceptably high during the last week.
The other day, I ran top in the shell and the server load was >30…. And now I can’t even login to the shell: Connection closed by remote host…
March 20th, 2008 at 12:57 am
@aries
Hours?? HOURS? This has been going on for MONTHS now, not HOURS. If it was only HOURS, I wouldn’t mind as MUCH; but no. This has been a problem almost since day one for me, and I signed up at the beginning of the year, January.
If your new and this is the first “problem” you’ve experienced, your in for a long ride my friend.
March 20th, 2008 at 12:58 am
@skh.com: believe or not, 4u.jcisio.com is with dreamhost. I must use 1and1 nameserver because 1and1 sucks ! If you host a subdomain with them, you must use their NS.
And yes, I’m in France. So my new day begins with downtime
mac-p-hnguyen:~ hnguyen$ traceroute 4u.jcisio.com
traceroute to kienthucphothong.com (208.113.249.200), 64 hops max, 40 byte packets
1 nrouteur-4.enssat.fr (129.20.217.199) 1.486 ms 0.938 ms 1.075 ms
2 la-joyeuse-garde.ste.enssat.univ-rennes1.fr (129.20.231.66) 1.333 ms 1.390 ms 1.476 ms
3 10.0.0.254 (10.0.0.254) 4.398 ms 4.052 ms 3.720 ms
4 ri-pix525-cs7204-254.univ-rennes1.fr (129.20.253.254) 5.251 ms 5.188 ms 5.153 ms
5 rennes-g3-3-454.cssi.renater.fr (193.51.184.26) 6.163 ms 5.145 ms 5.260 ms
6 caen-pos1-0.cssi.renater.fr (193.51.180.17) 13.685 ms 14.105 ms 13.823 ms
7 rouen-pos1-0.cssi.renater.fr (193.51.180.22) 13.551 ms 13.355 ms 13.559 ms
8 nri-a-pos6-0.cssi.renater.fr (193.51.179.21) 13.788 ms 13.733 ms 12.683 ms
9 ge3-0-0-dcr2.par.cw.net (195.10.54.65) 14.122 ms 13.963 ms 15.309 ms
10 xe-11-1-0.xcr1.prp.cw.net (195.2.9.190) 19.592 ms xe-11-0-0.xcr1.prp.cw.net (195.2.9.186) 14.390 ms xe-11-1-0.xcr1.prp.cw.net (195.2.9.190) 14.823 ms
11 xe-11-0-0.xcr1.lnd.cw.net (195.2.9.193) 25.979 ms xe-11-1-0.xcr1.lnd.cw.net (195.2.9.197) 26.191 ms 26.860 ms
12 ge-11-0-0.xcr1.nyk.cw.net (195.2.25.18) 97.659 ms ge-11-1-0.xcr1.nyk.cw.net (195.2.25.22) 97.905 ms 98.738 ms
13 66.79.152.145 (66.79.152.145) 98.310 ms 99.365 ms 97.118 ms
14 cr2.wdc005.inappnet-70.cr2.nym009.internap.net (66.79.146.186) 105.324 ms 104.139 ms 105.242 ms
15 cr1-cr2.wdc005.internap.net (66.79.146.201) 104.222 ms 104.521 ms 104.271 ms
16 cr1.lax009.inappnet-4.cr1.wdc005.internap.net (66.79.146.142) 168.085 ms 166.453 ms 167.673 ms
17 core1.lax.inappnet-12.cr1.lax009.internap.net (66.79.149.130) 163.707 ms 168.854 ms 164.134 ms
18 border1.po1-bbnet1.ext1a.lax.pnap.net (216.52.255.31) 165.371 ms 165.436 ms 165.935 ms
19 newdream-1.border1.ext1a.lax.pnap.net (216.52.220.78) 164.871 ms 183.246 ms 165.297 ms
20 ip-66-33-201-66.dreamhost.com (66.33.201.66) 166.123 ms 175.972 ms 172.903 ms
21 basic-moon.deblume.dreamhost.com (208.113.249.200) 173.146 ms 165.537 ms 166.357 ms
March 20th, 2008 at 12:59 am
… and how can this have Severity: Low???
There are obiously a lot of people having problems, I doubt most of them write comments here.
March 20th, 2008 at 1:06 am
All my ads are disapproved because “Destination URL is not working”… this is BS… and how can tihs have a low severity????!!!!! WTF!!!??
March 20th, 2008 at 1:11 am
I will lose $1000 if this server and my site are not fully online within the hour. Come on, this is appalling.
March 20th, 2008 at 1:11 am
Wow … my bloody site always goes down when I need to FTP files, update the blog, etc.. Arrrrrrgghh!!!
March 20th, 2008 at 1:13 am
Yeah, ok, it’s down, but how the heck it can affect the site?
I mean, is it a file server cluster? If so, i can get it, but it says on account status it is voldo my web server
blingy il mail server
phil sql server
(How lucky uh?)
SO if blingy is my mail server, how come my website will not load?
Just a 403 Forbidden error.
Thanks
March 20th, 2008 at 1:14 am
@Jcisio
Thanks for the info dude,
I just checked 1and1.com I was wondering what they mean by the “Host Unlimited 1&1 Domains”. Is it that they don’t allow you to transfer your domains in case we buy a domain through them? And do you have any domain/subdomain hosted on 1and1? I am really pissed off with DH.. looking for a new host.
Just yesterday got an account from Hostgator at $0.01 using a coupon. I am trying them out.. Their server performance look decent. But the problem there is that if I host:
subdomain1.domain1.com, then subdomain1.domain2.com also points to the same subdomain1 folder. This is not a problem with DH.
March 20th, 2008 at 1:16 am
@Daniel
Host them in some other host for the time being, if you can. Use domain forwarding with a note that the domain will be back soon. May be that will help
March 20th, 2008 at 1:17 am
Your sql server is on blingy, and voldo must be in the blingy cluster. I’m on boo, and it’s down too
March 20th, 2008 at 1:19 am
I’m super sick of the outages! Ive been with dreamhost only a few months now…and over 80% of the time ive tried to view my own website…its been down.
I have the exact same issue as 46…and really…i think every cent dreamhost has taken off me has been a total waste.
Guys…fix the issues or i’ll be requesting a refund (and never sugesting you to any of our over 300+ clients).
Really really sick of this…its pathetic quality…
March 20th, 2008 at 1:20 am
@wtf
“SO if blingy is my mail server, how come my website will not load?”
Your sites are probably on blingy cluster. And your webserver voldo in the blingy cluster. Irrespective of whichever server your sites are hosted on, all of them use the same mail server blingy
March 20th, 2008 at 1:21 am
ok now it is loading, are yours too?
March 20th, 2008 at 1:21 am
@skh.com: no that site is not with 1and1. FYI I have a VPS package with 1and1 and host tools.jcisio.com there, but that’s a static site. I think you missed the point: If I want to host tools.jcisio.com so I must point jcisio.com NS entries to there nameserver (not just create a tools.jcisio.com A 1and1-ip-address they don’t accept that).
http://4u.jcisio.com is a big dynamic site (200-300 MB database) and run fast, and is on Dreamhost (look at traceroute).
March 20th, 2008 at 1:26 am
Hmm looks like this is a recurring problem, I also signed up in January I guess we all coped a bad cluster.
March 20th, 2008 at 1:31 am
How can I see if my servers are in the Blingy cluster? In my account info none of the servers is named Blingy (web: holt, mail: spunky, sql: scooby) but my mail isn’t working (all mail gets bounced).
March 20th, 2008 at 1:31 am
this is realy bad guys, im trying to work on one of my sites and i cant do it locally zzz…
March 20th, 2008 at 1:33 am
It’s up now
Good work support ^^
March 20th, 2008 at 1:34 am
@Jcisio
I understood what you said.. I was just asking for some other informations..
Except the ill fate of being on blingy, I am happy about everything else on DH. I just wanted to know on which cluster/server your http://4u.jcisio.com is hosted, so that I can request DH to shift my account from blingy to there, or some other cluster they think is good. If they are ready to do that, I will sing their glories and stay with them. Else I will leave. I am already trying elsewhere. Enough is enough with blingy cluster.
March 20th, 2008 at 2:02 am
Images still aren’t showing up on my site, and one just isn’t working at all
March 20th, 2008 at 2:11 am
my site still isnt working at all…
March 20th, 2008 at 2:13 am
Yep. I concur that for those of us on ‘blingy’, dreamhost sucks - big time.
I’ve only been with them a few months, but my experience, Dreamhost is the most unreliable hosting provider in ten years.
Why can’t they just buy another filer to fill in while they fix this damn blingy???
I don’t call 2 months of continuous downtime and broken promises anything like customer service!
Rant over, for now
March 20th, 2008 at 2:29 am
Happy to see that it’s back. Thank you, DH !
@skh.com: web/mail/mysql is deblume/randy/chimchim. I don’t think they get free space on that old cluster, even PS is not available
Hope everything will change after the cluster moving this we.
March 20th, 2008 at 2:31 am
@Skillz: I’m user since Februrary, but I contacted with Dreamhost by a user for years. I haven’t experienced such outages and high loads before, that’s why I choosed Dreamhost. But now I’m very disappointed, I hope they really gonna make something.
March 20th, 2008 at 7:05 am
since yesterday I can’t delete anything on my server. I have permissions but dreamhost just ignores it or goes crazy if I do it on the cpanal
March 20th, 2008 at 8:54 am
Im on Iris, its down. None of my sites work. My client’s sites dont work either. What is going on?
March 20th, 2008 at 8:54 am
This is NOT resolved. ALL of my websites are down!!
March 20th, 2008 at 8:58 am
problem is still there, atleast it is on Iris host, my websites are down,down,dow,down,down ….
all of my websites are down…..
March 20th, 2008 at 1:17 pm
I’m getting this error now, at 5:15pm EST. Internal Error: Unable to check domain availability at this time. Please try again later!
Is this related?
March 22nd, 2008 at 9:46 pm
FWIW the server response time is still awful at this time.
March 23rd, 2008 at 9:51 pm
Well, I guess that’s it for me…. need a refund. Anyone else still getting the incredibly slow response times? Can you say amateur? These guys have absolutely no clue what they’re doing.
Incompetent is the word of this year 2008 for Dream/Nightmare host
March 23rd, 2008 at 10:44 pm
Our site has been up and down. Sucking around for weeks!!!! We have never expeirenced such kind of hosting in our life except this time!!!! This is absolutely sucking nightmare hosting!!!! Need a refund and shout to everybody never ever use dream host.
March 24th, 2008 at 7:22 am
We signed up January 24th. We did a major, global, press release today and our site has been down for the last two plus hours. Press are impatient people. Dreamhost should be called NIGHTMARE. The lack of uptime is causing irreparable harm to our business. After today’s failures, I’m afraid we may have to move to another host.
March 24th, 2008 at 7:48 am
I agree with scott. Same case here. Once my server is up (and I can access my files) I am backing up all my files and moving to a new hosting service. This has been a shit experience. At first it was supposed to last for hours and now it has been more than a month and problems keeps arising. My site has been down for more than 70% of the time !
March 24th, 2008 at 9:40 am
If I lose site changes again like last week - I’m gone and want my $$ back
March 24th, 2008 at 9:45 am
Dreamhost, WTF?!?! I’m hosting all my clients here and they are ringing off the hook now. I have nothing to tell them.
March 24th, 2008 at 9:50 am
I think you guys may be jumping the gun on Dreamhost. I’ve been using them for well over a year with three different sites on different servers (cutlass, altair, and I can’t remember the first one). Until today, they’ve been excellent compared the crappy host I had last time (iPowerWeb).
Granted, the company I work for is now hosting our site on the Altair server, but it’s up and running fine. Our problem is that our email server is not functional and we have a salesman on the road trying to access his email but cannot… so that’s definitely a big problem.
On another note, I’ve heard that there is a massive influx of spam this morning, across many different email hosts (Yahoo! primarily). Perhaps this has something to do with this cluster being down?
March 24th, 2008 at 9:53 am
It may still be early morning in LA, but this is prime time on the east coast and I was supposed to have a client review their site today. I am fuming right now.
March 24th, 2008 at 9:54 am
If people are looking for a place to vent: http://www.web-hosting-top.com/web-hosting/web-hosting-top.dreamhost.com-reviews
March 24th, 2008 at 9:56 am
Please, make the montly $15,00 but PLEASE, Keep my site UP!!!!
I pay more to a better service and no Overloads!
Please, think about it!
March 24th, 2008 at 9:57 am
Blingy still sucks. Can receive but not send email. Four days and counting for this problem! Come on DreamHost. Four days!
March 24th, 2008 at 10:05 am
f me sideways….and yes, I have nothing constructive to say. Just get this crap taken care of….my GOODNESS….
March 24th, 2008 at 10:08 am
COMPLETELY UNACCEPTABLE.
March 24th, 2008 at 10:10 am
Is everyone’s mail still down, can’t access mine still?
March 24th, 2008 at 10:13 am
Can receive but not send.
March 24th, 2008 at 10:15 am
Maybe you should bump this notice to the top while the issue is ongoing — just to clear up any confusion (i.e., for newbs like me).
March 24th, 2008 at 10:15 am
So this is high severity now?
I thought it was high severity back when you were my host.
March 24th, 2008 at 10:17 am
For those who are bitching and moaning, please cancel your Dreamhost shared account and get a more expensive service (be it Dreamhost PS or another provider, I don’t care). If you have something potentially useful to say, please speak up. For example….
How exactly can I tell if I am on the blingly cluster? Sorry, I may have missed this info through all the chaff-comments.
March 24th, 2008 at 10:28 am
lee, go to your account and look for the account status button on the top right of the page. It should expand to show you your server, your sql server, and your email server. Whatever name is listed for your email server is also your file server.
March 24th, 2008 at 10:38 am
This may seem like a stupid question but would this outage cause all mail sent to my domain to be returned? ’cause that’s what’s happening.
March 24th, 2008 at 10:47 am
My mails are working, but my site is down.
I really need it to be working NOW ! because of SVN
Please fix it!
March 24th, 2008 at 10:47 am
I`ve heard from a friend that this host is good, i had a host for free bcause my site has more than 20k visitors everyday and i`ve moved to dreamhost searching better service and now i see how dunk i am! DREAMHOST SUCKS and i am searching for a new server as fast as i can!
March 24th, 2008 at 10:51 am
Fix it now! i need my sites working now!
March 24th, 2008 at 10:51 am
error Your website does not appear in the Apache configuration file.
warning Your website took longer than 5 seconds to respond.
helpppp
March 24th, 2008 at 10:56 am
Come on guys this is my second year with DreamHost and everytime a problem came up they fixed it.
I have major problems as well right now. And my clients are lashing out on me.
Just give them time to fix the problem.
Just so you know I have Private Server here so I am definately more in problem than you are.
March 24th, 2008 at 11:06 am
well, my problems started today morning, and I already have my gmail inbox filled with emails from people telling me: “omg! your site is down! OMG! fix it please!”
Well, i dont blame them,they need the content i am offering them badly. lol
i cannot access via FTP nor SSH nor SFTP, and my site is down and so is my mail :/
the weird thing is, my webserver is shinobi, so i think it is within the cluster or somthing :S
Been with DH since November 2007, not many problems, i think this is the third one or so, the previous ones were fixed pretty quickly
DH guys please try to fix this soon.
March 24th, 2008 at 11:20 am
What is the time frame on getting this resolved? I just got started and am extremely dissapointed with your company so far.
Lisa
March 24th, 2008 at 11:23 am
Please, please, please, please, pretty please fix it.
March 24th, 2008 at 11:24 am
>>> DOWN FOR 8+ HOURS WITHOUT ANY RESPONSE FROM DREAMHOST SUPPORT!!! >> DOWN FOR 8+ HOURS WITHOUT ANY RESPONSE FROM DREAMHOST SUPPORT!!!
March 24th, 2008 at 11:25 am
tracert blingy.mail.dreamhost.com
Tracing route to blingy.mail.dreamhost.com [208.113.200.47]
over a maximum of 30 hops:
1
March 24th, 2008 at 11:31 am
Hello All,
I am brand new to hosting my site on dreamhost. I would really appreciate it if someone wouldn’t mind speaking with me offlist at dhlevit@mindspring.com
Thanks,
Donny
March 24th, 2008 at 11:35 am
Looks like everyone has a case of the Mondays. Hardware fails….it happens…you can always request from them that they move you to a different cluster…I did that with another one of my accounts and I haven’t had issues with them since. I have 3 different accounts and only one is affected by this outtage. When did this one start? Luckily I develop on a LAMP virtual machine and I don’t need the live server to develop on… But it does suck since I get commission off web leads…and web don’t werk rite now.
Have faith, they will get it fixed.
March 24th, 2008 at 11:39 am
It appends to me two hours ago .
can’t acces my website and ftp .
after turning around to find a problem in my computer, i wanted used the contact support because i realized an other friend on dreamhost don’t have problems.
And i saw this warning.
I don’t undertand this problem of plinging, i’m not an enginer but i’m surprised to see a 4 days problem can disturb other users laters ??
It coul’d be very appreciated to display an entimated time needed to solve this problem.
It would be usefull too to add how many time spended when updated au problem to say it’s OK .
I’m a new user, it’s my first time using host and if flame is natural it’s justice to thank you to display info about this disturb.
keep good work .
March 24th, 2008 at 11:47 am
Come on guys. It’s big boy time. Get things working. This is ridiculous.
March 24th, 2008 at 11:53 am
I was in midle of online mail sexy exchange. You bastards!
March 24th, 2008 at 11:54 am
I don’t believe it. You guys are not serious. This is fucked up stuff.
March 24th, 2008 at 11:56 am
The funniest thing is that the Dreamhost status site always seems to be working. I wonder if it is hosted by a different company?
March 24th, 2008 at 11:58 am
ok, mine is working….ooh…seems faster too! (maybe they upgraded)
March 24th, 2008 at 12:05 pm
Over on jurupa, we have us some huge server loads that have been going on all day. These loads are NOT reflected in the database. Is this a result of these problems or something else?
March 24th, 2008 at 12:13 pm
Ive been with dreamhost for a few years and my sites have only been down a few times in those years. This is the longest I have been unable to get to them though. I usually dont mind waiting but today I have a lot to do with my sites, I need them back up and running. Fix it in a hurry please.
March 24th, 2008 at 12:24 pm
This is getting ridiculous. I have important emails from the WA State Department of Commerce in my inbox that need handling, yet I can’t check my mail via Thunderbird or WebMail. I’m getting a little tired of this, DreamHost, and want some compensation. Your company looking bad is making mine look bad.
Thomas Albert Marsland II
CEO, MarsTech Computing, LLC
March 24th, 2008 at 12:34 pm
@ 106 - Yes. http://www.servepath.com/ seems to be the one.
March 24th, 2008 at 12:36 pm
Have been with DH for just one month and this is the third problem, and by far, the worst. Tech support has usually been responsive, but not this time. My sites are up, but NO email now for hours. Clients are not happy, so I’m not happy. This is EXACTLY the reason I changed hosts and I am not impressed. Lets get with the program fellas.
March 24th, 2008 at 1:13 pm
What servers are in the blingy cluster? I’m guessing COLBERT must be as my sites are SLOOOOOOOOOWWWWWWWWWWWW
March 24th, 2008 at 1:17 pm
my site has been slow all day and its been down for the past hour or two. This is Peak time!
March 24th, 2008 at 1:19 pm
This is not a ‘Dream’host, this is a NIGHTMAREhost!!!
Come on guys!!! i expect some kind of refund for this month, but even that will not
make up for all the time lost today!! I am on deadlines and i have not been able to read
1 email today!!
March 24th, 2008 at 1:24 pm
I’m leaving. My account is still within their 79 day guarantee.
Up and onwards I say!
March 24th, 2008 at 1:25 pm
I got email and website is up, but no mysql…which runs my shopping cart…which is my business…and we’re in peek season. Average about 10 orders a day this time of year….today NONE. I’m pretty aggravated.
March 24th, 2008 at 1:26 pm
Holy crap, it’s 5:30 PM EST and this is STILL listed as an unresolved issue? Are you f***ing kidding?
March 24th, 2008 at 1:29 pm
I am now reading my email faster than “300 baud modem”-like blingy server can emit it.
Idea: replace faulty hardware or software.
March 24th, 2008 at 1:32 pm
I found this number for DreamHost but nobody is answering: (714) 706-4182. I am not gonna stop calling until I get some information.
March 24th, 2008 at 1:35 pm
mine is back on (about time :@ )
but its cool now, mail still hell slow though.
site seems faster, i agree.
March 24th, 2008 at 1:42 pm
Still errors, stoll slow. Kind of upset at how long this has been going on!!!
March 24th, 2008 at 1:51 pm
still down here, my email has worked fine though, which I couldnt care less about
March 24th, 2008 at 1:57 pm
Guys, an ETA would be great! 2 clients dead in the water until this gets resolved.
Its hard to reassure my clients if you won’t reassure yours.
March 24th, 2008 at 2:06 pm
Guys, I understand everyone has issues with hardware, but this is a business, I can’t afford to not get my email all day long. A cluster is supposed to prevent this kind of down time, you might as well have it on a stand alone server.
March 24th, 2008 at 2:08 pm
Come on guys. How long does it take to fix this.
I can not send any email on the webmail function and half the time can’t get into my accounts.
This is unsat.
Keith
March 24th, 2008 at 2:09 pm
Neat. 3 minutes to get 2550 bytes. Less than 300 baud, fellas.
06:03 ~$ getmail
getmail version 4.7.8
Copyright (C) 1998-2007 Charles Cazabon. Licensed under the GNU GPL version 2.
SimpleIMAPSSLRetriever:jidanni@jidanni.org@mail.jidanni.org:993:
msg 1/1 (2550 bytes) delivered, deleted
1 messages (2550 bytes) retrieved, 0 skipped
You have new mail in /home/jidanni/Maildir/
06:06 ~$
March 24th, 2008 at 2:09 pm
Any chance of this being sorted soon? I am intermittently getting mail but I can’t move it or anything. I simply can’t continue like this and it’s really making me think about moving my services having been so happy with DreamHost for so long…
March 24th, 2008 at 2:27 pm
Status update please??
March 24th, 2008 at 2:55 pm
Tech Support - some information is better than NONE AT ALL! If you are still working on it, fine, but post it in a time stamped update. An ETA would be even better. You are getting more than a few disappointed customers and it looks like a lot of them (including me) have only been here a short while.
March 24th, 2008 at 3:03 pm
hi,
the problem probably is that they are having issues with their fileserver and that they don’t have a solution for it. if you read the status post carefully, then you notice that they have opened a case with the supplier.
They are probably doing their utmost to reduce the effects of the problem,
March 24th, 2008 at 3:13 pm
hi,
they are probably not responding because they are working on this. From what I can tell, they have decent fileservers.
Have a look at this http://www.bluearc.com/html/customers/internet-services.shtml
There seems to be some problem with some of the fileservers in this cluster, and it is ot easy to get this fixed. But I think they are doing their utmost.
March 24th, 2008 at 3:14 pm
Ok, defenders of DH: Keep in mind that those of us in the cluster have been dealing with these issues for more than a month and a half. I did ask to be migrated to another cluster and they refused. Now that I enter the 48 hours that I most need the site up, even the really slow site DH allows me, it’s all screwed.
So, with a group of people with whom I have no track record (new clients) _I_ look like ass.
March 24th, 2008 at 3:18 pm
Oh yes, “They’re working on it.” They’ve been working on it for weeks. They should have been working on isolating the machine and getting it out of production.
March 24th, 2008 at 3:20 pm
Ive said it before and Ill say it again, Id be gone from dreamhost if it wasnt for their panel. I cant find any other service with a panel that is as easy to use as theirs. I spend $80-$200/month for a private server for a big blog site, and all of the other companies out there use confusing panels like plesk
March 24th, 2008 at 3:27 pm
this is inexcusable, especially for such a long period of time. they’ve just lost all customers related to my accounts and any future recommendations.
March 24th, 2008 at 3:47 pm
DREAMHOST RULES!!!
you guys are haters
March 24th, 2008 at 3:51 pm
Does this involve harpo server?
March 24th, 2008 at 3:53 pm
Sites are working better, but Email is so slow as to be unusable.
March 24th, 2008 at 3:54 pm
So ????
March 24th, 2008 at 3:58 pm
I have a couple of my customers which unfortunately are on the blingy cluster…
looking back, the problems with blingy started at the end of dec’07.
now, back in the old telecom world, this would have been more than ample time to FIX, or remove/replace the unit. in this case, I would say that DH needs to bite the bullet and replace the hardware…
March 24th, 2008 at 3:59 pm
Funny thing Randy - I have the opposite: My E-mail is working fine, but my sites are down completely.
March 24th, 2008 at 4:01 pm
same here dan k, never had any issues with email today, and dont care about email
March 24th, 2008 at 4:04 pm
come on guys, give them a break, they’re prolly trying to fix it
March 24th, 2008 at 4:17 pm
Email finally back up (my sites and ftp were not affected) and seems to be ok . . . for the moment.
March 24th, 2008 at 4:41 pm
my sites are down with 404 errors and i can’t access FTP, i guess I am affected?
March 24th, 2008 at 4:42 pm
My sites are back up now.
March 24th, 2008 at 4:42 pm
Oh look. My site’s up. Must be a full moon in Cali tonight. I wonder how long this will last.
March 24th, 2008 at 5:06 pm
consider yourself lucky, my site is STILL down
March 24th, 2008 at 5:13 pm
how the hell do you find out if you’re in the blingy cluster? i’m on barry and my mysql is on duchess. sql and email work fine. html pages and most scripted apges work fine. but one of my scripts is incredibly slow user-side and completely times out admin-side. been like this all day. reported it and it got marked as resolved but of course it’s not. asked about it in a support ticket and no answer. as soon as i find time to switch hosts, i am. DH has sucked for at least a year. it’s ridiculous.
March 24th, 2008 at 5:19 pm
Jeez, a little downtime and the entire service sucks. Give these guys a break.
March 24th, 2008 at 5:24 pm
Im FINALLY back up, thank god
March 24th, 2008 at 5:36 pm
@Daniel: “I will lose $1000 if this server and my site are not fully online within the hour. Come on, this is appalling.”
Come on, guys. If you’re making that much money off your website, go for something a little more robust than shared hosting. You get what you pay for. If your website will make or break you, then shell out the cash and get a dedicated server or colo your own somewhere.
March 24th, 2008 at 5:44 pm
other shared hosting is better. i’ve asked around. hostgator for instance. DH used to be good. this isn’t an isolated incident. this is constant. and for every outage reported here i have many more that are short and never reported.
March 24th, 2008 at 5:55 pm
also, i’d glady pay 5-$10 more per month. but there’s a big difference in $10.95 and $150 for dedicated… reliable shared hosting is possible…
March 24th, 2008 at 5:57 pm
to be fair howie, a lot of us are on Virtual private servers now, which can be as much as $200/month
March 24th, 2008 at 6:09 pm
twenty nine: first, it wasn’t a little downtime. It was a lot of downtime. Some of have sites with more important information than comments about how dogs like to sh*t themselves.
March 24th, 2008 at 6:25 pm
Hi,
I’ve had some problems with Wordpress since this issue.
On one site, it has converted all my pages to posts, and when I open them up there’s nothing there. I haven’t touched the site in months it just loads the theme and says “No posts matched your criteria” - see www.delicadofoods.com.au.
On another it just won’t load the post. I’m a student on a short easter break trying to get some web work done to support me at university and get my uni assignments done in the same period. I had planned my time out well, but this has cost me 4 days so far.
Anyone else experiencing the same problems with Wordpress???
March 24th, 2008 at 6:51 pm
work faster!!!
March 24th, 2008 at 6:53 pm
Anyone else getting error id: “bad_httpd_conf” ?????
March 24th, 2008 at 7:02 pm
“Anyone else getting error id: “bad_httpd_conf” ?????”
YES!
I have a solution:
CLASS ACTION LAWSUIT
March 24th, 2008 at 7:57 pm
Wow DH! I got you in a brand new year(2008), and you put me in to this bingy shit.
Hey, can anyone explain me how I can claim a refund? I have paid dream host using someone else’s creditcard. If I claim for a refund, will this su**nghost send me the money to my paypal account? or will they send it back only to that credit card? This is the first time I am going to use a money back guaranty in my life.
March 24th, 2008 at 8:19 pm
Can you guys shut the fuck up and stop complaining? For how much DH costs, and the level of service they provide, they’re amazing.
March 24th, 2008 at 8:39 pm
I have been a Dreamhost Customer for around 8 years and I have found them to be responsive and very dependable.
I’m not up to date on what is going on now however I’m sure they will not only solve the issue but also fortify their systems.
These guys are very sharp and I trust them.
Daniel Gregory
March 24th, 2008 at 8:54 pm
I’m on Sothe, but in the blingy cluster. Every now any and all dynamic pages, even ones that don’t connect to databases, just regular php files, will completely time out, and freeze for 2-4 minute periods PER REFRESH.
I’ve been reading through this site, and blingy keeps having the same problems over and over again, quit patching the hardware and replace it instead. My forum in particular is moving at a crawl, and it’s pissing off my community.
Thankfully I’m still within my money back guarantee, which is the only thing keeping me placid at the moment. This is totally unacceptable, this issue doesn’t need patching, it needs fixing permanently.
Look at the list of servers under the cluster, then all of the sites under each server. This is affecting a lot of people. More importantly, before I signed up I asked if Dreamhost was the upstream provider or a retailer. Their answer should have been a red flag for me, but I looked past it. For such a short time using this service I am seriously questioning this hosts abilities. I guess if you want something done you have to do it yourself. I’ll have to host my site myself before it’s over.
March 24th, 2008 at 9:04 pm
“Can you guys shut the fuck up and stop complaining? For how much DH costs, and the level of service they provide, they’re amazing.”
YOU shut the fuck up, asshole! You think it’s fine for DreamHost to repeatedly JACK hundreds, even thousands of clients and render them completely unable to make a living? Go f yourself!
A class action lawsuit sounds good to me!
March 24th, 2008 at 9:05 pm
Mail was down for me from the morning til mid afternoon. A major inconvenience, and definitely worrying, since this is my first Dreamhost account. But I think overall the verdict is good (they replaced the whole server in the end) — they didn’t seem neglectful.
The one thing that bugged me about this was, how would you know that you’re on the blingy cluster? It’s not in control panel, or not anywhere obvious enough that I’d remember — “hey, that’s my cluster” when I saw the message on the screen. So I did an IP lookup for mail.mydomain and then I did a reverse IP lookup on that IP which showed that my email was indeed on the blingy cluster. But not everyone’s that adept, nor should they be expected to be.
So my suggestion to Dreamhost would be to put a link in the status page where you can enter your domain name to find out (a) what cluster you’re in, and (b) the status of your particular cluster.
Peace and respect,
Shiraz
March 24th, 2008 at 9:25 pm
“Look at the list of servers under the cluster, then all of the sites under each server”
how do you find what cluster you’re on or servers within a cluster?
March 24th, 2008 at 9:43 pm
Click on the “Account Status” link toward the upper right of the panel, your email server is which cluster you are in. It’s not very intuitive but that would be better addressed through the Suggestions section of the panel.
March 24th, 2008 at 10:16 pm
@reviewstash.com
“Can you guys shut the fuck up and stop complaining?”
Ok.. I will. I will get my refunds, and then shut my fuke*d up account at DH. I won’t have to complain. Believe me, I hate complaining, but my site users are complaining me so much that I couldn’t hold the vomit withing. Sorry if this complain was stinking.
“For how much DH costs, and the level of service they provide, they’re amazing.”
Try out http://110mb.com They are free and have far better uptime and speed than DH. Anyways.. if you don’t host porn, probably you won’t need 500Gb of space. Average user may need 1GB max, and they provide you 5GB.
Oh yeah.. did I mention that?.. the level of headache that DH gives me is far more costlier than the $120 per year hosting charges? Obviously they give you a *lot*(of headache) for very little.
@ Daniel Gregory
“I have been a Dreamhost Customer for around 8 years and I have found them to be responsive and very dependable.”
I have been here for the last 2.5 months, and heres the recent news: Now they su*c*k. They sucked me since day one till day 67. Exhausted. No more fluid left for you to suck. Give me a break DH. I thought I will make a living out of web designing.
“These guys are very sharp and I trust them.”
Sure. I agree. My friend is on DH since last 2 years. His sites are working fine. He recommended me, and I came here. But I am on blingy, and like everyone else on blingy I am frustrated. have some mercy dear.. we are humans. If I would have faced these problems after 8 years of hosting, that would have been justified. They sucked me from day one till date. Its also an emotional thing.
March 24th, 2008 at 11:43 pm
@skh.com: $120 is fairly big, but $10 per month is nothing. And DH allow us to host resource-consuming website for just this little amount, and if you host them elsewhere you’ll need at least $50/mo. Then I don’t count their other features like unlimited domain/acc/mailing list/…
Don’t compare any other hosting provider with DH. 110mb ? Really funny. 5 GB and then ? 110mb doesn’t allow Joomla!, vBulletin and other scripts that they class “CPU resource intensive scripts”.
Yet I’m unhappy with DH recently. Weekly uptime:96.26% Downtime:3 hour(s) 14 min(s).
March 25th, 2008 at 12:10 am
I just got my hosting here and got disappointed immediately. dreamhost guys. Please fix this ASAP or i will need to go back to my previous hosting.
March 25th, 2008 at 12:13 am
wow………. fucking … FUCK.
March 25th, 2008 at 12:16 am
Yea, I just got service here too. I’ve been with probably five or six different hosts over the years, and this is by far the worst service I’ve experienced. The fact that they don’t post any updates is particularly troubling.
March 25th, 2008 at 12:57 am
@Jcisio
“Don’t compare any other hosting provider with DH. 110mb ? Really funny. 5 GB and then ? 110mb doesn’t allow Joomla!, vBulletin and other scripts that they class “CPU resource intensive scripts”.
Yeah.. I agree with you. I don’t want to compare anyone with anyone else. I just did not like what @reviewstash.com said. It made me feel that because we are using a cheap offer, its justified for DH to give us cheap headaches. I gave him even a cheaper(free) site with lesser headaches. Of course 110mb.com is not for serious web hosting. Else I wouldn’t have come here.
I know DH is good. My friend who recomended me DH, his sites are running fine. I was unlucky to be on blingy. I requested DH to change my cluster, and they said they currently don’t have the technology to change clusters . Change to another server within a cluster is possible, though. Then what option do I have? Have lost all patience. Just the money back guaranty is holding me back here. I wish things get alright before I am too pissed off to cancel.
March 25th, 2008 at 1:04 am
Is there an ETA on a fix?
Even a status update?
I haven’t had email working at regular speed since I joined.
It just doesn’t work.
March 25th, 2008 at 1:15 am