RESOLVED Network Slowness
We are currently experiencing some networking difficulties which is causing parts of our network to be inaccessible. This is affecting everyone in a random manner. We are working hard to fix the problem right now and will have an update for you soon.
–UPDATE– Wed Aug 15 14:33:01 PDT 2007
As of now the network is running at about 95%, we’re resolving the post for now while we continue investigating.
Update: Thurs Aug 16 11:45 PDT 2007
We forgot to update this with what happened. It seems we ran in to an issue with arp table corruption between two of our main routers. The tables had arp entries, but no associated mac addresses. This was causing around 50,000 packets per second of traffic, all destined for our LAX datacenter, to broadcast in our primary datacenter. The initial location of the problem threw us off track at first, however after figuring out that the traffic as all supposed to be going down the road, we were able to fix it quickly.
.
August 15th, 2007 at 12:49 pm
Gosh, all my sites are down… i can’t imagine the amount of money i am losing …
BTW, MAKE YOUR MYSQL SERVER FASTER… MY FORUMS ARE THE SLOWEST OF ALL I HAVE VISITED.. ANYTHING WITH MYSQL ON DREAMHOST IS SLOW TO RESPOND!!
August 15th, 2007 at 12:49 pm
Best of luck nailing it down, guys! As a network admin myself, I know how frustrating these sorts of things can be.
-Andy
August 15th, 2007 at 12:50 pm
Does SMTP has something to do with this problem? I can’t send emails… Problems also here..
August 15th, 2007 at 12:50 pm
Why is dreamhoststatus.com itself going up and down? I thought this was on a different network…?
Also, I’ve gone through refresh hell to post this comment.
August 15th, 2007 at 12:50 pm
I love dreamhost, but this is just horrible.
August 15th, 2007 at 1:24 pm
All my sites are up and down up and down, then sql will be down and sites up and then email down and site down…. just craziness!!!
Let us know what is happening!!! i have been having issues ALL day!
August 15th, 2007 at 1:24 pm
been with ya for a year, and just wanted to let you guys know i appreciate the hard work. these kinds of things cant really be avoided by anyone.
i’m just glad it wasn’t my code that was slowing things down on my site… i sure didn’t want to re-write it!
p.s. don’t even trip over dudes complaining about losing money all the time, i’m sure their yearly income from the web is a couple hundred at most.
August 15th, 2007 at 1:24 pm
@ Andy - Totally agree with you (my profession also) and sometimes it can be solved in a matter of minutes, other times you just need to dig a little deeper….
@ Carlos - If you’re losing money get a dedicated with redundant connection. You will be on your own network (Dreamhost uses clusters so the network is a little more complicated). As for MySQL, again, go dedicated, that way you have your own machines resources, at the moment you are using SHARED hosting….
August 15th, 2007 at 1:24 pm
hmm. down again!? geez.. I hate making excuses for Dreamhost again to customers, perspective clients. I try to explain it’s “just a random thing.. not to worry.. should be fixed soon.” meanwhile, they think I’m B.S.ing them or omitting something.
I DON’T make a thousands of dollars a month with my $15/month account.
I DON’T have a high profile website that gets tons of traffic/month.
but just want basics, like (1) site is accessible, (2) email is accessible.
I love the features and site management but if they’re not accessible when I need them, what good are they.
I have a day job. I sometimes only get a little pocket of time here and there to “do stuff”.
Because of the current/latest outage, so much for today’s changes, D’oh!
August 15th, 2007 at 1:25 pm
That does it, we’re switching hosts…two days in a row with multiple hours in which we were unable to access e-mail? Completely unacceptable.
August 15th, 2007 at 1:26 pm
Why is this outage taking so long? I’m losing money at this peak time
August 15th, 2007 at 1:26 pm
Our site has now been completely unresponsive for an hour and a half. Is there any estimate AT ALL on when this will be resolved?
August 15th, 2007 at 1:26 pm
Will this affect the Panel outage scheduled for tonight? Is that being pushed back?
Thanks.
August 15th, 2007 at 1:26 pm
Not a good time to introduce my friend Chris to dreamhost then
August 15th, 2007 at 1:31 pm
Even dreamhoststatus.com seems spotty today (was down earlier..) I’m wondering if it really is hosted elsewhere.
(update) hah - while trying to post this, I see someone else has successfully posted the same question. I think we probably have our answer.
Oh well, again with the afternoon of “yes, we know you can’t get to your site, the host is having issues” calls…
August 15th, 2007 at 1:34 pm
Hang-up after hang-up. We can´t go on like this. Please improve your sistem or do something, this is getting realy anoying.
August 15th, 2007 at 1:35 pm
it looks like this site itself (dreamhoststatus.com) has been down for half an hour or so as well.
isn’t the point of this site to be completely seperately hosted? Just coincidence that both places went down?
August 15th, 2007 at 1:38 pm
Web pages down since 11:30 am. Please resolve this Dreamhost.
August 15th, 2007 at 1:39 pm
I use my dreamhost site to host images for my ebay sales. Which means all of my auctions are without images right now. I was planning on putting up about 40 items today since ebay is having a no fee day, but saving the insertion fee does me no good if I have to switch to paying to have my images hosted by ebay. Now I’m having problems posting here. I also thought this site was located offsite.
August 15th, 2007 at 1:39 pm
Oh god not more down time. I just had my site taken offline for 24 hours as I was getting too much traffic from digg.com:
Hello,
Unfortunately, I was forced to disable the http service on your
vanillamints.com domain just now. The site is flooded with concurrent
connections, and it saturated the network between your machine and the
file server and almost crashed the server (the load was over 250, while
we need it around 5 to be stable). This sort of activity is for dedicated
servers, not shared ones, sorry. The machine load came down after
I killed the apache service, but now I have to give a new IP to the apache
your domain was on, as the requests are still coming in to the old one
and no other sites can be loaded. I won’t be able to enable your service
until the hits die down a bit. Sorry I had to take this route, but I had
to consider all the other customers on your apache web service and
server.
I am seriously considering going to a better host, lately all I have had is downtime, downtime and more downtime oh and ÜBER slowness.
August 15th, 2007 at 1:42 pm
Carlos: Get a new host or stop complaining. Come’on Dreamhost is really, really inexpensive they are not going to double your server and guarantee 100% uptime for the price they charge.
Sheesh… webhosting isn’t free nor cheap.
August 15th, 2007 at 1:45 pm
Can we get a time frame? I need to make some choices… an update would be nice.
August 15th, 2007 at 1:52 pm
I agree. I kept checking to see if something was wrong with my server (usually isn’t) and was happy to see this. Guess I’ll go take a lunch break. Thanks for working on the problem!
August 15th, 2007 at 2:45 pm
I am one of the 5% that doesn’t work.
August 15th, 2007 at 2:47 pm
not workin here either
August 15th, 2007 at 2:47 pm
I must be part of that 5%, too. I have nothing on the websites… though email is working again…
August 15th, 2007 at 2:48 pm
I am still waiting for my website to be up, on the dib.dreamhost.com server…
It seems I am not lucky, after 2 weeks troubles on my server, now a general outage.
August 15th, 2007 at 2:48 pm
Still not working for me, a long long time down, and is not the first time.
Not so happy with the service…
August 15th, 2007 at 2:48 pm
How sad, your latest post says your running at 95%-I’m in the 5% with website down and no email!:(
August 15th, 2007 at 2:49 pm
It seems that my shared server has been having severe slow-downs for about a week now…and, yes, along with Elena I am one of the “5%”.
And, like any outage, it’s always a critical time for someone. In this case, me.
August 15th, 2007 at 2:49 pm
i’m down still
August 15th, 2007 at 2:51 pm
Thanks for resolving this. As it is we had to use a Yahoo address to send out some ship orders that had to be on the east coast by close of business. Would you mind posting some details of what went wrong and what has been done to limit the possibility of it happening again? I would feel much better about these problems if I felt they were receiving permanent, strong fixes each time. I recognize that costs money and writing about it to us costs the time of your employees, but I think a lot of people here would appreciate it.
August 15th, 2007 at 2:51 pm
Elena — So am I. Ah, well.
Looks like things are on the mend, at least!
Thanks, Dreamhost, for the hard work involved in fixing these issues!
August 15th, 2007 at 2:51 pm
Elliott, the same problem as you…
August 15th, 2007 at 2:51 pm
Actually after that experience I will get another host. My one year is almost up and now it is time to move to a more reliable host. My main concern is the database server, which is way too slow in my opnion.
August 15th, 2007 at 2:52 pm
I really wish my phone would stop chiming. Every time my sites go down, I get a text message to tell me. So far, I have received at least 30 messages.
August 15th, 2007 at 2:52 pm
Also one of the 5%, all my sites on Wasabi still do not resolve!
August 15th, 2007 at 2:52 pm
we’re in the 5% too… …hopefully, the problem gets resolved soon, growing weary of “site’s down” alerts…
August 15th, 2007 at 2:53 pm
I have multiple accounts and two of them are in the 5% that are not working. Sucks.
August 15th, 2007 at 2:53 pm
All sites down since 3pm EST. When will this be fixed?
August 15th, 2007 at 2:53 pm
I must be part of that 5%, too. i am losing money
August 15th, 2007 at 2:53 pm
Yeah, my sites still aren’t up either.
August 15th, 2007 at 2:54 pm
All my sites (as far as I can tell) are inaccessible, I can’t connect by FTP either, and it’s been this way for hours.
e.g. http://www.vacation2usa.com/
August 15th, 2007 at 2:55 pm
I guess I am in the 5% too
August 15th, 2007 at 2:57 pm
site down over here too. any updates?
August 15th, 2007 at 2:57 pm
Although none of my websites were actually down, they did take a seriously long time to load.
Nonetheless, I still favor dreamhost, and considering it was about 2 months since something like this happened, it’s all cool with me.
You have to learn to take the good with the bad.
August 15th, 2007 at 2:57 pm
Just adding my comment..not complaint.
It says the status is resolved but all my sites are still down.
Hope you guys fix this soon.
Thanks
Eugene
August 15th, 2007 at 2:57 pm
Looks like lots of us are in the “5%” category.
Alright, who’s trying to inflate their metrics by closing this thing early?
August 15th, 2007 at 2:58 pm
I’ve got three different accounts, all on different servers they either don’t load or give 500 errors.
If possible I would like to join the other 95% of the customers.
I would love to say that I’m losing tons of money right now, but it’s probably not more than $1,50
August 15th, 2007 at 3:10 pm
if you boners are whining about losing so much money, why not put your site somewhere that doesnt cost a few bucks a month? if it is mission critical, and you’re making enough money to cry about it here, you’d spend the dough elsewhere. you kids aren’t losing any money you couldn’t easily find in change on the sidewalk. that being said, the only people to complain are going to be the people that have problems… you think they only have a couple hundred customers? thousands and thousands of customers, 5% could be quite a few people still. my site is still down, but its not a critical site and nothing i’ve come here to whine about “losing money” over. it would be nice if my site was up, but in the meantime, watching the teens cry that their money-making blogs are down is amusing enough to pass the time.