Core router upgrades
This Friday, October 19th, 2007 at 10:00PM Pacific time we will be performing emergency maintenance on our core routers. We are going to be upgrading the operating system on one of our core routers in our main facility, and one primary distribution router at our LAX facility. The total downtime shouldn’t be much longer than it takes these to reboot into the newer operating system, and reestablish the links to the outside world. The maintenance window is two hours, though we hope everything from a network standpoint will be completed in 30 minutes.
These upgrades will address many of the issues we have been having over the past months. Cisco has recommended this version of IOS to potentially solve a network flooding issue we have seen intermittently, and if it does not, will allow us to escalate the case even further. The upgrade will also give us support for new hardware we have purchased for the routers themselves, increased diagnostic gathering capability, and bring online our redundant supervisor line card.
We apologize for the short notice and overall inconvenience of this upgrade, however this will hopefully fix various outstanding bugs that crop up during the day. We are attempting to do as much as possible with this reboot to minimize further downtime.
All systems will be affected by this upgrade.
.
October 17th, 2007 at 2:54 pm
there is no friday october 15th
October 17th, 2007 at 2:56 pm
Is the date on that correct? Today is already October 17 by my calendar…
October 17th, 2007 at 3:03 pm
when?
October 17th, 2007 at 4:58 pm
I don’t understand when?
October 17th, 2007 at 8:48 pm
well, it really doesn’t matter for me since my site hasn’t functioned properly for the last 2 going on 3 days i don’t really give a rats rear what kind of upgrades they are doing.
wait. i’m supposed to care that my site will be affected for two hours on friday night. by then, my site won’t have worked for over 72 hours and i’ll be used to it!!!!!!
and tech support told me my site looked fine. tell that to my clients.
do i sound upset????
October 17th, 2007 at 9:20 pm
Bonnie,
I don’t know if you will take this as “good news” or “bad news”, but your site also looks fine to me (though the flash is a little slow loading - meh, after all, it *is* flash). How is is not “functioning properly”?
Maybe your client/you are experiencing some connectivity problems some of the rest of us aren’t? Seriously, I’d keep investigating before assuming that the site isn’t being properly served, as I can see it fine.
October 18th, 2007 at 12:36 am
If you wish to know what time will it be at YOUR part of the world, you can use my Dreamhost Downtime Calculator
http://info.org.il/english/dreamhost_downtime_calculator.php
This is where it will take you to for this downtime notice
http://timeanddate.com/worldclock/fixedtime.html?month=10&day=19&year=2007&hour=22&min=0&sec=0&p1=137
October 18th, 2007 at 12:44 am
geyser’s slow… but my friends website on the other servers are ok
October 18th, 2007 at 12:54 am
I empathize with DH. From an IT and administrator point of view, they’re doing a good job. If you guys are looking for reliability, you’ll need to pay more. I can’t imagine you’re paying all that much money for the bottemless pit of bandwidth/storage on web hosting. Stop complaining. They already know what problems they’re having and trust me, IT’s don’t go any faster just because you cry about your problems. They get fixed when they do.
October 18th, 2007 at 3:23 am
After 2,5 years I closed yesterday my account with dreamhost . first year was great and I was proud to be with dreamhost. to the end of 2006 , the problems began, but I remained loyal. 2007 was ridiculous. I was using DH primarily for mail hosting. I cannot explain to my customers any more why my mail is unreacheable any more (DNS failures,….).
DH has added itself to the numerous black sheep in the ISP Business. But that is not my problem anymore.
And to everyone here, the money I paid for all domains and all plans permits me one last sarcastic remark:
Have fun with Dreamhost and the “not-reading-this-blog-because-it-is-useless” Dreamhost staff!
October 18th, 2007 at 4:25 am
Come on, We were coving a major event through photography albums, in India… and now i see even after a full 12 hours later still the issue is very much alive…
I mean I am running my site only for few of these events and when I need the site to run, I see my host asks for a 30 mins down time and presents me a full 12 hours and still running down time..
Thank you DreamHost for such a unreliable service !!! Really !!!
Regards
Saurav Basu…
October 18th, 2007 at 5:07 am
rlparker - my site (until this past week) zipped right open even through the flash. now it takes 30 seconds for a page to load. so YES, there is a problem and NO it is not my connectivity unless all of north carolina is having a connection issue which i don’t think is the case. and dreamhost SAID it there was a problem with my server all week and that it would be fixed soon. that never happened. only the good news is that yesterday they finally said the same thing that you did - my site was working just fine. ONLY IT WASN’T AND IT ISN’T. so that’s when i knew it was time to leave dreamhost. i was stupid to think they would help me.
October 18th, 2007 at 7:52 am
I’m siding with those who have issues with Dreamhost. Seriously guys, your webhosting service quality is not as good as it use to be.
I’ve an account with Dreamhost since 2005, and the first two years with dreamhost was awesome, I even recommend some of my friends to host with DH.
In 2007 dreamhost service quality are heading downwards, they started to hide the fact that they squeez thousand of users inside a single machine. Then they started to silently limit php.cgi process. ie. how many of you encounter “500 Internal Server Error” in your own website? my website all have
October 18th, 2007 at 7:53 am
I’m siding with those who have issues with Dreamhost. Seriously guys, your webhosting service quality is not as good as it use to be.
I’ve an account with Dreamhost since 2005, and the first two years with dreamhost was awesome, I even recommend some of my friends to host with DH.
In 2007 dreamhost service quality are heading downwards, they started to hide the fact that they squeez thousand of users inside a single machine. Then they started to silently limit php.cgi process. ie. how many of you encounter “500 Internal Server Error” in your own website? my website all have less than 3k/day visit for god sake. I dont expect it to withstand a digg-effect, but php.cgi killed when I’m only running ordinary blog is purely pathethic.
I know my money isn’t worth that much, but at least stop being flamboyant, dont try and steal other other web hosting customers (like LunarPage) if you can’t even handle your own users.
October 18th, 2007 at 8:01 am
Seems Bonnie is right.. Very slow and I see why:
tracert bonberphotographics.com
Tracing route to bonberphotographics.com [208.97.185.46]
over a maximum of 30 hops:
1 1 ms 1 ms 1 ms 192.168.100.254
2 30 ms 30 ms 29 ms [205.200.28.27]
3 30 ms 30 ms 29 ms [142.161.133.33]
4 29 ms 30 ms 30 ms [142.161.132.2]
5 30 ms 29 ms 29 ms [216.13.7.85]
6 63 ms 62 ms 62 ms [199.212.161.142]
7 63 ms 63 ms 62 ms cr1-six-peer.sea002.internap.net [198.32.180.41]
8 91 ms 90 ms 91 ms cr2.lax009.inappnet.cr1.sea002.internap.net [66.79.146.226]
9 91 ms 93 ms 90 ms cr1-cr2.lax009.internap.net [66.79.146.205]
10 273 ms 207 ms 204 ms core1.lax.inappnet-12.cr1.lax009.internap.net [66.79.149.130]
11 91 ms 91 ms 90 ms border1.po2-bbnet2.ext1a.lax.pnap.net [216.52.255.95]
12 103 ms 102 ms 102 ms newdream-1.border1.ext1a.lax.pnap.net [216.52.220.78]
13 390 ms * 400 ms apache2-argon.geyser.dreamhost.com [208.97.185.46]
Trace complete.
October 18th, 2007 at 8:24 am
@saurav basu: the updates will be done on “This Friday, October 19th, 2007″ so no wonder it’s not resolved yet
October 18th, 2007 at 8:44 am
Greg - I agree, Bonnie is right. But - did you read the announcement that these comments are attached to? DH knows they have a problem, and they are announcing changes to a core router to help fix it.
October 18th, 2007 at 10:07 am
Wow, lovely. More downtime, just great. My domains finally came online again after a load issue on the server cause about 72 hours of downtime that DH were VERY slow to fix, and now my domains will be be going down again? This is bullshit, I’ve been looking at a different hosting company as of late, the problem is I have about 50 dollars tied up in my DH account (Credit, due to one of the DH staff’s errors), that they can’t refund to me in any way. Anyone have any suggestions as to a good RELIABLE host? I’ve been looking at hostmonster.com lately, they don’t sound too bad.
October 18th, 2007 at 10:14 am
Meh still a bit slow IMO, at least slower than it was, I was getting about 40ms response times before all this crap happened…
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=29 ttl=56 time=80.8 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=30 ttl=56 time=80.1 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=31 ttl=56 time=79.7 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=32 ttl=56 time=78.0 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=33 ttl=56 time=80.1 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=34 ttl=56 time=79.5 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=35 ttl=56 time=79.7 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=36 ttl=56 time=78.0 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=37 ttl=56 time=79.4 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=38 ttl=56 time=77.6 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=39 ttl=56 time=79.8 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=40 ttl=56 time=77.4 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=41 ttl=56 time=79.6 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=42 ttl=56 time=77.8 ms
64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=43 ttl=56 time=80.0 ms
^X64 bytes from apache2-hok.geyser.dreamhost.com (208.113.176.42): icmp_seq=44 ttl=56 time=80.4 ms
October 18th, 2007 at 10:19 am
n0yd, i’m looking into hosting with hostmonster.com too, though i’m beginning to think to use VPS after this. can anybody suggest alternatives?
October 18th, 2007 at 1:12 pm
I will also be moving to a new host due to this latest Uptime problem.
October 18th, 2007 at 1:39 pm
my site is completely down !
completelydown.com
October 18th, 2007 at 1:43 pm
Same here, all sites are down.
October 18th, 2007 at 1:43 pm
Hmm.. I’m not getting any email right now…
October 18th, 2007 at 1:46 pm
Everything down here too.
October 18th, 2007 at 1:47 pm
Hate I You. It’s a puzzle. Work it out.
The end of the month (and our transition off your hosting) can’t come fast enough…
October 18th, 2007 at 1:47 pm
yup. same here.. all my sites on holt are down.
*sigh*
another day with dreamhost.
October 18th, 2007 at 1:48 pm
Ironic that Bonnie’s site appears to be the only one on dreamhost’s entire network that’s up right now.
October 18th, 2007 at 1:48 pm
And redondo fell as well. Are there ANY survivors? They really get to the homeland now.
(but you know what I mean)
October 18th, 2007 at 1:48 pm
I wasn’t getting anything (mail or web servers) except the login for webmail (that couldn’t pull the custom graphic hosted on the web server)… but now it appears it’s back up.
No slowness on my sites recently.
October 18th, 2007 at 1:49 pm
That’s because they can only host one at a time, I suppose.
October 18th, 2007 at 1:49 pm
UGH!!! THIS FUCKING SUCKS!!!!!!!!!!!!
October 18th, 2007 at 1:49 pm
Yup, my sites are also down. Jabber and mail too.
Hope it will be done soon.
October 18th, 2007 at 1:50 pm
everything is down. and back again. hmmm….
why can’t they just let us know what is going on. I have been using dreamhost for many years now, and I must say, aside from service going way downhill in the last 1 year, their customer service has gone to complete shit. I pay for callbacks, and don’t get them. Status tells me nothing.
We are all just wondering, is it possible to inform your users when something is going on? That’s all we want. Even just a simple note, like “we don’t know what the hell is wrong, but we’re trying!”
grrrr….
October 18th, 2007 at 1:50 pm
My sites on Gobstopper are down as well. I’m losing ZERO DOLLARZ EVERY MINUTE BY BEING DOWN!! heh heh
October 18th, 2007 at 1:50 pm
couldnt have picked a worse time ….
October 18th, 2007 at 1:50 pm
THATS IT! IM CHANGING HOST! DREAMHOST SUCKS§!
October 18th, 2007 at 1:50 pm
This is getting to be ridiculous….
October 18th, 2007 at 1:51 pm
Whoa, dude. Now everything screeeeeams! THANK YOU DREAMHOST!
October 18th, 2007 at 1:51 pm
My site is down just when i need it the most.. again.
anyone knows a cheap and *reliable* shared hosting?
i seek uptime over price here..
October 18th, 2007 at 1:52 pm
Back up!
A WHOLE 5 MINUTES!
October 18th, 2007 at 1:53 pm
WAAAAAAAAAAAAAAAAAGGGGGGH EVERYTHING’S DOWN!!!!!!!!!!!!!!!!!!!!!!!!!! NOT EVEN THE COMPANY BLOG IS UP!!!!!!!!!!!!!!!!!!!!
Ok, calm down.
I’m not in PDT. Is this the planned downtime or not?
October 18th, 2007 at 1:53 pm
Again up. Quite fast.
October 18th, 2007 at 1:53 pm
Thanks god, it was fixed quickly.
October 18th, 2007 at 1:53 pm
All the sites on POUND are down.
October 18th, 2007 at 1:53 pm
All is brokendown!!!!!!!!!!!!!!!!!!!!!!!
HEEEEEEELPPPPPPPP
October 18th, 2007 at 1:53 pm
Everything’s back up for me.
To all the whiners out there (and you are plentiful): hosts go down. The fact that dreamhost went down and came back up in 10 minutes with a noticeable speed increase is pretty awesome, if you ask me. Remember… 99% uptime still adds up to hours of downtime a year.
October 18th, 2007 at 1:54 pm
comes and goes … now nothing again
October 18th, 2007 at 1:55 pm
Just started to come back to life for me: how long was it all b0rked for, do we think?
October 18th, 2007 at 1:55 pm
yahu bıktım bu problemlerden, problemsiz bir gün olmayacak mı ?