Networking issue update
Posted (December 14th, 2006 at 2:41 pm PST) by jordanOur networking engineer made a change to our core2 router configuration. It caused the router to run out of ram and wipe out its configuration file. We have restored the configuration from backup and are going over it now to ensure everything is correct. You still may be experiencing site outages as we correct the problem. Please check back for updates which we will be making untill the problem is 100% fixed..
28 Responses to “Networking issue update”
DOH 
Kewl. I was upgrading Gallery and when “You have 1 error. Correct this error by clicking the link below.” message appeared in control panel with no apparent link I thought it was the panel that is broken, because the whole thing didn’t allow me to switch to another section! In addition I received a message from java.sun.com server about some job with unknown parameters and CPU it took at about 0%.
Eh, it happens. Wordpress wasn’t working for me and I thought it was something wrong with Wordpress itself. Checked here, and blammo. Nice to see ‘yall are on top of things, as usual.
Well, my sites stayed up (PHP5+mySQL), just mail went down an that was fixed quickly. Great job guys. As a side note what happened with dreamhoststatus.com? Got attacked?
Cheers, many thanks for your good work, Ed
On top of things indeed. Sheesh, I’m so glad I chose such an amazing team for my hosting needs. Will keep an eye out for more updates. Thanks for the hard (and dedicated) work!
My mail is still go byebye! I’ve tried IMAP as well as POP (which it was working with before…) BUT I trust DH staff will have things under control before night’s end.
Err…. IMAP seems to be working now!
I am constantly impressed with the level of service provided by the Dreamhost team. It’s refreshing to see a hosting provider that is honest about their problems and ALWAYS does everything possible to get things back on-line. Keep up the great work!
Does anyone know if this is affecting the ability to make domain updates? I tried switching a new domain to a different user and from PHP 5 to PHP 4, and after an hour it hasn’t switched. Does anyone know if this outage would affect that?
Dreamhost Status is a bag of mixed tricks, really. I love it, it is genuinely useful, and it shows a level of dedication to communication that I haven’t seen any other provider give. Ever. Seeing how hosting is really just a happy little communication job, I would suppose that communication is important.
The downside is that it attracts the vocal minority of people who like to start flame wars, and are generally just plain stupid. These are people like Dillon K., who blamed Dreamhost for a DDoS attack, and all those loud people who threaten to end their service with Dreamhost, or to cause pain to the employees that make Dreamhost work.
But, hey, it is the best service I have ever used, and the only one to dane to tell me why my site is down.
Shane - http://www.aimlessvagabond.com
Enterprise routers that reset their configuration when they run out of RAM. Nice.
i just joined dreamhost.. can someone please calm my fears that this is not a usual occurance? or should i look forward to my client’s reaming my butt hole on a weekly basis?
Thanks guys!! I noticed about 10 minutes of downtime, otherwise things have been working excellently.
I don’t usually come here to say thanks because either the outages don’t affect me, or I just don’t want to compete with the whiners. But for what it’s worth, I’m a very satisfied customer.
I really appreciate the communication when things do go wrong, as well as fixing the problems to begin with. My last host never did the former, and generally took quite a while to do the latter.
I didn’t have any downtime to speak of, either, and only a few minutes of login errors for my email. I am very happy with the fast updates on the issues, and while I’ve only been with Dreamhost about a month, I’m very impressed with the speed in which they deal with their customers. This is the first real ‘issue’ that I’ve seen thus far, and it didn’t even seem like that big of one on my end (thankfully).
As for others who are complaining, then they’ve obviously never worked with another company because the level of the fast, friendly, and professional response here is phenomenal, which is a huge thing.
Stuff happens. Things break. Especially on the Intur-web thingie. Every web host I use has outages. At least Dreamhost is usually responsive about them and keeps us informed. We’re not paying for 5-nines uptime guys. If you want that, go elsewhere and pay for it, or get a colo server in a datacenter and take on all the headaches yourself. Otherwise, get over yourselves, or go elsewhere.
All my routers [cisco 2600 series] store their config in NVRAM. Odd. What were to happen if there was a momentary power loss?
Thanks for the update! I was wondering why the mail script I was writing wasn’t sending me emails when I was trying to bug test it… and why I couldn’t download compressed versions of my SQL databases earlier. I hope it all gets fixed soon.
My mail is ok, but my sites are still down. I’m sad.
our site has been down for most of the day… it is now 4pm cst and still down…costing me new traffic and new business. Especially disheartening after receiving quite a bit of press yesterday and today—-please fix NOW!
correction, 6pm cst and still down…ugh!
My sites are still not receiving automated emails that should have gone thru this morning (usually lightning fast). Are they lost or just sitting in queue?
Both my site and mail are up, but barely. Two to three minute waits for page loads. Hmmm… not good, esp. with a big media mention coming tomorrow.
Finally, things are back up, but going slowly. Hope you can get all the issues fixed, you guys usually do. No podcast tonight.
Dreamhost pretty much is completely unreliable and their is no reassurance that their customer service will contact you in any timely mannter - especially when trying to run a business where time is money. It’s unacceptable to have as much down time as we’ve encountered since hosting our site with them. Waiting for our design firm to move the site as Dreamhost has been nothing but a nightmare!!
I’m really hoping this change that was made to the core router was an emergency change. Otherwise, why was a change made to a production router during the middle of the day?? This should never happen unless completely necessary.
I guess you’d have complained as much if they’d have left all your sites down for the rest of the day so they don’t have to take it down during the middle of the day???
Thanks you dreamhost for the great work done. Dreamhost Rocks!
Leave a Reply
Comments posted here may not be viewed by DreamHost staff at all. Please note that this is not a way to contact DreamHost.
i can’t believe in 15 minutes your last entry about the outage managed to receive 60+ comments, mostly negative, and several misinformed. in any case, keep up the good work.