LAX Networking upgrade

On Wednesday, March 12, starting at 10PM we need to do a quick network migration. We are moving from one router to a newer, larger router. This will hopefully solve a problem we are having with load balancing across our links back to our downtown datacenter. Cisco isn’t sure what is causing it, and we have no free capacity to do the troubleshooting they need to properly diagnose the problem.

The outage should be around 30 minutes, and will affect dedicated servers, looney, swarthy, spacey, frisky, and blingy. This is going to run concurrently with the Blingy file server upgrade.

Update 11:15PM Pacific: As of right now, I believe we are back in business. The blingy cluster took a bit longer to show OK due to the upgrade concurrently happening. Please let Technical Support know if after right now you are still having problems!

.

88 Responses to “LAX Networking upgrade”

Pages: [1] 2 » Show All

  1. 1
    SarcasmIntended Says:

    Now that’s a creative way to get you to upgrade your routers! Cisco: “Sorry, we can’t figure out what’s causing your network trouble. Why don’t you upgrade to this newer, larger, more expensive router and then we can help you.” :-)

  2. 2
    Tom Says:

    That’s cisco for you. (God I hope it is a Nexus 7000, they are gorgeous!)

  3. 3
    Shawn Muder Says:

    I am all for upgrades. ^_^

  4. 4
    matt Says:

    Uhhh, if Science has taught us anything, it’s that you change one thing at a time and then see if anything changes. If something fucks up on Blingy, you’re going to undo twice as much work — and then RE-do twice as much work.

  5. 5
    Sick of this Shit Says:

    Down, down, down. Kind of like Dreamhost’s service quality.

  6. 6
    Anon Says:

    You guys are royally fucking up my development.
    I love that I can’t do any development at night, because it’s inevitable that Dreamhose will be down… AGAIN.

    Media Temple here I come.

  7. 7
    Steve Says:

    @Anon: Yeah, but at least these announcements give you a great opportunity to buy the high quality mp3 player of cheap price. Would you get that with Media Temple?

  8. 8
    Shawn Muder Says:

    lol

  9. 9
    Viking Says:

    I’ll make a useful comment

    is it 10PM PST?? CST? EST? GMT?
    I’d appreciate to know in order to be able to inform my collaborators

  10. 10
    Sean Says:

    @Viking

    I would assume PST. All status posts are dated / timestamped with PST. This post’s “Current Time Is” is marked PST. And Dreamhost is located in the Pacific Timezone.

  11. 11
    Joe Says:

    Pacific time - they’re in California

    http://www.timeanddate.com/worldclock for a handy conversion chart

  12. 12
    Marcel K. Says:

    @anon: You need a life server for development? Or do you mean installing something you already developed? ’cause I do al my developing on a local test server. I would never want to depend on my -host- for that. Or am I missing the point here?

  13. 13
    bob cobb Says:

    My database has been CRAWLING today

  14. 14
    Teck Says:

    lol The spam in the comments are EPIC!…

    Anyways I’m pleased to hear that its only my mail server (spacy) that will be down…

  15. 15
    Anon Says:

    @Marcel K.
    Yep, you’re missing the point.
    Besides, why on earth should I “depend on my host” to have my hosting work. I guess I should just depend on them to bill me. Oh wait, Dreamhost fucks that up too.

    Great work guys! Keep it up!

    Donkeys.

  16. 16
    jared Says:

    did everything just go down for anyone else? ftp, e-mail, sites, the works?

  17. 17
    jasmel Says:

    Is the DreamHost.com site down as well? 8:56PM PDT

  18. 18
    jared Says:

    everything is down, sweet

  19. 19
    jasmel Says:

    one of my sites is still up…. just one of my eleven.

  20. 20
    yep Says:

    all down

  21. 21
    Joe Says:

    More problems…half of sites are down again. can even get to Cpanel to report

  22. 22
    dhlover Says:

    buck up, hearties! DH will be back shortly!

    eh.. fuck that.

    PANIC!!!

  23. 23
    adam Says:

    weird. about half of my sites are down too. :(

  24. 24
    Kristie L. Says:

    Lovely. I’m down, and I’m not even on any of those servers. I’m on quid.

  25. 25
    threephase Says:

    Something’s definitely up. Can’t get in touch with my sites, shell hosts, or email. Hope this resolves soon!

  26. 26
    Hooray Says:

    There’s been a lot of inexplicable sluggishness since the Spacey move for us, I sure hope this helps!

  27. 27
    superdave Says:

    You know Donkey-anon … you need to get a life. Technology breaks now and then. Get a grip. No service can be up 100% of the time. At least DH gives you the heads-up to let you know something is going to happen, rather than you finding out when you are trying to do something.

    Plus its 10pm … you should be chilling with a nice beverage, watching TV or something. Sheesh. Get. A. Grip. I thought I got all cranky and moody about things….

    Dreamhost, I have been with you almost six years…you have been the awesome.

  28. 28
    dhlover Says:

    hey superdave,

    the planned downtime in this post is for tommorrow night, supergenius.

  29. 29
    Drew Says:

    So someone can post a status on why its down anytime now…. kthxbye

  30. 30
    dhlover Says:

    because it’s run by internet hating nazi terrorists?

  31. 31
    Vex User Says:

    Great. ‘nother outage. geez.. even panel is down.

    My sites hardly get any traffic, but when they do
    this crud always seems to happen. I could give
    a rat’s ass most of the time. But WTF this time?
    I’m trying to promote an event, maybe sell a
    ticket or two thru paypal.

    duh.
    I know DH didn’t coordinate the with my schedule/event in mind.
    I know 99.x% is pretty good for a $10 site.
    I know .. I should change my diaper.. wah, wah. :(

    it just sucks looking like a douche bag (again) to the folks
    I develop for because of some ‘technical issue with the servers’
    beyond my control. I like the features in the Control panel.
    I just would like them more if they weren’t “unavailable”.

  32. 32
    Vex User Says:

    I wanna be on the server that host THIS site.. status.dreamhost.com ;) !!!

  33. 33
    evofuse Says:

    Umm…. Well I might as well stop for the night. I took the whole day off and said I would finish it tonight but now I cannot.
    Xbox here I come.

    evofuse/

  34. 34
    Elrahc Says:

    I am looking into getting a PS with DreamHost - hopefully I would get less downtimes like these, but I somehow doubt it. I hate developing and then have the site go down in the middle of it.

  35. 35
    threephase Says:

    Awesome, panel is down, and they say they don’t ‘officially’ read comments here.

    Just how are we supposed to notify them that we see an outage?

  36. 36
    Drew Says:

    well my site with a dedicated IP is up….
    weird.

  37. 37
    f*&Ked Dreamhoster Says:

    why can’t they put something useful on the status page? Why have a status page when it’s useless?

  38. 38
    Elrahc Says:

    Media Temple, eh? [Checks their site]

  39. 39
    threephase Says:

    Drew,

    Is there anything you can send from your dedicated-IP site that would indicate to Dreamhost that there’s a problem?

    I’m limping through trying to use panel (it’s kind of still there) but it looks like they host all their CSS on machines that are also unreachable right now :P

  40. 40
    dhadmin Says:

    we are working on it as fast as we can.

  41. 41
    superdave Says:

    dhlover,

    Get lost. It takes a pretty shallow person to resort to name-calling. I made no mention about it being today. Don’t put words in my mouth. Maybe you should do something more productive than name-calling.

  42. 42
    threephase Says:

    dhadmin,

    Do you have any way of proving to us that you’re, well, a DH Admin, and not just another random anon poster?

    Sorry, but bad experience on some forums has led me to mistrust…

    Maybe some more specific info, or updating the status page with something, would be good?

  43. 43
    yep Says:

    >we are working on it as fast as we can.

    uh huh

  44. 44
    Drew Says:

    so I noticed that mail.dreamhost.com is responding on port 25 so I sent an email to support from my gmail acct….

  45. 45
    Drew Says:

    ok…it spit my msg back at me saying no open support request.

  46. 46
    evofuse Says:

    I had an open ticket from earlier. I just replied and told them that stuff was down so let’s hope something happens soon.

    Evofuse/

  47. 47
    evofuse Says:

    yeah mine bounced back to me too. Sucks!

  48. 48
    Barn Says:

    Here we go again.

    Got rebilled so I’m in it for another year with no possibility of prorated refund, according to their policies.

    I just now manage to get some evening time to do some pruning, and whaddya know? My webmail AND the Web Panel BOTH go down.

    No way to contact anyone. No indication on the status page that anything is amiss. Nothing.

    I’m getting weary of this.

  49. 49
    evofuse Says:

    See if anyone can get through to this link

    https://panel.dreamhost.com/index.cgi?tree=support.msg

    Evofuse

  50. 50
    dhadmin Says:

    if i were not really a DH admin, how would i know exactly which hamster has expired?

    think about it.

Pages: [1] 2 » Show All

Leave a Reply