DreamHost Status » Mysql Outages http://www.dreamhoststatus.com Information about DreamHost Services Fri, 09 May 2008 16:02:27 +0000 http://wordpress.org/?v=2.2.3 en Mysql Maintenance http://www.dreamhoststatus.com/2008/05/01/mysql-maintenance/ http://www.dreamhoststatus.com/2008/05/01/mysql-maintenance/#comments Fri, 02 May 2008 04:47:25 +0000 Hutch http://www.dreamhoststatus.com/2008/05/01/mysql-maintenance/ These mysql servers will be experiencing some downtime tonight for maintenance:
jake
leo
midnight
snarf

Downtime is expected to be less than 30 minutes. It should happen shortly after midnight PDT.

–Update
The maintenance was preformed and the servers were back up within 15 minutes.

]]> http://www.dreamhoststatus.com/2008/05/01/mysql-maintenance/feed/ Planned outage for mysql’s toto rover dogbert dino beethoven bootsy camille jaws http://www.dreamhoststatus.com/2008/04/30/planned-out-for-mysqls-toto-rover-dogbert-dino-beethoven-bootsy-camille-jaws/ http://www.dreamhoststatus.com/2008/04/30/planned-out-for-mysqls-toto-rover-dogbert-dino-beethoven-bootsy-camille-jaws/#comments Wed, 30 Apr 2008 16:42:30 +0000 JamesH http://www.dreamhoststatus.com/2008/04/30/planned-out-for-mysqls-toto-rover-dogbert-dino-beethoven-bootsy-camille-jaws/ On the night of Tuesday May 6th we’ll be replacing one of the network switches that serves the following mysql servers:

toto
rover
dogbert
dino
beethoven
jaws
camille
bootsy
spacey-vsql01
frisky-vsql01

We hope to be able to do this one server at a time with only seconds of downtime for each, however we’re posting this in case that’s not possible and we need to bring all the servers down.

Update: This switch was successfully replaced last night.

]]> http://www.dreamhoststatus.com/2008/04/30/planned-out-for-mysqls-toto-rover-dogbert-dino-beethoven-bootsy-camille-jaws/feed/ Mysql server Sanspoof having problems http://www.dreamhoststatus.com/2008/04/28/mysql-server-sanspoof-having-problems/ http://www.dreamhoststatus.com/2008/04/28/mysql-server-sanspoof-having-problems/#comments Tue, 29 Apr 2008 06:17:54 +0000 jordan http://www.dreamhoststatus.com/2008/04/28/mysql-server-sanspoof-having-problems/ We are currently experiencing problems with the mysql server “sanspoof” crashing. The issue is being looked into at this time, we apologize for any trouble and will update you as soon as there is more information regrading this problem.

UPDATE 23:22:43 PDT

It appears that the memory in this server is causing it to panic and crash. We are going to be replacing the memory and that should fix the problem. This update should only take about 20 minutes.

UPDATE 12:54:29 PDT

Problem has been resolved by replacing the bad memory. All mysql service on Sanspoof should have returned to normal. If you are still having problems please contact technical support.

]]> http://www.dreamhoststatus.com/2008/04/28/mysql-server-sanspoof-having-problems/feed/ Phil isn’t feeling very well http://www.dreamhoststatus.com/2008/03/18/phil-isnt-feeling-very-well/ http://www.dreamhoststatus.com/2008/03/18/phil-isnt-feeling-very-well/#comments Wed, 19 Mar 2008 01:26:58 +0000 Jason C http://www.dreamhoststatus.com/2008/03/18/phil-isnt-feeling-very-well/ Our admin team is currently investigating an issue with the MySQL server phil on the blingy cluster. Right now, any site that utilizes phil will be running into connectivity issues and new databases cannot be created on the server. Sorry to everyone that is inconvenienced by this service being down.

Hopefully we’ll be able to get a lock on this soon and sort this out. Please continue to stay here for all the latest updates on phil’s condition.

Update Tue Mar 18 18:52:04 PDT 2008: phil is back online.

]]> http://www.dreamhoststatus.com/2008/03/18/phil-isnt-feeling-very-well/feed/ Central Services and Spunky Cluster Move http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/ http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/#comments Fri, 14 Mar 2008 08:00:56 +0000 micah http://www.dreamhoststatus.com/2008/03/20/central-services-and-spunky-cluster-move/ Due to continued space and power constraints in our primary data center, we will be moving all central DreamHost functions as well as the “spunky” cluster to one of our newer data centers. This move will begin Friday, March 21st, at 9PM PDT, and is expected to last up to 12 hours, until Saturday, March 22nd, 9AM PDT.

Central services include panel.dreamhost.com, dreamhost.com, dreambook.com, files.dreamhost.com, media.dreamhost.com, wiki.dreamhost.com, discussion.dreamhost.com, basically everything but secondary DNS and this status blog. Primary and tertiary DNS will be going down as well, but will have a more limited downtime window of only 2-3 hours. For spunky, all web servers, mail servers, file servers, and MySQL servers in the spunky cluster will be unreachable. The list of affected spunky web servers is here:

abbazaba absinthe achilles adams admiralty aero alameda almalibre alondra altoid alvarado archibald arrow atlantic avalon aviation babyruth badillo balu bandini barranca barry baseline bazooka beaudry bellflower beverly bixel blowpop bonbon bottlecap bounty bourbon boyd broadway brownie bubbleyum bundy burton butler butterfinger cahuenga caramello casamento catalina centinela century cerritos cheeto cheezit chex chiclet cienega cognac colbert compton cookie cordial crackerjack crenshaw crunch cupcake dingdong doheny dorito drumstick dumdum edendale euclid fairfax fc23 federal fig fireballs firestone fletcher flower foothill formosa frito frontseat fruitland fudge fundip garland garth garvey gobstopper goober good gower grand granola grappa gumdrop gummi haven heath heaven highland hillhurst hillmont hoho holt hoover hope hops hyperion jalapa jawbreaker jefferson jerky juniormint jurupa kidsgames kiki kitkat krackel lankershim larchmont laurel lemonhead licorice lifesaver limbo-spunky3 limbo-spunky4 locust look lucas malt manchester mariposa mayo melrose mento milliken mills monroe moorpark mounds munchies nash necco nerds nilla nougat nutrageous oakdale ocean olive olympic ord oreo ouzo overland oxnard paramount payday pernod pez pico planters plenty pocky popcorn poprock powerbar pretzel price pringle rampart razzle redhot redondo reeses rexford ritz rockyroad rodeo rollo roscoe rosecrans rossmore rum runts sake saltine sanborn sawtelle schnapps scotch selma sepulveda shocktart skittle skor skybar slauson smores snicker snocap soto sourpatch spree starburst sugardaddy sunset taffy tampa temple tequila toblerone toffee tootsie topanga torrance truffle twinkie twix twizzler union vanowen vermouth vine virgil warhead washington western whittier whopper wilmington wilshire york zagnut zuma

We realize this is a very large move and we will have a dozen techs onhand to supervise. My apologies for not posting this earlier.

Happy DreamHost Mover Team!

]]> http://www.dreamhoststatus.com/2008/03/14/central-services-and-spunky-cluster-move/feed/ Mysql server deputydawg going down for hardware replacement http://www.dreamhoststatus.com/2008/02/28/mysql-server-deputydawg-going-down-for-hardware-replacement/ http://www.dreamhoststatus.com/2008/02/28/mysql-server-deputydawg-going-down-for-hardware-replacement/#comments Thu, 28 Feb 2008 22:06:40 +0000 JamesH http://www.dreamhoststatus.com/2008/02/28/mysql-server-deputydawg-going-down-for-hardware-replacement/ The mysql server deputydawg is having some problems with its raid array, and needs to be replaced. There has been no data loss. This should take about thirty minutes, during which time any databases hosted on it will be inaccessible.

Updated 2:44pm, this is done, deputydawg is on new hardware and serving its databases.

]]> http://www.dreamhoststatus.com/2008/02/28/mysql-server-deputydawg-going-down-for-hardware-replacement/feed/ Mysql server, Spike, has been impaled! http://www.dreamhoststatus.com/2007/12/26/mysql-server-spike-has-been-impaled/ http://www.dreamhoststatus.com/2007/12/26/mysql-server-spike-has-been-impaled/#comments Thu, 27 Dec 2007 04:00:45 +0000 Brian http://www.dreamhoststatus.com/2007/12/26/mysql-server-spike-has-been-impaled/ Spike crashed, and is down for the count! We’re currently moving it to new hardware, and should have it back up soon! We apologize for the problems this causes.

The move took longer than expected, but its all back up and running. Sorry for the trouble.

]]> http://www.dreamhoststatus.com/2007/12/26/mysql-server-spike-has-been-impaled/feed/ Graveyard server moves http://www.dreamhoststatus.com/2007/09/24/graveyard-server-moves/ http://www.dreamhoststatus.com/2007/09/24/graveyard-server-moves/#comments Tue, 25 Sep 2007 00:58:46 +0000 kitchen http://www.dreamhoststatus.com/2007/09/24/graveyard-server-moves/ Continuing with our datacenter re-arranging tonight we’ll be moving 2 mysqls from one rack to another.

mimsey
figaro

We will be moving these at 1am pacific time, and the downtime should be no more than 15 minutes. We will post another update here when the moves are complete.

Update: 1:06am pacific: The moves are beginning now. We will post another update when they are completed.
Update: 1:19am pacific: The moves have been completed and everything should be fine!

Thank you for your patience!

Sincerely,
The Happy DreamHost Graveyard Shift Team.

]]> http://www.dreamhoststatus.com/2007/09/24/graveyard-server-moves/feed/ Krakatoa mysql server problems http://www.dreamhoststatus.com/2007/09/20/krakatoa-mysql-server-problems/ http://www.dreamhoststatus.com/2007/09/20/krakatoa-mysql-server-problems/#comments Thu, 20 Sep 2007 15:46:52 +0000 Justin http://www.dreamhoststatus.com/2007/09/20/krakatoa-mysql-server-problems/ The mysql server krakatoa is experiencing some hardware problems. Our admins are checking out the issue now. As soon as we have further info this post will be updated. Our apologies for the downtime.

–UPDATE– Thu Sep 20 09:54:35 PDT 2007

Krakatoa has been successfully booted and we’re copying data off to a new server right now. It seems a RAID issue with one of the partitions was making it inaccessible. We’ll resolve this post once MySQL is up and running on the new server. We appreciate your patience.

–UPDATE– Thu Sep 20 11:43:02 PDT 2007

All of Krakatoa’s MySQL databases have been moved over to server Sifl. They’re all up and running normally again. Please contact support if you are still having problems with your databases.

]]> http://www.dreamhoststatus.com/2007/09/20/krakatoa-mysql-server-problems/feed/ RESOLVED! Tib hardware failure http://www.dreamhoststatus.com/2007/08/18/tib-hardware-failure/ http://www.dreamhoststatus.com/2007/08/18/tib-hardware-failure/#comments Sat, 18 Aug 2007 13:26:20 +0000 Kelly http://www.dreamhoststatus.com/2007/08/18/tib-hardware-failure/ The mysql server “tib” suffered a hardware failure around 1 hour 30 minutes ago, at 5am Pacific time. It rebooted itself, and spent the next hour checking its backup drive, only to hang. It will not remotely reboot so I am heading in to diagnose the problem! Estimated further downtime is one hour.

Update 7:33AM Pacific: Unfortunately, it turned out to be checking the raid volume, and fsck was eating the files. I am moving the backup drive to another server right now and will begin the restore process.

Update 945AM Pacific: The backups took a little coaxing, but they are now restoring as fast as the drive will read! I’m not certain exactly how long it will take, but your databases will come online as they are restored. Ballpark time to completion is 2 hours.

Update 1251PM Pacific: Looks like the backups finished restoring at 12:17pm. Please write technical support if you are having any other problems with your “tib” databases!

]]> http://www.dreamhoststatus.com/2007/08/18/tib-hardware-failure/feed/