Problems caused by apache service updates
We have noticed that any apache service updates initiated from the control panel are breaking the service. This includes anything that has to do with the domain’s web service, like adding a new domain, changing FTP users on domain, etc. This doesn’t just break the actual domain that initiated the change, but all domains on that apache service.
We are fixing this as we find them, and trying to catch up with the ones that broke a little while ago. Very sorry about the web downtime this has caused you, and please check back here for updates.
Uptdate 5/6/08 5pm Pacific: This issue is now resolved. Sorry about the delay, we have reconfigured all apache services for which the firs fix didn’t take. If you’re still having problems, then it’s probably unrelated. Please write to support with some details, and we’ll be happy to check into it for you.
.
May 6th, 2008 at 11:25 am
FYI, I didn’t make any changes in my panel, and experienced the 404, and now a 500 error. So I’d say that any panel updates from any user (maybe limited to my server) cause this problem.
May 6th, 2008 at 11:28 am
Same as with Gabriel. I haven’t made any updates. 500 Internal Server Error.
May 6th, 2008 at 11:31 am
I made changes, but I didn’t want to start all this, I swear!
May 6th, 2008 at 11:32 am
@1:
This pattern is exactly the failure I am experiencing. This appears to have started at about 9:30AM PST according to the error logs. I first got 404 errors and now it’s throwing 500 errors. The logs are now showing this when I attempt to hit any websites:
[Tue May 06 11:18:50 2008] [error] script ‘/home///web/internal_error.html’ not found or unable to stat
[Tue May 06 11:20:58 2008] [error] failed to open log file
[Tue May 06 11:20:58 2008] [error] fopen: Permission denied
[Tue May 06 11:20:58 2008] [error] [ Premature end of script headers: php5.cgi
Aside from zero response for the ticket I put in an hour and a half ago, the part that’s most frustrating is that we have a dedicated account. Like you, we made no changes to our dreamhost configuration today, so how did this just break?
Something I’ll have to talk to support about I suppose.
May 6th, 2008 at 11:33 am
yay right when I buy a 30 dollar ad campaign on a few sites for the day….
May 6th, 2008 at 11:35 am
My sites broke too… I expect them be back soon.
By the way… Trying to access by FTP I got “Incorrect password” on all the sites on my account I’ve tried.
May 6th, 2008 at 11:38 am
Me too. All my databases are down. So now I am just wondering how long this is going to take for them to get it fixed.
May 6th, 2008 at 11:38 am
Haven’t faced any probs yet. No problems in accessing my FTP.
May 6th, 2008 at 11:41 am
MySQL works slow, but fine, same as FTP.
May 6th, 2008 at 11:46 am
Also didn’t change anything. 404.
The requested URL /cgi-system/php5.cgi/index.php was not found on this server.
Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
May 6th, 2008 at 11:49 am
Keep getting a broken pipe while trying to upload to ftp. Related?
May 6th, 2008 at 11:49 am
Another oddity. There is a site we registered when we setup our DH account. That site still works. This is the same account and server that has failing sites on it. It might be on it’s own unique IP, but I’m not sure.
May 6th, 2008 at 11:52 am
While the initial post didn’t seem to affect my problem at all, reading the comments shows that we are indeed experiencing this, it seems.
“Not Found
The requested URL /cgi-system/php5.cgi/index.php was not found on this server.
Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.”
This comes up whenever attempting to access the forum I run. The website runs fine, however.
May 6th, 2008 at 11:53 am
Ahh, actually it appears it’s any site that uses PHP that fails. Static HTML sites seem to work fine.
May 6th, 2008 at 11:55 am
Doesn’t anyone read the announcement before they post here?
“This doesn’t just break the actual domain that initiated the change, but all domains on that apache service. ”
So all it takes is for someone whose site is running off the same Apache service to change something, and it will break your site too.
I don’t think that you can relate the Apache service to anything else, like the account name or the server name, so this is going to seem random at best.
May 6th, 2008 at 12:00 pm
Look ma’! DownHost is down again!
May 6th, 2008 at 12:01 pm
Ah, thanks for the notice. I’m guessing this is why my site is suddenly not working. I thought it was my connection being iffy.
Hopefully it will be fixed soon~
May 6th, 2008 at 12:02 pm
Great stuff, sent out an email for banner advertising last week, got two paying banner ads now and allready they see a website down and then the adserver isn’t working anymore when the site is back up.
May 6th, 2008 at 12:04 pm
Please get my site back up asap. It’s been down for too long! This happens too often.
May 6th, 2008 at 12:05 pm
Ok my site is restored and running again, but cant login to my ftp…
May 6th, 2008 at 12:05 pm
Also having password issues. Is this part of the problem???
May 6th, 2008 at 12:16 pm
THIS IS RIDICULOUS.
I cannot believe this is happening. WHEN will my service be online again????
FIX THIS OR I AM MOVING AND DEMANDING A REFUND
May 6th, 2008 at 12:23 pm
I’M A LOUDMOUTHED ASSHOLE THAT HAS SHIT FOR BRAINS.
May 6th, 2008 at 12:24 pm
Does this mean it’s safe to create a new domain if your server appears to be working? Or not? If not, when will it be safe?
May 6th, 2008 at 12:26 pm
I’m back up. yeah.
Lets hope they fixed the root cause so someone doesn’t go into apache and cause everything to stop working again.
May 6th, 2008 at 12:27 pm
Christ, spoke too soon *JINX*.
Seems they are restoring files, but forgot permissions…
May 6th, 2008 at 12:31 pm
I havent touched the panel and I am getting a 500 error.
May 6th, 2008 at 12:35 pm
no updates on my end, but still getting 500 error on php files. html files accessed just fine.
password error on ftp, too.
May 6th, 2008 at 12:37 pm
i, too, am beginning to question the quality of hosting here at dreamhost. it seems our email or website experiences issues on a weekly basis. anyone know where to find the average uptime?
May 6th, 2008 at 12:38 pm
waiting the fix
May 6th, 2008 at 12:42 pm
Password error on FTP. PHP Sessions can’t be instanciated because there’s is no write permission on /tmp/ folder.
May 6th, 2008 at 12:43 pm
The few files I serve here are fine, but FTP is down (which is what caused me to come here, to see if this was a known problem, which indeed it appears to be!). Not quite sure how apache crashing is causing FTP login errors, but such is life.
May 6th, 2008 at 12:45 pm
Ugh, what’s the deal? We have ads running like crazy and no one can get to us. Please fix this SOON! We’re losing money by the minute!
May 6th, 2008 at 12:48 pm
the same like all
400 and 500 errors, I didn’t make any update from some time ago, my error log show ” Invalid query name 1″ message around 30 times
May 6th, 2008 at 12:51 pm
Apache slowness also effects speed of my sites. Anyone interested in a little personal history can check the following forum post over at our forums: http://www.terminatorfiles.net/forum/viewtopic.php?t=436
Hope to see this resolved asap… as always!
May 6th, 2008 at 12:51 pm
Same as everybody else, all domains offline, no ftp, 500 Internal Server Error. Help!!
May 6th, 2008 at 1:00 pm
my site is down and i haven’t touched anything on the panel. this problem comes only a month after we were down for about three days because of the blingy cluster issue. i’ve never had a host that had so much downtime before and it’s a real pain the ass.
GET IT FIXED NOW!
May 6th, 2008 at 1:01 pm
No FTP. Typical. Please fix before I get back from fridge.
May 6th, 2008 at 1:03 pm
COME ON guys, it’s been several hours. You’ve replaced the Apache config error problem with a permissions error problem. Now users on my site are greeted with :
Warning: require_once(/home/.nikademus/belli/ianbell.com/wp-config.php) [function.require-once]: failed to open stream: Permission denied in /home/.nikademus/belli/ianbell.com/wp-blog-header.php on line 16
Fatal error: require_once() [function.require]: Failed opening required ‘/home/.nikademus/belli/ianbell.com/wp-config.php’ (include_path=’.:/usr/local/php5/lib/php:/usr/local/lib/php’) in /home/.nikademus/belli/ianbell.com/wp-blog-header.php on line 16
May 6th, 2008 at 1:04 pm
Me too. Same as everybody else, 500 internal server error. Please help.
May 6th, 2008 at 1:09 pm
Dear Dreamhost: Here’s the mail that you refuse to receive, and tell
me that I have to send thru the web panel:
You totally blew it on your apache updates that you just announced you
started.
You have messed up the php apache interaction/paths.
$ w3m -dump http://radioscanningtw.jidanni.org/
Warning: require_once(./LocalSettings.php) [function.require-once]: failed to
open stream: Permission denied in /home/.yoshie/jidanni/mediawiki-1.12.0/
includes/WebStart.php on line 86
Fatal error: require_once() [function.require]: Failed opening required ‘./
LocalSettings.php’ (include_path=’.:/usr/local/php5/lib/php:/usr/local/lib/
php’) in /home/.yoshie/jidanni/mediawiki-1.12.0/includes/WebStart.php
on line 86
Same for my other two wikis.
May 6th, 2008 at 1:20 pm
So…I would say that for $10 a month we shuld expect issues like global outages every 30 days…and then I read the following on the dreamhost.com “About Us” page…THIS IS SOME FUNNY SHIT!!!!
The Bottom Line
We love it here and we’re all focused on hosting. It’s what we do. It’s what we’re good at.
BWAHAHAHA!!!!!! HARHARHARHARHAR!!!!!!! OH HAHAHAHA!!!!!!!!!!!!!!
You guys ROCK at DOWNTIME!!!! Your metrics look like the inside of a fucking cave - everything is pointing down…
May 6th, 2008 at 1:20 pm
Plus I wish to note again that Dreamhost turns HTTP 500 (error) into
HTTP 200 OK
$ HEAD http://radioscanningtw.jidanni.org/
200 OK
In the logs the only clue that something would be wrong is the smaller
byte transfered numbers, as error messages use less bytes.
Too bad Dreamhost does not read these comments.
May 6th, 2008 at 1:35 pm
All my sites are down…
Warning: require_once(/home/.muppet/rbarros/ci9.com.br/blog/wp-config.php) [function.require-once]: failed to open stream: Permission denied in /home/.muppet/rbarros/ci9.com.br/blog/wp-blog-header.php on line 16
Fatal error: require_once() [function.require]: Failed opening required ‘/home/.muppet/rbarros/ci9.com.br/blog/wp-config.php’ (include_path=’.:/usr/local/php5/lib/php:/usr/local/lib/php’) in /home/.muppet/rbarros/ci9.com.br/blog/wp-blog-header.php on line 16
May 6th, 2008 at 1:51 pm
http://everlinux.com/blog/
Warning: require_once(/home/.moxie/eversite/everlinux.com/blog/wp-config.php) [function.require-once]: failed to open stream: Permission denied in /home/.moxie/eversite/everlinux.com/blog/wp-blog-header.php on line 14
Fatal error: require_once() [function.require]: Failed opening required ‘/home/.moxie/eversite/everlinux.com/blog/wp-config.php’ (include_path=’.:/usr/local/php5/lib/php:/usr/local/lib/php’) in /home/.moxie/eversite/everlinux.com/blog/wp-blog-header.php on line 14
May 6th, 2008 at 1:52 pm
cant access my sites of sftp..
May 6th, 2008 at 1:55 pm
Can someone at Dreamhost please update us as to what’s going on? It’s been nearly FOUR HOURS!
May 6th, 2008 at 2:01 pm
this is not funny anymore..
May 6th, 2008 at 2:03 pm
arghhh
i’ll use this time to look for a better hosting
May 6th, 2008 at 2:13 pm
Only one of my websites is experiencing this issue (went down 10 minutes ago) and I haven’t touched the control panel today.