Email on our cluster “spunky” is delayed =(
Posted (November 29th, 2008 at 9:55 pm PST) by BrianCurrently, all inbound mail on our “spunky” servers is backed up. We’ve narrowed this down to a problem with the mysql database system that routes mail for this cluster. We’ve restarted the mysql database involved in routing mail, however, it does take sometime to sync up the database slaves.
I should mention that mail should be queued up, and not bounced, so mail should not be lost while this is happening.
Since spunky is our largest cluster, it does take sometime to get it back on it’s feet, however, we’re doing everything we can to get this back up and working correctly. We apologize for any issues this may have caused! Stay tunes to this post for more details as we get them.
UPDATE: The servers have processed the backed up e-mail, and everything is back to normal now. There was a lot of e-mail, and so it took a very long time. We apologize for the inconvenience.
November 29th, 2008 at 10:19 pm
I’ve been out a few hours on this one… ETA for when today’s mail will start rolling in?
November 29th, 2008 at 10:29 pm
Ditto that. I’ve got some stuff pending… (sigh)
Thanks for the efforts getting it back up and running.
November 29th, 2008 at 10:31 pm
I haven’t been able to retrieve email since about noon PST today. This has been very, very frustrating. Thanks for getting it back up as soon as possible!
November 29th, 2008 at 10:41 pm
So long as the e-mail doesn’t get lost, and it gets fixed in a reasonable amount of time, I’m fine. It happens :\.
November 29th, 2008 at 10:43 pm
I just sent in a support ticket so I’m happy to see a post about this. I also haven’t gotten mail since around lunch time. I hope none is lost! but thanks for being on the ball about it <3 <3
November 29th, 2008 at 10:45 pm
fyi, my mail has been out since early afternoon PT. good luck with the issue. hoping you get a breakthrough soon…
November 29th, 2008 at 10:59 pm
I too filed a trouble ticket. Last e-mail as around noon as well.
November 29th, 2008 at 11:55 pm
Yeah an ETA on this would be really nice. Has there been any progress? It’s several hours later and I haven’t seen anything new come in, but I know there’s stuff pending.
November 30th, 2008 at 12:46 am
Any update when we’ll get good news?
November 30th, 2008 at 1:02 am
Well I just got an email, but it was one I sent just a bit before my previous comment (before I’d seen the notice) as a test. There should be mail from before that too, so I’m not sure what that means…
November 30th, 2008 at 1:30 am
I’d really like to have a PS mail server…
November 30th, 2008 at 1:51 am
Looks like things are flowing fine now.
November 30th, 2008 at 4:47 am
Thanks for the fix guys! I didn’t think my mail problems had anything to do with the Ritz outage. :-/
November 30th, 2008 at 7:39 am
We still are not getting any incoming emails even thou the updats says its been fixed. Anyone else still having problems receiving email?
November 30th, 2008 at 8:30 am
So it turns out that mail for one domain is fixed, but still behaving wrong as yesterday for another domain. Both are supposedly on “spunky.” Opening another ticket.
November 30th, 2008 at 10:53 am
No mail for nearly 48 hours now, also, no webmail (for two domains). It’s a blackout!
November 30th, 2008 at 11:11 am
FYI, people sending me emails received bounces.
You might want to check with people you were expecting correspondence from.
Lee
November 30th, 2008 at 11:29 am
Lost an important email, dont think there is a chance i`ll ever get it.
This is why i use Gmail in 99% of cases. It might look lame and unprofessional but the emails ARRIVE.
November 30th, 2008 at 12:21 pm
@Bobo - use Google Apps with your domain. It replaces Dreamhost as the email server but you still have your web hosting through Dreamhost. I’m moving all my clients to it so that we are not affected by these types of outages.
November 30th, 2008 at 9:37 pm
Someone forwarded a bounced message from Dec 1 14:38 (GMT+10).
Seems this problem has not been fixed?
December 1st, 2008 at 12:23 am
Wilshire seems to have some problems again. Sites on that server not accessible. Can you guys look into and sort asap? Thanks.
December 1st, 2008 at 1:43 am
I submited a ticket. Looks like I cant reach the database-server
December 1st, 2008 at 2:04 am
I’m getting my mail, but am constantly getting emails from GMail (where my mail is forwarded to) saying delivery failed and the error returned by spunky is - Relay access denied (state 14).
December 1st, 2008 at 6:05 am
@Ed - the “relay access denied” is not from Spunky - it’s from Google’s servers. It’s a fairly common occurrence to have emails blocked by Gmail because they think that too much spam is generated by the sending server. You should put in a support ticket, because DH needs to know that this is happening, so that they can get the IP address that Gmail has targeted unblocked.
December 1st, 2008 at 6:42 am
I agree, seems the problem is back. I emailed myself a message to test a notification 2 hours ago and still haven’t received it.
Off to the support ticket. . . .
December 1st, 2008 at 6:56 am
Seems this problem has not been fixed?
December 1st, 2008 at 7:00 am
At least your sites are working- mine is down and apparently it’s due to a MySql change that I didn’t make- I can’t even upgrade WP. Nothing but a blank page-for ALL pages on my site.
December 1st, 2008 at 7:02 am
Definitely not fixed. People are telling me they are sending me mail and it is bouncing. I forward to gmail but it’s also not getting into my DH mailbox, so it’s not just the forward to gmail bit that is failing.
December 1st, 2008 at 7:17 am
I’ve had a couple people tell me mails bounced and this is just now from a test message to myself from a non-DH account:
Final-Recipient: RFC822; ***@***.com
Action: failed
Status: 5.0.0
Remote-MTA: DNS; mx1.balanced.spunky.mail.dreamhost.com
Diagnostic-Code: SMTP; 554 : Relay access denied
Last-Attempt-Date: Mon, 1 Dec 2008 10:14:58 -0500
Going to fill out a ticket
December 1st, 2008 at 8:56 am
I’m getting bounces and error messages galore!
mcooper@ccpres.org>: host
mx2.balanced.spunky.mail.dreamhost.com[208.97.132.48] said: 554
: Relay access denied (in reply to RCPT TO command)
December 1st, 2008 at 9:40 am
All of my sites have a bad httpd_conf, apparently:
http://www.willchatham.com
Not sure how that happened or if it related to this, but I am on Spunky.
December 1st, 2008 at 10:53 am
Guys,
Spunky is on its kneeds, since this morning we are getting plenty of bounces and error messages.
Nothing more irritating not being sure if people can or cannot reach you via e-mail.
No response via support.
Solve this; please !
: host
mx2.balanced.spunky.mail.dreamhost.com[208.97.132.48] said: 554
: Relay access denied (in reply to RCPT TO command)
December 1st, 2008 at 10:57 am
@brasscrest
Surely not a gmail forward problem; we get bounces on plenty of mailboxes which have no gmail forwarding.
December 1st, 2008 at 3:57 pm
My email is on Spunky, and I still have not received anything since last night. No tests are going through…nada.
December 1st, 2008 at 5:13 pm
It’s ok on my end O.o’
December 1st, 2008 at 8:57 pm
Still getting bounces despite Dreamhost claiming this issue is fixed.
The following organization rejected your message: mx1.balanced.spunky.mail.dreamhost.com.
mx1.balanced.spunky.mail.dreamhost.com #<mx1.balanced.spunky.mail.dreamhost.com #5.0.0 smtp; 554 : Relay access denied> #SMTP#
Not happy.
December 1st, 2008 at 9:50 pm
Hi,
I’m still getting “relay access denied” bounces as well.
December 2nd, 2008 at 4:28 am
I am still having people mail me and get bounces sporadically as well. This must be fixed. I will submit a ticket.
December 2nd, 2008 at 8:44 am
Lee said: I am still having people mail me and get bounces sporadically as well. This must be fixed. I will submit a ticket.
I say: Indeed. I have the same problem. Mail has been bounced rather than ‘delayed’.
December 2nd, 2008 at 12:16 pm
I’ve had several people call me yesterday and today to tell me that their emails to me are bouncing. This issue is certainly NOT resolved. Please look into this as unreliable email service for an extended period of time is just not acceptable.
December 3rd, 2008 at 9:48 am
Something weird is still going on - I just sent three test messages to myself, two got through, one got a Relay Access Denied.
December 3rd, 2008 at 12:35 pm
Today I’m having probs sending via Spunky. I get a ‘SENDER QUOTA REJECTION’ error.
December 7th, 2008 at 1:22 pm
saol valla çok işe yaradı