pyongyang downtime
Posted (February 8th, 2010 at 6:41 am PST) by patrickmWe sincerely apologize for the downtime with the pyongyang server at this time. Our admin team is investigating the issue and hope to have services restored as quickly as possible. Please watch this space for updates.
Update – 3:20pm PST: The server should be getting back to normal now. The filesystem on the server was having issues and became corrupted. We started our normal restoration plan, but after running several fscks it wasn’t repairing the data. We started to restore files from backup, but several other misconfiguration problems prevented that from happening. We’ve fixed all of those and data is now being copied over to the server from our backups. The server is now serving files from the backup server over the network and will switch back to serving the local files once the restore is complete. There should have been no data lost due to this issue and things should be running smoothly now. If you have any further issues with this server, please contact support.
Update – 6:30pm PST: It would appear that the file restores that are running are doing a fantastic job of driving the load up on the server. This means some folks are still seeing downtime and 500 errors. So “back to normal” isn’t all that normal at all. Sorry about that! More updates (hopefully) soon.
Update – 11:20am PST: Just wanted to touch base and let you know that the moves are still running. They are going slowly unfortunately but they are moving along. Sorry this has taken so long to resolve.
Update Feb 10th – 11:20am PST: We haven’t forgotten about this issue, we just don’t have any updates. The moves are still running and we won’t be able to do anything else until that completes. We will update this status post when the situation changes.
Update Feb 11th – 6:50 PST: We are roughly 2/3 of the way through restoration, hang in there!
95 Responses to “pyongyang downtime”
send me a mail when it’s done …. reply me on — > jona87_kedah@hotmail.com
To my humble opinion are there other servers down too.
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.
Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
Anxiously awaiting the fix so I can get back to work.
I told you already somedays ago that pyongyang got several problems too about the javascript! In pyongyang Wordpress got a badly dashboard and dont work as well as were in the old 32bit server (with ie7, ie8 and avant browser type in blank character’s and under the main dashboard you can see a 2nd.. like a clone).
@ George:
hello,
for the “404 Not Found” get a look on your account “google webmaster tools”. If there you find some url of your website that google say were not possible read because the 404, and that url’s ending with “function.require-once”.. that means the server not only were down but too got several problems.
With pyongyang I got many of that alerts in google wembaster tools!
@George –
“Internal Server Error” does not mean the server is down. In fact, if the server were down, you would not get a message from it at all. “Internal Server Error” means that something on your site, most likely a script, failed. Put in a support ticket.
(BTW, the “404 Not Found” part of the message you quoted just means that you do not have a custom page specified to show the 505 Internal Server Error – which most people don’t).
Well we came online for a bit with the home directories mounted read-only, but we’re off again.
send me a mail when it’s done …. reply me on — > erick.nunes.carvalho@gmail.com
fail….
all sites down
An update of the situation would be very appropriate!
O servidor não voltou ainda?
Nosso telefone de suporte não para de tocar, os sites estão todos fora do ar.
The server did not come back yet?
Our phone support does not stop play, the sites are all down.
Update, please!
still down?
What’s the story?
Already 6 hours server is down. What is the problem? Please, more details on this.
update??
So many hours! Well is it the right way to be down also in the google serp’s!
NO WAY.. only the same problem… changing server doesn’t work… SERVER DOWN is always an issue on Dreamhost, this evening I take a Nightmarehost -.-
They put an empty RAID, now copying our files. Slowly. I hope nothing is lost. Guys, DON’T PANIC:)
Forbidden
You don’t have permission to access / on this server.
Additionally, a 403 Forbidden error was encountered while trying to use an ErrorDocument to handle the request.
claudio, yes, because your files have not yet been copied. Coming soon.
:O
thx misago
POR LA RE MIERDA TENGO EL SITIO ABAJO HACE CALETA DE RATO, VOY A TENER EL CABRO CHICO ACA MISMO SI NO ME ATIENDE POR LA SHUSHA
que hay que ahcer para conseguir un poco de dignidad en este hospital, grupo ed holgazanes
ya verán tengo buenos abogados que destinarán mucho tiempo a este problema sin importancia REAL
hola los quiero, me viro
Site Temporarily Unavailable
We apologize for the inconvenience. Please contact the webmaster/ tech support immediately to have them rectify this.
error id: “bad_httpd_conf”
hi i can’t contact the webmaster, because tge webmaster is me and i don’t have an answer to this poroblem 
Site Temporarily Unavailable
We apologize fo..
Too now I got that message.. unfortunally(?) I’m the webmaster, but I didnt have an answer and dont know how to fix it.
Come on guys, you should’ve known better than to put a web server right in the capital of North-Korea.. It’s no surprise it’s down with the shoddy electrical infrastructure, the lack of fiber and the totalitarian regime, not to mention the famine. Probably some poor oppressed farmer ate the damn cables.
8 hours to put an empty raid and copying our file? Unbeliveable!!!
@guido more than 10 hrs….
capone
I KNOW WHAT HAPPENED!!!!!!!!
no, i don’t
I’m seeing most of my domains restored now. I’m still checking them, but they seem to be intact with data from as late as 04:14 PST this morning.
Is this messing up the “ninja” dreamhost forms, too? Because they are not functioning on for my websites, either.
Finally online! I already checked and seems that everything work fine (I hope so).
Just there is not 3 foto’s about the last two article’s.. What I have to do? Replace them or waiting untill will switch back the local files once the restore is complete?
nonsense. my sites still show:
Site Temporarily Unavailable
We apologize for the inconvenience. Please contact the webmaster/ tech support immediately to have them rectify this.
error id: “bad_httpd_conf”
Will the effected sites be getting compensation for this? Everything I uploaded to my server yesterday was deleted, and I can’t even replace it tonight because everything is still so slow that WP times out before I can even do anything…
This is crazy! My sites have been down all day and now it looks like there’s a chance I’ll have to rebuild them? Talk about a serious pain in the ass. I hope there’s some kind of solution fast along with a credit for the downtime.
AGGHHHHHH!!!
Still down, now it’s been 10 hours! What’s the deal? I got an email saying my site should be working now, but it isn’t!
Domains now restored, but they are backing up untill 5 february. Every stuffs you uploaded after this date unfortunally is loseeeee!
aggghhhhh!!!
The websites are not back yet. Is it normal?
What a great idea!
Have some new hosts in Lybia, China and Iran…it won’t be worst…
I think you all have to SHAME with this situation… the longest downtime websites records in the world is your!!! SHAME SHAME SHAME!!!
It’s 2:45 AM PST and it appears pyongyang has been down for at least an hour.
Please!!! when it will be fixed ? Any estimate?
When the prob will be fixed? please give us some of your estlmate?
From China!
When the prob will be fixed? please give us some of your estlmate?
From China!
My website: http://www.lyqf.net/index.php
My websites are gone: no data in folders except empty favicon files. When should I expect them to be restored?
My website in the pyongyang server been online just some hours and again back in the nightmare down! what is the problems today?
now im getting
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, webmaster@alumnosutem.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.
Additionally, a 500 Internal Server Error error was encountered while trying to use an ErrorDocument to handle the request.
in all my sites
We’ve been off the majority of the last 24 hours 
I wonder how may be that the server being restored and in 6 hours again downtime!
Site not loading again. What’s up?
…..
24 hrs +
dh should call jack bauer..
still down?!
sheesh. talk about a massive loss in production. down all day yesterday … today not looking good?
NEVER restarted… this mean 24hrs of continuous downtime…
Google will delete all my websites … without words -.-
It is really here in Brazil .. we were thinking to call Jack Bauer to resolve the problem 24 hours off the air.
update??? complaint to the FTC!!!
It’s not funny. How you suppose to compensate all our losses?
[pyongyang]$ uptime
08:28:13 up 22:50, 10 users, load average: 1267.29, 1272.64, 1507.46
@john whats mean that?
For such off and failed dreamhost should compensate financially.
Discuz! info: Can not connect to MySQL server
Time: 2010-2-10 1:04am
Script: /index.php
Error: Lost connection to MySQL server at ‘reading initial communication packet’, system error: 111
Errno.: 2013
Similar error report has been dispatched to administrator before.
over 30 of my sites are off. But one working! ))) _http://adm-rostov.ru
Why dh didnt update the status bout this next pyongyang downtime? What is the time frame for getting the server back online?
Sheeess, I do not have words, you let google will fsck us!
All my sites are down, but quite honestly, this is the first time I’ve ever experienced something like this with dreamhost in the past 2 years. Not only am I impressed with their service, but I’m also happy for a forced break away from the internet for a while.
More outages = more free time to read a book
=)
Please give us a preview back. My clients are very
nervous!
Help Us Please give us a preview back. My clients are very
nervous!
some info?
website is online, yes. but is very very slowly.. to see the homepage and some else articles need the same time that I need to make a coffe!
Now I understood why the server is called pyongyang. There is a lots of website in chinese, cirillic, serbian and so on.
My website too is two language, and one of them is russian!
DH mades our sites land in that unlucky misconfigurated server!
dreamhost nos cago a todos, carè raja
my webs still loading slow…
server again croaked…
It´s sounds like a great nightmare! And about the SLA? My customers are complaining a lot about the delay in re-establishing the service. They are losing MONEY!!!
What is the estimate for the service back to normal?
second day left………… still doesn’t work
OH MY GOD!!! AND??????????????
??????????????????????????????????????? Dreamhost OFF
Damn!!! The server is down for almost 3 days!
I have already opened several tickets but couldn’t get even a deadline!
This has been a nightmare for me! I’m still waiting but nobody from Dreamhost could assist me and give me the directions. I’m lucky because my website wasn’t rolled out yet and is still be used for tests. I don’t know what I would do If I was already in production!
Hey Dreamhost! Wake up! Do you know QoS? Do you know image risk?
We (customers) are not too much sensible about outages like that! We need information otherwise we’ll move our business to another hosting company!
Still waiting….
good luck for all!
This is the 3th downtime!
In italy about some situations is says: “cannot be 2 without 3″.
I cant believe about it.. I dont have words.
This mean more than 48hrs of continuous downtime!
Also is very strage that pyongyang server fall in downtime only when night.
Google crawler passed 3 time in this last 48hrs, sure all our sites will get “last but one” position in the serp’s! Too lots of us got complaint from customers and/or losing money!
Nightmarehost!!!
Guys, we need take an action against dreamhost: Share Action!
im agree with you guido, but you still with problems?? my sites are fine but very very slow
is access to the CP shut down too?
@ Claudio
Yeah, before was very slow and after midnight (local time of dreamhost) my website again in such problem.. is already more than 7 hours the cant access also through ftp.
so, 3 days down and there are no more updates from Dreamhost on the issue?
great.
Cm’on Dreamhost! Help Us, please, let us to knows about pyongyang server, give us a preview back!
I’m start to be really nervous!!!
Dreamhost => Nightmarehost
I´m already searching a serious company to host my websites!
At this moment you see how serious is a company and how prepared they are to deal with situations like that.
1) How come a hosting site do not provide a contingency plan?
2) What about SLA, deadlines? I opened 3 tickets and all I can get is: “We are working, don´t worry! It will be ok soon!”. I ask you, “soon?”. It´s unacceptable! We need a deadline! Unfortunetely we are depending on the server and believe or not, most of us are loosing MONEY! What do you guys tell about that? Who will pay that loss?
I´m still waiting for a serious answer from Dreamhost.
One of my tickets the technician told me to optimize my databases because that is the reason of my website´s outage! It must be a joke! They can´t be serious!
Hey dreamhost what hosting do you recommend to migrate?
Had my sites hosted with Dreamhost fro best part of 4 years and this is the first serious outage I’ve had . . . Of course I’m not crazy enough to host a commercial site here . . . I’d pay for dedicated server for that . . . at a couple of hundred a month rather than 7.95
Good luck finding another cheap reliable host . . . there are plenty out there
Hasta cuando por la cresta? el sitio carga lento.. cuanto rato más tenemos que esperarlos hijos de puta?!
@amigo lindo hermnoso
we should call to FPEL. They know who to fix this matter,
Это просто ппц. Хорошо что сайты хоть работают уже, но их нестабильность неайс.
how long will be 3/3 of server restore?
well, now pyongyang work fine, but our readers said us that they several time get a 500 internal server error.
Again pyongyaung downtime! He at all lives just 10 days?
it is still down? when it will be fixed ? every1 have the same prob ? aren’t it should fixed on 2 am ?!