PDA

View Full Version : Report ARK server down here



Pages : [1] 2 3

InsaneJ
12th August 2016, 10:38
We often get reports about the server being down. Sometimes it is really down but most often the ARK client hides the server from view because of an update in ARK or one of the mods.

In any case, if you can't reach or see the server, please report it in this thread. That way we can keep the reports in a single central location which will help our admins to respond to the issues faster.

Thanks :)

HappyDiggers Ark Server Status List

https://arkservers.net/banner/happydiggers.net:27015/banner.png
(https://arkservers.net/server/happydiggers.net:27015)https://arkservers.net/banner/84.245.27.221:28015/banner.png (https://arkservers.net/server/84.245.27.221:28015)

https://arkservers.net/banner/84.245.27.221:29015/banner.png (https://arkservers.net/server/84.245.27.221:29015)

https://arkservers.net/banner/84.245.27.221:30015/banner.png (https://arkservers.net/server/84.245.27.221:30015)

InsaneJ
12th August 2016, 12:39
Niels reported that he ARK server was down. When I checked both servers were running so I assume there has been another update.

I have updated and restarted both servers. I can't check to see if I can connect right now so let me know how it goes.

TheRealPoker
12th August 2016, 12:58
Both were down, Ark1 is now up and working. Ark2 running but still unavailable (mods?).

TheRealPoker
12th August 2016, 15:08
Now both are gone again.

InsaneJ
12th August 2016, 15:38
Strange, I show both servers as running. The process is running and the ports are open.

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
30071 ark_sur+ 20 0 8104932 7.061g 53444 S 15.6 9.0 26:56.70 /home/ark_survival02/ark/ShooterGame/Binaries/Linux/ShooterGameServer
26402 ark_sur+ 20 0 5737636 4.922g 54072 S 9.6 6.3 21:33.33 /home/ark_survival01/ark/ShooterGame/Binaries/Linux/ShooterGameServer

netstat -tunlp | grep ShooterGame
tcp 0 0 10.200.13.15:27020 0.0.0.0:* LISTEN 26402/ShooterGameSe
tcp 0 0 10.200.13.16:28020 0.0.0.0:* LISTEN 30071/ShooterGameSe
udp 0 0 10.200.13.15:27015 0.0.0.0:* 26402/ShooterGameSe
udp 0 0 10.200.13.16:28015 0.0.0.0:* 30071/ShooterGameSe
udp 0 0 10.200.13.15:7778 0.0.0.0:* 26402/ShooterGameSe
udp 0 0 10.200.13.16:8778 0.0.0.0:* 30071/ShooterGameSe
Unless another admin beats me to it, I'll check futher when I get home tonight.

TheRealPoker
12th August 2016, 15:46
Gone as in from the server browser, needing mod updates.

Jiro_89
12th August 2016, 19:18
HappyDiggers Ark is back up and running.

InsaneJ
12th August 2016, 20:44
We've tried to get the auto-mod update feature to work in ARK. Unfortunately it seems this functionality is broken for Linux at least. This means that whenever a mod dev pushes an update, we need to manually update the server. Same for when ARK updates. It's a tedious process for us right now. We're working on getting some other kind of automation going for it.

Both servers are updated to v245.986 and are currently running.

Linux Server Auto Mod Update (http://steamcommunity.com/app/346110/discussions/0/358417008718413037/)
Ark Mod updater new patch (http://steamcommunity.com/app/346110/discussions/0/358417008718195226/)

Dourne
11th September 2016, 15:52
getting mod mismatch this morning. believe Ice may have the same issue. we have been trying to join the server for 20 min now.

Jiro_89
11th September 2016, 23:24
One of the Pegi mods updated. The remote server access is down at the moment though, so it may be a while before I can access it and update it. HappyDiggers 1 is still live without a mod update.

edit: Doh! Didn't notice the game updated. We'll have to wait still though, J will fix it soon.

Jiro_89
12th September 2016, 16:59
Valhalla is back up :)

Jiro_89
12th September 2016, 22:18
Looks like a mod updated and whichever one it was didn't update their page correctly. Valhalla won't be able to be updated until InsaneJ can take a look as the remote access is still down.

Jiro_89
13th September 2016, 20:18
Both Ark servers updated to 247.1 and now live.

Jiro_89
13th September 2016, 21:54
2 Valhalla mods updated. Working on updating the server.

Jiro_89
14th September 2016, 04:00
This server will be the death of me :p. Valhalla mods are now up to date.

InsaneJ
14th September 2016, 13:43
5 minutes later.... another forced client-side mod update breaking server compatibility across the globe!

TheRealPoker
15th September 2016, 13:03
Mod update needed on Valhalla (due to Structures+).

Jiro_89
15th September 2016, 19:39
Valhalla mods are now up to date. Both servers updated to 247.3.

TheRealPoker
18th September 2016, 18:48
Another mod update needed on Valhalla.

Jiro_89
18th September 2016, 23:27
Another mod update needed on Valhalla.

I just connected after the client updated the mod. Perhaps J updated the mods? Anywho, if you still can't connect I can do another mod update.

edit: I forgot I configured the mods to auto-update on start, so when the server is restarted the mods are up to date which is what happened. :)

TheRealPoker
19th September 2016, 01:39
Aye, all good now thanks!

Jiro_89
25th September 2016, 07:44
Valhalla mods up to date.

TheRealPoker
26th September 2016, 14:48
Valhalla mod update needed (Death Helper).

Khajera
27th September 2016, 07:07
Getting mod out of sync message on Valhalla. Is there a way for me to find out which one it is so I can let you know? or just say mods out of sync?

~Khajera

TheRealPoker
27th September 2016, 09:16
It's Death Helper (at least) as a new version was released yesterday. It doesn't really help to identify which one as far as I know though, it just needs the server restarting and it should update all the mods itself.

InsaneJ
27th September 2016, 09:38
Try it now.

TheRealPoker
27th September 2016, 10:17
Valhalla up (thanks), Island down (mods).

InsaneJ
27th September 2016, 11:10
How about now?

TheRealPoker
27th September 2016, 13:57
I've still got a mismatch on Island.

InsaneJ
27th September 2016, 14:09
Then Jiro will have to take a look at what's going on. Maybe this is one of those instances where we need to copy the mod files from a Steam client to the server?

TheRealPoker
27th September 2016, 14:39
Or a 'remove and re-add'. Or it could be my client, had that happen once before.

It's certainly not a standard mod update as nothing in the mods list has been updated today (allegedly).

Jiro_89
27th September 2016, 21:26
Ark01 Updated and up. Lately, the only way to get Ark01 not to have mismatches is to remove all the mods from the Ark01 mod folder and then start the server. The server will re-populate the mods quickly and there will be no mismatch. The odd thing is that you have to do this EVERY time you restart the server, but Ark02 doesn't do this and updates normally. I haven't a clue why it's being so finicky, but at least it works.

TheRealPoker
29th September 2016, 23:24
Island down, needs mods (GlassMetal).

Jiro_89
30th September 2016, 07:19
HD Ark The Island back up

Dourne
2nd October 2016, 02:50
both down.

Jiro_89
2nd October 2016, 03:34
both down.

They're both up and have been for some time? I've been on Valhalla since I last saw you online and only left to confirm they're both up.

3054

TheRealPoker
2nd October 2016, 17:21
Both servers up, but I can't see Island from Valhalla, is the clustering down?

Jiro_89
2nd October 2016, 19:17
Both servers up, but I can't see Island from Valhalla, is the clustering down?

Ark The Island Clustering re-activated. Looks like it lost the config values when I fixed the mod mismatch startup error.

Dourne
15th October 2016, 22:56
getting mod mismatch.

Jiro_89
15th October 2016, 23:56
Valhalla should be back up now with up to date mods.

TheRealPoker
19th October 2016, 19:09
The Island didn't come back up after the general outage.

InsaneJ
19th October 2016, 20:01
It seems the Island server wasn't configured for auto-start on system boot. It should be running now.

The server went down this afternoon when a certain toddler saw the shiny blue power button of the server and decided to press and hold. The server automatically recovered from this hard shutdown. But then I discovered I had set the virtual machines to manual start for debugging purposes a while ago. Those are now also set to auto-start when the server is turned on again.

By the way, did I mention I had solved the major server issues we were having for about a month or so? It pretty much took a new server to get things sorted. Literally all components except for the hard drives have been replaced. In the end it turned out the CPU was the culprit. So the server got a CPU upgrade in the process. We're now rocking a 14 core Intel Xeon E5-2680 v4 (http://ark.intel.com/products/91754/Intel-Xeon-Processor-E5-2680-v4-35M-Cache-2_40-GHz) CPU. Which is why we can go nuts and run a bunch of ARK servers next to the CPU hungry TerraFirmaCraft servers.

TheRealPoker
19th October 2016, 20:33
Not surprised it took a while to track down that it was the CPU, such a rare component to fail in my experience.

Got mittens for the toddler now?

Dourne
22nd October 2016, 17:02
why dont the mod authors work on the weekdays.... mod update again

Jiro_89
22nd October 2016, 23:43
Ark servers updated to 248.4 and Valhalla mods updated.

GhostInTheShell
25th October 2016, 19:15
It seems there has been another mod update, so the servers might need to be updated again.

And hello, btw. I had played on the TFC Minecraft server before, but never registered on the forum. Now that I discovered ARK I decided to join here as well.
Sorry that my first post is a "nagging" one. Somebody probably already noticed and informed an admin, but I wanted to be sure.
Awesome work so far!

Jiro_89
26th October 2016, 02:55
It seems there has been another mod update, so the servers might need to be updated again.

And hello, btw. I had played on the TFC Minecraft server before, but never registered on the forum. Now that I discovered ARK I decided to join here as well.
Sorry that my first post is a "nagging" one. Somebody probably already noticed and informed an admin, but I wanted to be sure.
Awesome work so far!

Don't worry about nagging us, that's what this thread is here for ;)

Servers updated.

GhostInTheShell
28th October 2016, 22:31
I'm not sure whether the server's actually down or if it's maybe the Halloween Update, but it gives me an error message when I try to connect (unable to query or something?).
That's a different one than the usual message about differing mods...

Jiro_89
28th October 2016, 23:52
All 3 ark servers updated to 249.0, the Halloween update.

GhostInTheShell
29th October 2016, 23:44
And now the mods need updates again...
Isn't there some way to automate this, like steam updates them in each client, too?

Jiro_89
30th October 2016, 00:42
Mods were updated about an hour ago on Valhalla.

Mods can't be automated, not unless you're really good at scripting and can make a script that can auto-check and detect mod update listings off of the workshop page.

Game version updates can be automated but many of the scripts people have out there are old and don't work for one reason or another. I have a script I've been working on for a while, but it's not quite working yet. Until then we still have to manually update. Our moderators will be able to do manual updates soon though, which will help. Just a matter of getting some things done first.

TheRealPoker
31st October 2016, 15:54
Need mod update on Valhalla (at least) again please.

Jiro_89
31st October 2016, 19:22
Mods updated on Valhalla and is back up.

GhostInTheShell
2nd November 2016, 20:47
Seems the Valhalla server is down atm.

Btw, is it normal that Valhalla doesn't appear in the "My survivors" list of servers? And the Island one somehow vanished from my favorites, too. I only rely on the links posted on the site.

Jiro_89
2nd November 2016, 21:54
Valhalla is back up.

It seems Valhalla was suffering from a fatal error on startup. The save was somehow corrupted so I reverted to a save from a day ago which means losses should be minimal, if any at all, since people haven't been able to play on it due to the crash.

GhostInTheShell
6th November 2016, 09:00
And right after I lost my Raptor the server mods need to be updated again. :(

Jiro_89
6th November 2016, 23:18
Valhalla mods updated.

Shacck
8th November 2016, 22:45
The Scorched Earth server is down :-( pls fix

Shacck
9th November 2016, 11:40
Bump

InsaneJ
9th November 2016, 16:30
The ARK servers may or may not have been updated. I really can't tell with all the fancy Jiro-ware scripts :)

Try again?

Shacck
9th November 2016, 18:01
Yes it works again. Thanks alot :-)

Shacck
17th November 2016, 11:59
All ark servers are down. Pls fix.

Thank you.

Jiro_89
17th November 2016, 19:16
Ark servers updated and back up.

Shacck
20th November 2016, 10:54
Another week another server outage.

Servers are showing up on the list but once again are not working. I guess i will check back in 2 days here to see if they work again.

Do the servers die for 1 -2 days everytime an update hits? If so, this server is unplayable. No wonder there are 0 players outside of my own tribe right now.

4 x server offline for 1 -2 days everytime in the last 2 weeks. Is all iam saying.

InsaneJ
20th November 2016, 11:36
Another week another server outage.

Servers are showing up on the list but once again are not working. I guess i will check back in 2 days here to see if they work again.

Do the servers die for 1 -2 days everytime an update hits? If so, this server is unplayable. No wonder there are 0 players outside of my own tribe right now.

4 x server offline for 1 -2 days everytime in the last 2 weeks. Is all iam saying.

Servers should be up now.

If you ask me the way ARK handles updates plain sucks. Every minor update on either ARK or one of the mods completely breaks the server and is automatically pushed to everybody who has ARK installed. With Minecraft mod packs at least we an control when an update is pushed which keeps server and client in sync. With ARK you can update everything, and 5 minutes later another minor update breaks everything and you have to do it all again.

I don't play ARK so I won't notice there is a problem unless someone tells me. Jiro does play ARK but he can't be expected to be on the server each and every day.

We all understand it can be frustrating not being able to play on a server you have invested in. This is why we always try to respond as quickly as possible to these posts. As long as there is no working way to automatically detect updates and then update ARK server + mods this will remain an issue I'm afraid.

Shacck
20th November 2016, 13:50
Yea it is working now.

I didnt mean to blame you. I know the way this game updates is crazy.

Thanks for everything :-)

InsaneJ
20th November 2016, 13:50
No worries :)

Shacck
15th December 2016, 11:56
Everything is extremly slow and half the base isnt loading in.

Restart pls

Shacck
15th December 2016, 11:57
Everything is extremly slow and half the base isnt loading in.

Restart pls

Your website appears to be laggy as hell. Something is going on.

InsaneJ
15th December 2016, 22:33
We've been having intermittend issues with VMware ESXi where disk latency would creep and eventually become so high that the performance would plummit. Having high disk latency means that reading and/or writing to disk takes longer. Meanwhile the system has to wait for confirmation that something was read from or written to disk causing the slowdowns.

Our server runs on an Areca 1680i raid controller which has a dual core PowerPC CPU @1.2GHz and 4GB cache memory. It's a fast raid controller. However it's not on VMware's HCL which means there is no support for it from VMware. Areca has drivers for VMWare and maintains them with regular updates. They just don't pay VMware to certify their products.

Basically Areca is great for workstations, servers and the like. Just not for professional VMware installations due to lack of support. But since we already had this card and it's an $800 piece of kit, I wasn't about to get rid of it after we moved from Xen to VMware a couple of months ago. The problem with our setup is that VMware assumes that it runs on systems that have newer raid controllers which have larger queue depths and SAS drives which have larger queue depths than the SATA drives we are currently using. The lower queue depths of our hardware means that VMware tends to saturate the queues with commands for disk I/O. When that happens things slow down.

To give you an idea. VMware recommends raid controllers with a queue depth of 100 or more. The Areca 1680i has a queue depth of 255 which is OK although more modern controllers have a queue depth up to 1000. The SATA drives we use only have a queue depth of 32 where SAS drives have a queue depth of 254. That's basically why SAS drives are more expensive than SATA drives. For a regular PC you won't notice much of a performance difference, but in multi-user scenarios as with our various virtual machines the difference is significant. Since we run most of our VMs from a raid-1 array for two 3TB drives and a raid-5 array of SSDs, we run out of queue depth to the drives pretty quickly. Again, this is mostly a VMware thing. When we ran the Xen hypervisor we never had any issues like this.

Anyway. To get back to our disk latency issues. I've upgraded the Areca driver from arcmsr-1.30.00.02 to arcmsr-1.30.00.03. Unfortunately I couldn't find the change log for this minor update so I have no idea what's changed. I might just be compatibility with the new VMware ESXi 6.5, or it might have solved our issues.

I've also upgraded from ESXi 6.0 to ESXi 6.5. So far things seem to be doing OK. Our host has a 14 core / 28 thread Xeon CPU with 96GB RAM and is running a bunch of virtual machines. This is a graph of the disk performance as monitored by ESXi right after booting the system, starting all the VMs and starting all the Minecraft and ARK servers.
3109

As you can see disk I/O isn't very high, even during system startup. What's more important is the disk latency graph (light blue). It seems to stay below 30ms which isn't great, but it's not nearly as bad as it was when we suffered through the extreme slow downs. During those periods we'd see disk latency of in excess of 1000ms. Ideally you'd want a disk latency lower than 5ms. But for that we'd need to get SAS drives which are quite expensive. The graph above should be good enough for our purposes though. We'll see how it goes from here and keep an eye on things.

Alternatively we could add more SATA drives to spread available disk queues between VMs. But yeah, money doesn't exactly grow on trees. If anything I'd rather replace the current raid-1 array with NL-SAS drives. Those aren't much more expensive than regular SATA, but less expensive than SAS and still provide better queue depths which should help in our case.

For those who want to read a bit more about VMware and queue depths, check this out: http://www.yellow-bricks.com/2014/06/09/queue-depth-matters/

Shacck
16th December 2016, 07:37
Well it doesnt work.

Make sure to make copies of the save from like yesterday or 2 days a day.

Hope it gets fixed eventually.

Heptagon_ru
16th December 2016, 10:32
We've been having intermittend issues ...
Aargh, J, you are provoking my "like button" itching! :D
It is very harmful for my mind to have a struggle between needing to say something nice about the awesome post and being too shy to write trivialities like "awesome post, dude, I enjoyed it a lot!". This struggle results (best case) in posts like this. :elmo:

Shacck
16th December 2016, 19:23
Aw what
The server worked today for sometime but now when i tryed it was offline :-((

Jiro_89
16th December 2016, 23:21
Aw what
The server worked today for sometime but now when i tryed it was offline :-((

Our windows virtual server may be down. Unfortunately, I can't do much about that from my end. We'll have to patiently wait for J to have a look when he's online :)

InsaneJ
16th December 2016, 23:40
Trying to track down the storage issues I've been able to reproduce the symptoms. It appears that when we run the Windows Server instance the disk latency issues happen after about 10 minutes or so. The server starts up, uses a bit of disk I/O without any problems, and then after things have seemingly settled down and disk I/O is low, the disk latency issues appear.

Shutting down the Windows server instance seems to resolve the disk latency issues completely. I've already tried switching between different kinds of virtual disk controllers but that doesn't seem to make any difference. I'm now installing another Windows instance. We don't really need Windows Server to run ARK servers, it can be a regular old desktop Windows as well. We'll see if that'll make any difference.

InsaneJ
17th December 2016, 09:54
Windows 7 (woot!!) installation is complete. I've added 32GB of RAM, 8 vCPU's and the virtual hard disk of the other server which contains the ARK server instances. I've started the 3 ARK servers manually. There's no auto start as of yet, this is just to test and see if disk latency issues come back or not. Right now the ARK servers have been running for about 10 minutes and there aren't any disk latency issues so far.

However, since I really have no idea how the ARK servers should work/behave, could someone please tell me if they're working as they should? :B

InsaneJ
17th December 2016, 13:19
The server has been mostly idle since the last change. So far I'm not seeing any latency issues creeping up on us. Before we had the latency issues even when the server was idle so I'm cautiously optimistic.
3110

Shacck
17th December 2016, 13:27
It's offline.

InsaneJ
17th December 2016, 16:45
Restarted and updated the servers.

Jiro_89
17th December 2016, 23:47
However, since I really have no idea how the ARK servers should work/behave, could someone please tell me if they're working as they should? :B

Played for a bit on the servers and they're doing well. Better than baseline really.

Shacck
18th December 2016, 14:42
Offline

Jiro_89
18th December 2016, 23:21
Valhalla updated. All servers up.

Added a few startup tasks/scripts to see if we can get them auto-starting again.

Backups are already auto-running daily.

Shacck
31st December 2016, 16:35
Server is dead :-(

Jiro_89
31st December 2016, 23:49
Server is dead :-(

Server given epinephrine, paddles, and mouth to mouth. Server successfully resuscitated.

Verstix
29th January 2017, 16:49
The ARK TheIsland server is down

Jiro_89
30th January 2017, 01:30
The Island is back up.

DwarfyAssassin
31st January 2017, 17:15
I am unable to conect to the server. The error message I get form ARK is: Unable to query server info for invite.

Jiro_89
31st January 2017, 23:55
I am unable to conect to the server. The error message I get form ARK is: Unable to query server info for invite.

When Ark has a major version update it forces your client to download it. After updating you are blocked from accessing servers with an older major version.

Servers updated to 254.21.

joeyjojo800
12th February 2017, 10:25
I am playing on the ARK: Scorched earth server but yesterday it went ofline. I stopped playing for that day and i came back now and it is still closed? Fix it please.

Jiro_89
12th February 2017, 21:37
I am playing on the ARK: Scorched earth server but yesterday it went ofline. I stopped playing for that day and i came back now and it is still closed? Fix it please.

Scorched Earth is back up.

joeyjojo800
18th February 2017, 18:33
Hi HappyDiggers,
I am playing on the scorched earth server today and it is lagging very hard right now. I have lost 3 argy cause off disconnections but I am happy I found one back. Can someone fix this lagg so I can play normal again?
Kind regards, joeyjojo800

Jiro_89
18th February 2017, 23:05
That's easier said than done. There are many, many causes of lag. I've tracked the server over the last 5 minutes and it has had normal ping values and has returned my inquiries promptly.

Kagehamaru
20th February 2017, 07:10
Structures + Updated, Mod Mismatch

Panda
20th February 2017, 09:18
Good Morning,

My Clan and I play on the Island Server.

Can I just say what a great server it is!!

This morning though none of us can join or even find the server online?

Is there a problem?

Many Thanks

Panda

MikeMcG
20th February 2017, 11:07
Structures + Updated, Mod Mismatch

Yup, having the same issue :( I need my daily Ark fix :(

lol

Moralawl
20th February 2017, 11:32
Same here, didn't get my morning dose of ARK before work, and now I'm grumpy :(:(

Moralawl
20th February 2017, 11:34
Otherwise, Great Server guys! :)

Daron
20th February 2017, 11:39
Cant join the server! Can you guys take a look at this issue please! Need my daily dose of Ark

ExSiteus
20th February 2017, 13:57
same here think the server is down.:p:(:elmo:

MikeMcG
20th February 2017, 14:37
same here think the server is down.:p:(:elmo:

it's not down there's just a missmatch on the S+ mod as it's been updated. They just need to update the mod on the server and we'll be able to join again

MikeMcG
20th February 2017, 17:06
any update on the ETA for the S+ mod to be updated on the Ark server for TheIsland?

Panda
20th February 2017, 17:54
Hi Guys,

Island Server Update would be awesome!!! Any idea when back up?>

Lot of frustrated crack addict arkanites hahaha

:)

Thankyou

InsaneJ
20th February 2017, 19:07
Try it now.

Panda
21st February 2017, 09:13
Many Thanks for the help! all sorted and running as smooth as ever :)

Moralawl
22nd February 2017, 08:59
Good day to you mods!

The S+ mod had another update today and the server is yet again unavailable for joining on.:)

Awaiting your action,
An ARK addict

InsaneJ
22nd February 2017, 12:04
Restarted the servers. That should have triggered an update. Try it now.

Panda
26th February 2017, 13:02
Hi guys, possible to update server please? Friends can't join

dentodili
26th February 2017, 14:14
Waiting eagerly for the server update :D Cant wait to play on the new patch !

InsaneJ
26th February 2017, 15:28
I have restarted the server which should have triggered the update. Try it now.

MikeMcG
26th February 2017, 15:29
firstly, thanks for updating the server but a suggestion for next update guys. If you have people on the server when you are about to update it can you at least give them a warning? We were on the server when a message came up saying "saved world, see you on the other side" and the server went down.

One of our guys were out on the pteradon, our high level one i'd like to add, when the server went down. There's a good chance we may have lost that now.

Panda
26th February 2017, 16:19
Server still offline?

Moralawl
26th February 2017, 16:54
Server still offline.

dentodili
26th February 2017, 17:05
Please update the server and turn it on, my wife needs her dinos :D

MikeMcG
26th February 2017, 17:35
any ETA on when server will be up?

MikeMcG
26th February 2017, 17:36
also there was another update to 255.1 so you may need to restart it to get that please

Panda
26th February 2017, 18:51
Guys restart did not work. Server has now been down 4 hours. Please fix!!

MikeMcG
26th February 2017, 19:51
c'mon lads, it's just a 90mb update needed for the server and we can play again :/

joeyjojo800
26th February 2017, 20:14
c'mon lads, it's just a 90mb update needed for the server and we can play again :/
c'mon lad, it just takes 10 second to look if the server is online... it is online already :p

MikeMcG
26th February 2017, 20:43
c'mon lad, it just takes 10 second to look if the server is online... it is online already :p

it also takes 10 seconds to realise you posted 20 mins after I posted ........................... but hey, don't worry about that, just go ahead and try and make someone else look stupid, it's all cool

Jiro_89
26th February 2017, 21:03
A second restart for The Island seems to have fixed things.

Panda
27th February 2017, 16:23
Good Afternoon,

Firstly may I say your Island server is where me and my friends play. We are having a great time and appreciate the work you've put into the server. Probably one of the finest servers we have played on.

Yesterday the server went down for what seemed like an eternity to an ark player!! I totally appreciate you guys are US based and we are UK based so the time zones mess everything up. Hence the normal 6 hour lag behind normally. That's not my issue.

The issue I have was yesterday the server restarted I believe around 15:40hrs UK time. At the time I was out flying on my 402 Pternadon and all of a sudden, A message came up something along the line of " game world saved, see you on the other side" and it was then immediately down.

We then had about a 5 hour wait until we could log back on, ( again I get why). However when I logged back in, I was dropping to the floor and immediately died. We then had to organise a search party to find our best Flyer. Now we did find it and I managed to retrieve my gear also. after an annoying 3rd person search :)

All I'm asking for if possible. Is next time can we at least have a bigger timed warning. This way if we are flying we can get them to a safe place to land on etc...

And finally on a very minor note. my friends and I are all above 18. Now I get not everyone on the server is. and I respect your server rules of no swearing etc... I wont lie to you though we all swear like troopers. at each other jokingly as friends do in TeamSpeak. Now as you know one of my Friends when first joining the server a couple of weeks ago. Made a character named BitchFace. haha stupid name really but its a personal joke between us. He was renamed to Unhappyface which is more than fair enough, within your rules. However May I make a request his name is infact changed To Project92. Just a minor request :)

Once again cheers for hosting our new home :)

Jiro_89
27th February 2017, 21:50
Thank you for your input. We have a couple of different ways to update servers, the simplest being a special update script I made. There are two versions of this script, an auto update no warning version and a 10 minute warning version. Typically if I see people on the server when I'm going to update it I activate the 10 minute warning script. I'm pretty much the only admin that takes care of all of the ARK server problems. That being said, as you guessed I'm US based (west coast) so there is lag time when it's night here and when I'm at work. The servers and server owner are actually based in the Netherlands. InsaneJ (the owner) helps take care of restarting the server in the event that I'm not online by using the update scripts I mentioned. It sounds like he may have used the no warning update script, which I'm sure was not an intentional ploy to get you guys kicked off your dinos and killed. Accidents happen, and it sounds like it worked out as you were able to find the dino and body.

Regarding the 5 hour delay between the two server restarts, the server decided to start up with an error. There was no rhyme or reason and it happens, rarely. The Scorched Earth server started up in the same way at the same time and ran just fine. After a second restart of The Island it was running correctly.

And finally, your friend UnhappyFace. I would be glad to change his name to "Project92", but he needs to be online when I am online for the change to happen. To make things easier what is his steam username? It's much simpler to see who is online based on their steam username rather than ingame name. Taken care of

MikeMcG
17th March 2017, 09:42
you must be getting bored of us lot by now :D

there's been a small S+ update so people can't see the server if it's not been updated

Heptagon_ru
17th March 2017, 13:19
I can't stress enough the importance of praising Jiro for all the good he does!

Of course every active staff member needs praising, but historically they all was merged into one divine deity
(nice idea actually, need to make a statue with mixed skins from all staff members next time)

We did a lot for this on Minecraft servers: statues, shrines, signs, verbal praising, praising events, ...

Don't drop the torch, Arkenians!

Sincerely, :elmo:.

MikeMcG
17th March 2017, 17:45
we praise Jiro all the time, especially after he didn't kill us when we decided to have a peek in his base (although to be fair his inner turrets rinsed us which was funny)

Panda
17th March 2017, 18:37
Hi guys any update on the server being updated? Still down. Thank you

MikeMcG
17th March 2017, 20:04
I miss my ark :(

InsaneJ
17th March 2017, 20:58
I've just initiated the forced update scripts Jiro made that should give players 10, 5 and 1 minute warnings. If all goes well the servers should update after about 10 minutes and be back shortly after that.

MikeMcG
18th March 2017, 10:57
so there's been yet ANOTHER S+ mod update, due to the last one not really working. So, unfortunately, we can't see the server again :(

InsaneJ
18th March 2017, 14:46
I've initiated the updated scripts with 10 minute warning again.

The servers should be up now.

MikeMcG
20th March 2017, 09:15
yet ANOTHER s+ update ........... I'm begining to think these guys update more often than Ark and I never thought that would be possible :(

InsaneJ
20th March 2017, 09:34
And another update cycle started. Servers should be up again in about 15 minutes.

MikeMcG
20th March 2017, 09:37
awesome, cheers pal :D

your job never ends with S+ hey? lol

MikeMcG
21st March 2017, 10:08
another day another S+ update ............ lol

luckily I happen to have been on the server when it dropped so I'm still on but others can't get on :(

InsaneJ
21st March 2017, 11:23
Initiated another round of updates. Servers should be back in about 15 minutes.

MikeMcG
21st March 2017, 11:28
thank you

Kagehamaru
22nd March 2017, 06:52
There is another S+ update. I haven't logged out, but my friend can't log into ARK because of the update.

InsaneJ
22nd March 2017, 07:50
Another day, another round of updates :)

Servers should be back in about 15 minutes.

BTW, don't you guys sleep?

MikeMcG
22nd March 2017, 10:37
why sleep when you can ark????? :D

Panda
22nd March 2017, 13:40
Ark is love, Ark is life!!! :)

joeyjojo800
30th March 2017, 16:24
Hi,
I have noticed that the ARK servers are down. I went to ARK server search and it said it was online for 1 hour. Can it get fixed please?

Kind regards, Joey

InsaneJ
30th March 2017, 17:26
The servers should be up in a few minutes.

Panda
30th March 2017, 17:46
Thank you INSANEJ :)

Entire tribe cannot wait for the new Update!!

Horses YAYYY hahaha,

Will wait for it to be restarted.

Many Thanks

MikeMcG
30th March 2017, 18:10
it's a bit unusual as the new update hasn't been released yet so the servers shouldn't have gone down, any idea?

InsaneJ
30th March 2017, 18:32
I know exactly why the servers went down. If you're interested you can read all about it here :)
Server hardware stuff (https://happydiggers.net/showthread.php?2462-Server-hardware-stuff)

MikeMcG
30th March 2017, 18:36
awwwwwww, that's hillarious and cute at the same time :D

having a 6 year old daughter myself I know what it was like when she was younger and saw buttons (I swear if I were the president of the US she'd randomly nuke somewhere)

sounds cool on the upgrade to the server though :) looking forward to it :D

Kagehamaru
1st April 2017, 06:05
ARK Update, don't see server.
Server down.

InsaneJ
1st April 2017, 09:07
I've just started the update cycle. Servers should reachable for updated clients soon.

MikeMcG
4th April 2017, 15:44
hey guys, are your hosts having issues? I've been dropped from the server a few times today and when i try to refresh I don't see the servers for a while. I thought it was me until I also noticed that your forum keeps going down briefly too :(

InsaneJ
4th April 2017, 21:29
Our host has no issues at the moment. Earlier today there was a problem with one of the core routers of my provider which caused network disconnects. Currently there are no reported issues so let's hope that they fixed the problem.

MikeMcG
4th April 2017, 23:01
yeah, seems to be spot on pal, ta :)

MeMoR3x
9th April 2017, 15:53
The Center primitiv + Server is down:(

InsaneJ
9th April 2017, 19:30
Should be up now.

PoSack
24th April 2017, 05:21
The server isn't updated right now and has been down for a while from what I understand. Is there an eta on it coming back up?

InsaneJ
24th April 2017, 13:39
Update cycle with 10 minute warning has been started. The servers should be updated in about half an hour or so.

Chocolate Jones
11th May 2017, 04:42
Looks like the server went down :/

Jiro_89
11th May 2017, 04:56
Thank you for the report. Looks like the virtual server restarted without starting the Ark servers back up. The Ark servers are live again.

Chocolate Jones
11th May 2017, 05:06
No prob, I'm happy I could help!

Progamer192
22nd May 2017, 17:13
the center prim+ is down :(

Adan
22nd May 2017, 18:31
The Island is down as well, I think structures plus needs updating

InsaneJ
22nd May 2017, 20:21
I've initiated update cycled for all ARK servers with a 10 minute count down. They should be updated and running again in about 20 minutes or so.

Marvin
23rd May 2017, 05:55
:( The Center Prim + is down again :(

Thanks for help and have a nice day :o

Jiro_89
23rd May 2017, 07:52
:( The Center Prim + is down again :(

Thanks for help and have a nice day :o

Ark says the server is up and has been since J cycled the servers 11 hours ago.


Edit: Logged in just fine too.

Progamer192
23rd May 2017, 16:53
the center prim + is down again. from the site I use to show how many people are on ( https://arkservers.net/server/84.245.27.221:28015 ) sorry if I'm not allowed to post links, but that site says that it is online but it doesn't show up in ark :confused:

Progamer192
23rd May 2017, 18:15
the center prim + is down again. from the site I use to show how many people are on ( https://arkservers.net/server/84.245.27.221:28015 ) sorry if I'm not allowed to post links, but that site says that it is online but it doesn't show up in ark :confused: I just tried logging in using that site, something came on my screen. it appears that the S+ mod needs another update 3304

InsaneJ
23rd May 2017, 19:32
I've initiated another round of updates with 10 minute count down. The servers should be back and fully updated in about 20 minutes or so.

Progamer192
23rd May 2017, 19:55
Server is back online :D

Topsnek
26th May 2017, 20:14
Ark - Island server down

Jiro_89
26th May 2017, 20:54
The Island is back up.

Marvin
30th May 2017, 06:37
Good Morgning

The Center Prim + Server down?

Or become a update and restart?

Thanks for help

Jiro_89
30th May 2017, 09:16
All Ark servers updated.

Epimetheus
30th May 2017, 13:09
and already down again because of patch 258 ^^

InsaneJ
30th May 2017, 17:18
I have initiated server updates with a 10 minute warning. The servers should be accessible again in about 20 minutes.

Progamer192
30th May 2017, 19:07
no idea how but the center prim + got wiped?

Gamerstieno1
30th May 2017, 20:36
The center prim+
i logged in on the server see no bed to spawn and i go to the base location and everything is gone
Do you have a back-up maybe?

thx

Jiro_89
30th May 2017, 22:31
Looking into this.

Jiro_89
30th May 2017, 22:55
The Center Primitive Plus has been fixed. The server has been reverted back to the earliest save from May 30th, before the latest update. All personal player progress and current up to date tribe logs remain unaffected as the world save is separate from character/tribe saves.

Chocolate Jones
15th June 2017, 03:54
I think the scorched earth server is down.

Jiro_89
15th June 2017, 04:01
The Ark servers went down while InsaneJ did some server maintenance. Starting them back up now.

MeMoR3x
15th June 2017, 09:14
Everything is gon we haf this issue several times now normaly the stuff is back after a while but now it is 1 and a half day and everyting is gone can you play the last server back up above it

Jiro_89
15th June 2017, 10:18
Everything is gon we haf this issue several times now normaly the stuff is back after a while but now it is 1 and a half day and everyting is gone can you play the last server back up above it

Thank you for the report. These sorts of issues need to be reported right away, not a day and a half later. I don't visit every server after every update so it's important that people let me know when something is wrong.

The ark developers have changed how servers are initiated in some way and have not made any change notes regarding it. It seems to be causing the servers to not load the correct map save file, more so primitive plus than the other servers but it has happened on Scorched Earth as well so it's not an isolated issue. My guess is it has something to do with the order of operations in spooling the servers up since primitive plus has a much longer startup process requiring loading of all that extra content.

I'm working on fixing the map. This takes some time as I have to troubleshoot the correct map save (harder to estimate the longer the server has been up with a bad map), and also takes time updating Ark and loading in primitive plus.

Jiro_89
15th June 2017, 11:10
The Center Primitive Plus is back up and running with the original server map.

Chocolate Jones
22nd June 2017, 07:26
Hey guys, I think scorched earth might be down.

Jiro_89
22nd June 2017, 08:21
Structures Plus needed updating. All servers should be back up in a few minutes after running updates.

Chogata
30th June 2017, 15:44
Can't see any of the servers. I guess it has something to do with my ark being version 260 now...

InsaneJ
30th June 2017, 16:29
I've just initiated an update cycle with 10 minute warning. The servers should be available to up-to-date clients again soon.

Gamerstieno1
7th July 2017, 14:07
why are the servers offline (ark the center and ragnarok)

Epimetheus
7th July 2017, 15:06
Patch, servers arent up to date = you cant join

Gamerstieno1
7th July 2017, 18:59
When they gonna update it than?
its already 8H offline

LegendOfAir
7th July 2017, 20:31
Please be patient, once the administrators are available they will resolve the problem.

Jiro_89
7th July 2017, 21:03
I've just initiated an update sequence on the Ark servers. They should be back up in a few minutes.

Dourne
13th July 2017, 03:39
servers down

InsaneJ
13th July 2017, 10:05
Should be up now.

Vikusha
22nd July 2017, 22:04
It seems Ark has an update , in which we need to update the server so people can join back in. :o

InsaneJ
22nd July 2017, 22:12
I've initiated a round of updates for all the servers with a 10 minute warning. My client tells me the update is 2.1GB in size so it may take a little while for the servers to update and become available again.

Dourne
26th July 2017, 01:19
appears Rag server went down.

and came back up 10 min later. no warning.

Jiro_89
27th July 2017, 09:21
appears Rag server went down.

and came back up 10 min later. no warning.

Not sure, I didn't see anything peculiar on the server when I took a look.

Epimetheus
15th August 2017, 19:54
Island Server is down

Jiro_89
15th August 2017, 20:17
Started a round of updates. All servers should be updated and running in 10-15 minutes.

Dourne
23rd August 2017, 16:13
unable to connect to Ragnarok. got on the island fine but Rag may need an update.

Jiro_89
23rd August 2017, 17:09
They released another non-backwards compatible version update for Ragnarok. Servers are being updated.

Chogata
28th August 2017, 16:44
My Ark just updated and I can no longer connect to the servers. Major number change.

Vikusha
28th August 2017, 17:28
My Ark just updated and I can no longer connect to the servers. Major number change.

They are updating again. It seems another change will come. Happydiggers servers might need update as well.

Jiro_89
28th August 2017, 21:01
Ark servers updating to version 266.0.

Nezz
30th August 2017, 18:26
Oi there, is it only me and my super shitty connection or the Ragnarok server is down? Casue you know, my carrots are whitering! ^__^

Chogata
30th August 2017, 19:30
Yeah, Ragnarok is down. The others are there...

Jiro_89
30th August 2017, 21:01
Ark servers are being updated. Ragnarok should be back up in 15 minutes or less.

Vikusha
15th September 2017, 06:14
servers are not showing up in ark list, using the links to join servers show : unable to query the server for invite. I believe server update needed.

Jiro_89
15th September 2017, 07:19
Ark servers have been updated.

DutifulComet
17th September 2017, 17:56
The Ragnarok server does not show up in the server list and is also mentioned by BattleMetrics as being offline

InsaneJ
17th September 2017, 18:54
The Ragnarok server does not show up in the server list and is also mentioned by BattleMetrics as being offline
I've initiated an update cycle with 10 minute warning. Servers should become available for updated clients soon.

DutifulComet
17th September 2017, 18:58
I've initiated an update cycle with 10 minute warning. Servers should become available for updated clients soon.

There isn't an update afaik as the servers were already running on 269.0, the SE and The Island servers are still online, while the ragnarok one isn't

InsaneJ
17th September 2017, 19:01
The update cycle should also stop/start the server. So if the server has crashed this should restart it.

DutifulComet
17th September 2017, 19:25
The update cycle should also stop/start the server. So if the server has crashed this should restart it.


All 3 servers now offline, I guess the update cycle has stopped?

Zen
17th September 2017, 20:00
Sup'

2hrs downtime : starting to look like a technical failure...

Jiro_89
17th September 2017, 20:08
Ark servers are back up.

Khajera
26th September 2017, 12:48
So something happed in the last 2 1/2 hours. Didn't show server on my server list, went to the direct logins and tried Ragnarok and The Island and get the mod mismatch thing. I think I am going to let Dourne raise my babies from now on LOL That's what I get for trying to nap when I know I should stay awake. Being overnight sucks. Just wanted to give you guys an FYI. I know not what you want to see when you get up.

Have a good day??
<3

Jiro_89
26th September 2017, 15:33
I figured there would be another S+ update soon after the most recent release to fix issues it might have. Servers updated.

Zen
26th September 2017, 19:22
Yup'

Is there any trouble concerning Ragnarok server ? I can see it in my Steam's server list but not in game. Any attempt to connect from Steam fails. I still see 5/70 connected people from Steam's list. What could be wrong with me (S+ mod up to date) ?

Jiro_89
26th September 2017, 19:35
New version update is available. I've initiated the 10 minute warning update cycle.

Zen
26th September 2017, 19:39
Well thank you ;)

Chogata
27th September 2017, 16:08
I can't see the servers. Another update? ;)

Zen
27th September 2017, 19:41
Hello,
Looks like we got an update, server isn't showing up on my in-game list. Sorry, everytime the same for me.
Edit : This is a S+ mod update. If I uninstall the mod, I can attempt to connect to Happy's server but i'm still downloading the latest mod version, which makes me unable to join server.

Jiro_89
27th September 2017, 21:58
S+ had another update released. Ark servers are updating now.

Zen
27th September 2017, 22:15
Thank you :)

Dourne
28th September 2017, 02:11
just got zero servers on my list. they go update crazy today?

Jiro_89
28th September 2017, 05:54
just got zero servers on my list. they go update crazy today?

Yep, lots of updates. Is your client up to date? There is a new update as of this post but it's just a minor version change to Ark which shouldn't affect the ability to join.

Jiro_89
28th September 2017, 06:19
Updated the servers again for good measure. The latest minor version update is for Ragnarok spawns and previous Ragnarok updates have not been backwards compatible. Even though the patch notes don't say it's not backwards compatible, that could be the issue.

Dourne
29th September 2017, 02:33
server isnt down but i tried direct connect to the server right now with 3 people currently playing and got a mod mismatch error. still not listed in my favs.

Jiro_89
29th September 2017, 02:41
Another S+ update. 10 minute update cycle initiated.

Khajera
3rd October 2017, 03:49
Another mod update, can't log in. Tried to join Vik's game and got message server not responding. :( And yes ....I'm raising babies again.

Jiro_89
3rd October 2017, 05:18
Ark servers updating.

Jiro_89
5th October 2017, 04:45
Just a heads up for all staff:

All structures plus servers are experiencing fatal errors when restarted or updated. If our Ark servers go down for any reason do not update them at this time. If it's a structures plus update it would likely be about fixing the current issue and is okay to update. If it's a major game build update I'll have to do it myself as it will require removing specific files from the structures plus mod and troubleshooting crashed save files.

I'm expecting a fix for this very soon, many servers are reporting this problem and the Structures plus developer is working on a solution.

InsaneJ
6th October 2017, 08:37
I've changed the Windows Update settings on the ARK server so it doesn't automatically install updates. This should prevent the server from unexpectedly rebooting.

Once this ARK issue is resolved I'll set it back to full auto mode.

BrittPiiqen
6th October 2017, 12:05
I've changed the Windows Update settings on the ARK server so it doesn't automatically install updates. This should prevent the server from unexpectedly rebooting.

Once this ARK issue is resolved I'll set it back to full auto mode.

Cant find the server. Me and a friend have been playing a few days on the server. And now its just gone? Update or?

DAoshy
6th October 2017, 12:34
yup, either servers are down or i can;t see them for the past 6h :( my babies definitely dread ^^ and this forum is like lagging so bad too ;)

Jiro_89
6th October 2017, 12:43
yup, either servers are down or i can;t see them for the past 6h :( my babies definitely dread ^^ and this forum is like lagging so bad too ;)

One of the mods updated. Your lag has nothing to do with Ark servers appearing offline (which they're not).

BrittPiiqen
6th October 2017, 12:59
One of the mods updated. Your lag has nothing to do with Ark servers appearing offline (which they're not).

If its not appearing offline, then why cant i see it? And do you know when it Will be fixet? Or is there anything i can do so i can join again?

Jiro_89
6th October 2017, 13:06
I meant that they're not offline. Ark servers only appear offline to your client if a mod or the game updated. You can easily view an Ark servers' status on the steam server list or on 3rd party Ark server listings.

Please refer to my earlier post.


Just a heads up for all staff:

All structures plus servers are experiencing fatal errors when restarted or updated. If our Ark servers go down for any reason do not update them at this time. If it's a structures plus update it would likely be about fixing the current issue and is okay to update. If it's a major game build update I'll have to do it myself as it will require removing specific files from the structures plus mod and troubleshooting crashed save files.

I'm expecting a fix for this very soon, many servers are reporting this problem and the Structures plus developer is working on a solution.


Protected Passives updated. I've already tested updating one of the Ark servers. It was hit with a fatal error. Until I can diagnose what specific part of S+ is causing it in each server they will remain uplayable. This is happening to all unofficial servers running S+ and is completely random. It's currently 4 AM where I am right now. A problem like this can take hours to diagnose and fix. We'll see how far I get.

Chogata
6th October 2017, 13:18
Protected Passives updated. I've already tested updating one of the Ark servers. It was hit with a fatal error. Until I can diagnose what specific part of S+ is causing it in each server they will remain uplayable. This is happening to all unofficial servers running S+ and is completely random. It's currently 4 AM where I am right now. A problem like this can take hours to diagnose and fix. We'll see how far I get.

You mean they are unplayable to everybody who has automatic updates and PP already updated? If I force Steam not to update, I will still see the servers?

Jiro_89
6th October 2017, 13:21
Ark client updates are automatic. There's no way to stop them. The only way around it is to not exit your client at all.

Jiro_89
6th October 2017, 13:31
Scorched Earth is back up. All S+ metal storage boxes were deleted.

Chogata
6th October 2017, 13:45
Ark client updates are automatic. There's no way to stop them. The only way around it is to not exit your client at all.

Not true. You can pause the install download in steam and run ark manually from its folder. Harder to do with workshop, as mods are small and usually update very fast.

(Theoretically you can also set Steam not to update your stuff manually at all, but for some reason I cannot switch this option...)

Jiro_89
6th October 2017, 13:48
I've been playing Ark since it first came out and used to use that method. It's not a 100% guaranteed method as steam can still force you off. Mod updates are separate from steam client updates. If you load into the client you update in game. Loading the game from steam or from your file folders will still run the client as it is the game. Once you're on that title screen the mods will update, thus there's no way around it.

Jiro_89
6th October 2017, 14:19
Very bad news. I've identified the bad mod item for Ragnarok. It is S+ fridges. If I remove the file to clean the server save all S+ fridges will be removed from the server. Considering such an action would remove irreplaceable items from tribes I'm going to try an alternative way to fix it, but I'm not optimistic.

Jiro_89
6th October 2017, 14:56
Ragnarok is back online. All S+ fridges have been deleted and all contents of the fridges are gone. There was no way around it. Until the issue is resolved I suggest you use the vanilla fridges and vanilla storage containers. There may be a possibility of restoring the lost fridge content in the future when the mod and/or game developers fix the issue plaguing mods right now. It's 6 AM and I'm very tired. I won't be able to work on The Island server right now. That will have to wait until tomorrow.

InsaneJ
6th October 2017, 15:06
Thanks Jiro, you're awesome :)

Jiro_89
6th October 2017, 21:21
The Island is back up, no losses. Working on a way to recover the fridges on Ragnarok.

Jiro_89
6th October 2017, 22:28
I have identified the latest corrupted save from before the 271.17 version update and I'm running it on a second server slot. This save is 3 days old. Dino and player downloads are disabled and it's password protected. You will need to Private Message me on the forums and I'll give you the password to access the server. This sort of thing opens a lot of doorways for abuse so I'm only going to be allowing people to transfer stuff if I'm online with them. You have to join the server from the main menu, you won't be able to transfer to it in game. All items you upload will be available back on the regular Rag server. You'll have to login to the 2nd server, upload fridge items, log out, login to the main Rag server, and download the fridge items.

2nd Rag server IP: HappyDiggers.net:28015 (http://steam://connect/84.245.27.221:28015)

Jiro_89
7th October 2017, 04:08
Wildcard released an update that was supposed to fix these issues mods are having. I updated the Scorched Earth server by itself and it populated just fine. Afterwards I updated the other two servers. The Island updated fine. Ragnarok hit me with a fatal error again.