Potential Shard Revert - Guilds did not save correctly.

Red Squirrel · Post by **Red Squirrel** » Thu Jul 30, 2015 6:22 pm

I really hate to do this, I always promised it's something I would never do, but for some reason all guilds have been corrupted. They are completely gone. I will experiment in the test environment with backups to see if they return. If yes I may have to revert to that version of the backup. Very sorry to have to do this but I'm sure it's better that then everyone loosing their guilds.

I will update this with plans once I figure out what is going on.

Archived topic from AOV, old topic ID:6580, old post ID:38437

Red Squirrel · Post by **Red Squirrel** » Thu Jul 30, 2015 6:54 pm

Unfortunately the latest backup I have is Wednesday July 28 at 6:10am. The Thursday backup never ran because that disk image was taking bloody ages and I had to go to bed and let it go overnight, and everything after that is going to be corrupted anyway.

I'm currently testing it in dev but looking at the actual SQL data it looks good. So I will probably end up having to revert to that date unfortunately. I will look into doing something to compensate.

Archived topic from AOV, old topic ID:6580, old post ID:38439

Red Squirrel · Post by **Red Squirrel** » Thu Jul 30, 2015 6:58 pm

This backup seems to check out. I will be starting the revert shortly.

Archived topic from AOV, old topic ID:6580, old post ID:38440

Red Squirrel · Post by **Red Squirrel** » Thu Jul 30, 2015 7:07 pm

Shard revert is complete. Used the July 28 6:10am backup. Guilds are now back, but we lost several days of progress. I will try to think of something to compensate. Open to ideas. Sorry about this. I have some suspicious as to the cause, so it should hopefully not happen again.

Could everyone confirm that this backup is really the 28th? Ex: do you have stuff that you know you had before then? I just want some reassurance.

Archived topic from AOV, old topic ID:6580, old post ID:38441

Ixxie · Post by **Ixxie** » Thu Jul 30, 2015 10:10 pm

Red Squirrel wrote:I just want some reassurance.

Everything is shiny

Archived topic from AOV, old topic ID:6580, old post ID:38442

Ixxie · Post by **Ixxie** » Thu Jul 30, 2015 10:27 pm

It's definitely not the 28th. It's probably around a week lost. But it's ok. You fixed it

Archived topic from AOV, old topic ID:6580, old post ID:38443

Red Squirrel · Post by **Red Squirrel** » Thu Jul 30, 2015 10:30 pm

Crap that's not good then, it means the backup dates are all wrong, it's not putting the right date when it's doing the backup. The backup date on this backup said the 28th.

Archived topic from AOV, old topic ID:6580, old post ID:38444

Ixxie · Post by **Ixxie** » Thu Jul 30, 2015 10:46 pm

Do you want wine? i have wine. Actually lots of it.

Just breathe.

Archived topic from AOV, old topic ID:6580, old post ID:38445

Red Squirrel · Post by **Red Squirrel** » Fri Jul 31, 2015 1:09 am

If this is not working right it means ALL my network backups arn't working right, since the same script is used across the whole network. So it really concerns me if this does in fact turn out to be an older backup because the date associated with it says the 28.

I should go to bed I start at 7am tomorrow, yuck, but this is going to seriously bother me that the backups arn't working right. Everything looks fine when I look at the scripts.

Archived topic from AOV, old topic ID:6580, old post ID:38446

Ixxie · Post by **Ixxie** » Fri Jul 31, 2015 1:11 am

Ugh. Ok. You can turn a little blue now. Because this is very very definitely an older save than the 28th

Archived topic from AOV, old topic ID:6580, old post ID:38447

Red Squirrel · Post by **Red Squirrel** » Fri Jul 31, 2015 1:20 am

Going to rerun the revert... I wonder if I misstyped something the first time... I could have sworn I saw a bag in Luna on the ground at one point and when I ran the restore in test that bag was still there, but on live the bag was not there, I assumed it just decayed but now I'm having doubts, maybe I restored the wrong database.

Archived topic from AOV, old topic ID:6580, old post ID:38448

Red Squirrel · Post by **Red Squirrel** » Fri Jul 31, 2015 1:27 am

Did another revert let me know how this looks like. I have a better feeling.

I think I originally accidentally restored the wrong DB file.

I will be looking into providing proper compensation for this issue. It was mostly my fault, had I opted to not bother to do a backup image of the server it never would have needed to be shut down.

Archived topic from AOV, old topic ID:6580, old post ID:38449