Unplaned downtime due to file sync failure [resolved]
Posted: Sat Mar 26, 2016 8:13 pm
While trying to commit a small update my sync script messed up, and for some reason TC1 and live is not syncing properly and the live shard is failing to load the database. Nothing has been lost, but we are looking into why this is happening. Tried to restore a script backup but that is failing too. (backups are done with rsync as well, go figure)
The shard may be down for the next few hours, to even the next few days. If I can't figure it out by tonight, I won't be able to look at it till a week from now as I'll be with family tomorrow (Easter) and after that I start work.
I will post an update once some progress is being done. I'm still mostly investigating at this point.
Rsync has been the bane of my existence, it has a mind of it's own but it's really the only half decent app that has that function. One of these days I need to code a replacement.
Archived topic from AOV, old topic ID:6641, old post ID:38761
The shard may be down for the next few hours, to even the next few days. If I can't figure it out by tonight, I won't be able to look at it till a week from now as I'll be with family tomorrow (Easter) and after that I start work.
I will post an update once some progress is being done. I'm still mostly investigating at this point.
Rsync has been the bane of my existence, it has a mind of it's own but it's really the only half decent app that has that function. One of these days I need to code a replacement.
Archived topic from AOV, old topic ID:6641, old post ID:38761