Donmai

Issue with older pictures.

Posted under General

Should be working again. Our hosting provider (OVH) had a network outage and had to perform emergency maintenance. This happened while I was asleep. Our main image server was down during the outage. When it came back up, it didn't automatically mount the drives containing the images, so uploads were failing because they couldn't be saved to the image server.

There is a secondary image server, but I took it out of the CDN rotation about a week ago to test that we could run on only one server if we needed to. Unfortunately the main server went down during this time. Uploads still would have failed because images have to be saved to both servers for the upload to go through. There was no risk of data loss though because images are stored on multiple servers and backed up to multiple locations.

Show

Dear Valued OVHcloud customer,

Regarding your account

We are notifying you regarding an emergency maintenance for Vint Hill Server Rack V115B02 that will begin immediately. We will be taking rack V115B02 offline for the entire duration of the maintenance. We do not have an exact ETA, but will be working as fast as possible to get V115B02 back up. At this time we do not expect any impact on V115B01, but due the their close proximity we may need to take V115B01 offline as well. We unfortunately will not know this until we begin the work so we have notified you of a potential outage.

While we strive for efficiency, we also want to work safely. This maintenance will carry a 7-hour change window. During this time the rack will be powered down and your service will be unavailable to you.

https://news.ycombinator.com/item?id=28849319
https://status.us.ovhcloud.com/pages/maintenance/59dd23da8827c804746f1664/61672870e91909053f83ee9a

Updated

1