Stickied Incidents

27th November 2019

Dwellers Dwellers need to be reprovisioned. Affects Mastodon.

Still down: Mastodon, RabbitMQ, Notifications center, tools.nasqueron.org

2020-02-15 Development facilities like Docker build are ready to use

2020-02-14 A fresh CentOS 8.1 has been reinstalled through Salt.

2020-02-13 Upgrade RAM, new 1 To disk attached to avoid previous Mastodon issues.

2019-11-27 According to the servers log: 07:13 dereckson: Disk drives look corrupted. Attach a new 1 To drive to the machine. Install a clean CentOS 7 on this drive to recover data.

Past Incidents

28th October 2017

No incidents reported

27th October 2017

No incidents reported

26th October 2017

No incidents reported

25th October 2017

No incidents reported

24th October 2017

No incidents reported

23rd October 2017

Mastodon Mastodon upgrade process

We're upgrading database schema for the Mastodon 2.0 upgrade.

19:20 UTC: -> Migrated 1215000 rows (~66.61%, 2:45 remaining, safe to interrupt)

19:26 UTC: -> Migrated 352000 rows (~19.30%, 5:53 remaining, safe to interrupt) --- this one is a second big migration to do

19:39 UTC : -> Migrated 35000 rows (~1.92%, 17:08 remaining, safe to interrupt) --- and here the third

20:02 UTC: -- Migrating mentions.id_cm (~1111610 rows) is done

20:09 UTC - Database migration is done.

20:13 UTC - Mastodon instance restarted.

22nd October 2017

No incidents reported