Some systems are experiencing issues

Stickied Incidents

27th November 2019

Dwellers Dwellers need to be reprovisioned. Affects Mastodon.

Still down: Mastodon, RabbitMQ, Notifications center, tools.nasqueron.org

2020-02-15 Development facilities like Docker build are ready to use

2020-02-14 A fresh CentOS 8.1 has been reinstalled through Salt.

2020-02-13 Upgrade RAM, new 1 To disk attached to avoid previous Mastodon issues.

2019-11-27 According to the servers log: 07:13 dereckson: Disk drives look corrupted. Attach a new 1 To drive to the machine. Install a clean CentOS 7 on this drive to recover data.

Past Incidents

31st March 2018

No incidents reported

30th March 2018

No incidents reported

29th March 2018

No incidents reported

28th March 2018

No incidents reported

27th March 2018

No incidents reported

26th March 2018

No incidents reported

25th March 2018

Dwellers Docker engine unresponsive for maintenance operations

Docker engine doesn't reply to any new request. That doesn't allow to run container for maintenance operations, like renew a Let's Encrypt certificate.

The Docker engine has been restarted at 16:47 UTC.

This restart wasn't handled very well by the iptables: containers daemons weren't reachable by front-end nginx. After a reset of the iptables configuration and a second restart of the docker service, the issue was solved.

At 16:55 UTC, all the containers worked again.

This doesn't affect the Docker containers running on Equatower.