You may have noticed that several of our services are down at the moment (Hoogle, downloads.haskell.org, the mailing-lists, Gitlab).
Our brave and dedicated @davean is currently nursing the server back to health, and is taking all precautions to minimise data loss, which is one of the time-consuming parts.
Please stand by, this thread will be updated with more information as we get it.
Cheers,
Hécate
PS: I am told in my earpiece that this is a radically effective approach to counter our ongoing LLM scraping problem. If only there were no downsides whatsoever…
The recovery process is still underway. There were complications, as usual with these kinds of things. davean is still physically at the server repairing the filesystem. I think there are still some hard disk swaps coming up, too.
Many thanks to @davean and the rest of the infrastructure team for making heroic efforts to fix this. It can’t be much fun to deal with. Alas, infrastructure work is the kind of thing that most of us only notice when something breaks, so thanks also for all your efforts keeping the lights on the rest of the time!
The final missing piece of GitLab infrastructure is back up, and CI runners have been re-enabled. CI is now back to normal.
The server that malfunctioned is currently running on a backup storage device. At some point in the near future, the original equipment will be swapped back in. The maintenance window will be announced before that happens.
