News about OpenStack
Storage outage on 22.08.2025
Monday, August 25, 2025 in OpenStack
Flapping OSDs Starting at 22.08.2025, 18:00, we noticed flapping OSDs. OSDs are Cephs storage daemons, where each daemon handles a specific disk in our cluster. So the Ceph OSD storage processes were marked down periodically. Around 70 of 1710 OSDs …
Security issue on 28.07.2025
Sunday, August 24, 2025 in OpenStack
Discovery We were notified by IVV5 about a potential security problem. They noticed wrong permissions on their directories: The group u0mitarb had permissions rwxs. We quickly found, that many directories, including the /usershare and …
Service outage on 02.07.2025 at SP4
Saturday, August 23, 2025 in OpenStack
Introduction There was a power maintenance on 01.07.2025 at around 22:30 which caused a single power line to fail. All hardware kept running, but we have seen the following issues, which caused a total outage: General slowness during power …