The RockLogic GmbH validators, run as part of the Lido liquid staking protocol, failed to validate for a period of approximately 9 hours 30 minutes on June 9 2023. This impacted staking rewards on the Lido protocol.
9-6-2023 ~ 01:00 AM | ISP goes offline due to hardware failure
9-6-2023 10:29:59 AM | ISP fixed problem
To compensate for the missed proposals and attestations during the outage, RockLogic GmbH reimbursed the Lido rewards vault 3.1531 ETH.
Total value lost = 2x penalties + missed rewards
This is because penalties would have been rewards if not incurred, so total value lost is actual penalties plus opportunity cost of not operating correctly.
It was observed that stETH was sent to the EL rewards vault instead of ETH (which means it cannot be automatically handled by the protocol). Thus the reimbursement is not yet finalized.
On-chain ops and NOM contributors will work on a planned proposal to remedy the issue so that the reimbursement can be completed. As it will require an on-chain DAO vote, we will try to line it up with a scheduled omnibus vote.