Postmortems
Blameless write-ups of what the system and the process allowed, with action items that prevent, detect or mitigate a recurrence. The GitHub repository is the single source of truth; drafts open as pull requests.
Loading…
Blameless write-ups of what the system and the process allowed, with action items that prevent, detect or mitigate a recurrence. The GitHub repository is the single source of truth; drafts open as pull requests.
Loading…
Contributing factors across 16 postmortems. Select one to filter.
What the postmortems asked for, and how much is done.
56%done
Postmortems per day, by severity.
A planned rotation of the L2 web3signer keys (CHG-01) mounted the new key files under the old Secret name; web3signer restarted with 2 of its 4 keys and blob submissions paused 26 min.
After the security programme was rolled back (02:01–02:08, every pod restarted), an end-to-end run showed the W3 withdrawal waiting 36 min for finalization, and the gap between L2 head and finalized block kept growing (486 at 02:53, 1,087 at 04:13). Two independent causes were found.