etcd
Recovery of etcd failing node
· ☕ 2 min read · 🤖 Alexander Chernov

One of my etcd nodes in my home k8s cluster has been failing with following message:

2021-01-14 11:16:09.233458 I | embed: listening for peers on 192.168.0.33:2380
raft2021/01/14 11:16:09 tocommit(29492601) is out of range [lastIndex(29492469)]. Was the raft log corrupted, truncated, or lost?
panic: tocommit(29492601) is out of range [lastIndex(29492469)]. Was the raft log corrupted, truncated, or lost?

These are steps I took to fix it: