While removing painful memories may be good, it's still something that we live by.
We learn from our mistakes. It's what often motivates us to do better.
Remove a memory, and we remove a part of ourselves.
What if a painful memory was connected to a wonderful memory? Remove that painful memory, and what was once wonderful... is no longer wonderful. 
