Letting go is like getting a tooth pulled out by a dentist. Pull it out, you're relieved. But how many times does your tongue run itself over the spot where the tooth once was? Probably a hundred times a day. Just because it wasn't hurting you doesn't mean you don't notice it. It leaves a gap and sometimes you see yourself missing it terribly. It's going to take time.

Should you have kept the tooth? No, coz it was causing you so much pain. Let go :-(