Based on that, you are essentially challenging God and religions that have a heaven and hell. Surely there are some worthy of Hell, even if your views on it are that most offenders and enemies don't, surely you would agree that Stalin and Hitler deserve to go there?
If you had eternity to think about, you may well start feeling guilty. But of course, if you were in heaven you might have been prevented from feeling guilt or suffering by some magical soul-lobotomy.