Why is Catholicism considered the closest denomination to Paganism when it has guilt involved?

That Pagans don't believe in and that other Christian denominations don't adhere to. The mysticism is the only related tie there and even that is a stretch.