I wouldn't dump him but I'm sure we would slowly grow apart since I am not interested in going to church functions on a regular basis.

Maybe things have changed the last few years but I know that all of my relatives who are conservative are completely wrapped up in church functions... even their non-church activities are with their church friends. I have found that when people get really involved in church, they just don't have much time left over for anything else.