This could be some real trouble for both of you. In 2005 I still considered myself Christian when I married my ex. She still claims to be a believer today but she got to a point of telling me that what I was saying to her when I de-converted sounded true. By 2012 I was fully atheist. There will never be any going back because gods are imaginary.

If you both keep anger out of the picture your husband and yourself can get along. It's a matter of whether you think your best life is here while you are alive OR someplace in the sky or another dimension when you are dead. It really is that simple. Once you have people crying and praying for you because they don't want you to burn in hell, or concern about the children in an "unequally yoked" marriage it might be too late. You can see at this point that the church and the preacher is controlling the entire situation. The both of you need to be in control of your own lives for the sake of your family. This means all 4 of you and maybe more if others are born.

My best advice is stay away from Evangelicals like Pentecostal or Baptist. They live in a world that was not real over 2000 years ago and it is also not real today. Try a Lutheran or maybe a UU church. Make sure the church you go to is not going to have people claiming "god spoke to them" and somebody running around showing their ass while others claim they have the holy ghost. None of that crap is in the bible but people want to take everything so personally. Live your life for now even if the whole family goes to church. Do not get suckered into being told this is a "training ground" and your life starts once you are dead.