If the church that you are attending is making your husband uncomfortable, there might be another church that the both of you can agree upon.  The important factors that Pastor Mark shares with those who are looking at churches is the "4 F's"

FED - Are you being taught God's word?
FRUIT - Are you being used by God at your church?
FELLOWSHIP - Are you attending Bible Studies, prayer groups and other activities with other Christians?
FIT-IN Do you feel comfortable at the church you are attending?

It sounds like your husband doesn't feel like he fits in.  If after visiting other churches your husband just seems to be desiring to not go to church or fellowship, then you must serve the Lord and make sure you are attending a fellowship that feeds and fulfills you.