Still feel a little weird

[Blue]

Nothing is wrong with you, those doubts and the associated feelings are a product of your upbringing, the garbage about homosexuality being wrong, dirty, sinful and bad. You were taught, at an impressionable age, that both homosexuality and sex outside of marriage were dirty, perverted, etc..

Now, you've gone and done both and the part of your subconscious that still has those incorrect ideas locked in it is trying to argue with you. As annoying and, confusing as it feels, it's your chance to reprogram those ideas, correct the incorrect information in there. Yes it takes a few tries, but don't let that discourage you from enjoying your new relationship in the least.