Feeling like a selfish bastard...

[Baslero]

Well, I guess my case is quite common, typical case of couple with discrepant sexual needs..., I'm deeply in love with my man and I get an erection almost every time we kiss, but he's nothing through a good period in his life, recurrent pain from a recent back surgery, problems at work because they want to get rid of him because of this health problems, problems with his family, problems with his flat..., even problems with his pets..., I accepted my role in the couple as a kind of shoulder to lean on and cry..., i drive him, I clean, I cook, I do the shopping, I lend him money..., but nothing seem to be enough and when finally I think there is some time for us, there seem to be a problem in his mind and he rejects me...long story short..., after months of feeling rejected , unsatisfied and even frustrated, today I had the courage to have the big conversations that told him how I felt,and that I needed at least some time to share just the two of us, without the problems..., so at the end he resumed everything to "you are angry because we didn't have sex in one week, you are being for being so selfish and I feel I can't rely on you and tell me about my problems anymore..."
I'm I being that unreasonable and selfish to ask for some time to share the two of us as a couple without talking about problems...? That could do us a lot of good and give us strength to fight problems as a couple..., but he sees it like " you are angry for not getting sex..."
I hope you guys can give me an impartial opinion...