Looking on the bright side, at least it is not a fidelity issue.
As for whether he love you more and can show care n concern for you, maybe you need to work out with him on his true and real feelings about you.
Also, what made you fall for him during your courtship days and what are his strong points or strength that made you decide to be with him?
Do evaluate and analyse from both the good and bad, rather than simply looking at his flaws or weaknesses.
Do make an effort how best to work out the solutions with him so that you dont't feel so resentful or faithless in your marriage.
Have a heart to heart communication with him moving forward and come to some mutually agreed solutions.