Is he under stress or have something on his mind, too busy?
Does he watch porn?
How often were you having sex with him at the start of the relationship?
I mean, at the start of the relationship a lot of people's sex drive is high, but it gradually decrees, but this depends on the relationship.
It could relate to health issue, but not sure...since he can get hard, but doesn't last long...