Sorry to hear of your troubles but: There isn't anything we can do to help you. You've done the right thing by filing for your rights to see your child. I do hope you've been keeping up with your child support payments because that too will be looked at during your custody hearing(s).
Where are your parents in all of this (do they not want to see their grandchild too? Also: Why did you break up. I'm sure there is much more to it then the strain of having had a fire which meant you couldn't live under the same roof temporarily.
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion