Should I just end this relationship?

I love my boyfriend to death, but i'm growing more and more frustrated with him. We're both 16 and i'm 2 months pregnant with his baby. He's extremely sweet and caring and loyal, but I have this problem with him. He never spends more then one full day with me. He gets homesick and is emotionally attached to his dad, who has been in and out of jail his whole life and who now has custody of him again. He constantly wants to spend time with his dad, but he needs to spend time with his pregnant girlfriend too. He's barely ever there to help me cope. I'm getting extremely frustrated, although he apologizes often for this I just NEED him to spend more time with me. What should be done here?