You deserve better than this, girl! Now, he won't tell his family he's "gotten back together with you". That's because he's got something to hide -- like another woman, one that his family does know about.
You are wasting your precious time with this guy! Dump him, change your number and don't have any contact with him again. He's a loser and it would be really sad if you let him drag you down, too!