Should I take him back?

this wasn't a good relationship to start with. What makes you think it'll be any different now especially when you don't even love him anymore? Give it up. You'll meet a guy that you won't have to ask anyone about. He'll treat you right and he'll make you feel good and neither you will have any desire to cheat. That's what you need, not some childish on again off again relationship. You need a real man who knows how to treat a woman.