Should i let mt ex see his daughter?

my ex (we were never married) and i have an 8month old child, he physically and mentaly abused me for over two years, cheated on me, and abandoned us. now that i am finally away from him with my child, he wants to see her. i can not deal with him, i am scared of him, i do not believe in a restraining order, because that would just fuel the fire, so to speak. yesterday because i blocked his number (he calls me at least 50 times a day) he called DSS/CPS on me for neglect and abuse, i am a stay at home mother living with my father, i dont do even do anything besides take care of my child. he has become obsessed with me. i am sure his next step is to go to court, i need legitimate reasons he can not see my daughter, that the court cant just dismiss my saying he is enrolled in anger management or something like that.... please help me i dont know what to do