.... is it my fault? How do I deal with this?

that sucks. but it sounds like your the victim here. you did say the guy was on top of YOU. not the other way around. DONT GIVE UP ON YOUR LOVE