I took this to mean that he was not only going to do me harm...

I took this to mean that he was not only going to do me harm but also do harm to my parents.