Reyes said he ‘apologized’ to the women that his relationship with Ballard made them feel ‘powerless and without a voice to fight back’