Martin Amidu's issues against me go beyond legal matters – Ayariga suspects