dont hold it. Go immediately on square when you parry. Don't wait for the opponent to fall back on himself. Press the moment the parry connects.
What you describe indicates you are not quick enough on the timing. It is not really difficult though, so once you learn how to due it it will quickly catch up for you as almost natural I am quite sure.