If you play on PC like me, then yeah, it is really really hard to get it done.
It does work, like 1 times out of 10. The gards are not even in open conflict or anything, and Connor just run through...