The actor says that he doesn't want to push his luck & spoke about a far-right rally that left him and his team concerned.