If a challenge to an individual grand juror is allowed, he cannot be present at, or take part in the consideration of the charge against the defendant who interposed the challenge, or the deliberations of the grand jury thereon.