If a juror be absent when his name is drawn or be set aside, or excused from serving on the trial, the ballot containing his name must be folded and returned to the box as soon as the jury is sworn. R.L.1910, § 5832.