The ballot with the name of a juror who is absent when the juror’s name is drawn or called or is set aside or excused from serving on that trial must be again returned to the box containing the undrawn ballots as soon as the jury is sworn.