The Governor or any former Governor of this state, any judge, city recorder, magistrate, minister, or other person authorized to perform the marriage ceremony who joins in marriage any couple without a license or the publication of banns shall forfeit the sum of $500.00, to be recovered and appropriated as set forth in Code Section 19-3-45.