We do not currently know of any antonyms for person of the cloth.
For similar words to person of the cloth, try: