We do not currently know of any antonyms for rectory.
The noun rectory is defined as:
See full definition of the word rectory.
Did you mean rector or rectors?