We do not currently know of any antonyms for primary residence.
The noun primary residence is defined as:
The dwelling where a person usually lives. A person may have only one primary residence at any given time, which is used for legal purposes such as determining where a person votes or pays taxes.