We do not currently know of any antonyms for pay a brief visit to.
For similar words to pay a brief visit to, try: