We do not currently know of any antonyms for palling around with.
For similar words to palling around with, try: