We do not currently know of any antonyms for having affection for.
For similar words to having affection for, try: