We do not currently know of any antonyms for having a great time.
For similar words to having a great time, try: