The past tense of rejoy is rejoyed.
The third-person singular simple present indicative form of rejoy is rejoys.
The present participle of rejoy is rejoying.
The past participle of rejoy is rejoyed.