The past tense of pretrain is pretrained.
The third-person singular simple present indicative form of pretrain is pretrains.
The present participle of pretrain is pretraining.
The past participle of pretrain is pretrained.