The past tense of rely is relied.
The third-person singular simple present indicative form of rely is relies.
The present participle of rely is relying.
The past participle of rely is relied.