The past tense of keep at bay is kept at bay.
The third-person singular simple present indicative form of keep at bay is keeps at bay.
The present participle of keep at bay is keeping at bay.
The past participle of keep at bay is kept at bay.