The past tense of let on that is also let on that.
The third-person singular simple present indicative form of let on that is lets on that.
The present participle of let on that is letting on that.
The past participle of let on that is let on that.