The past tense of let yourself go is also let yourself go.
The third-person singular simple present indicative form of let yourself go is lets yourself go.
The present participle of let yourself go is letting yourself go.
The past participle of let yourself go is let yourself go.