The past tense of go on the piss is went on the piss.
The third-person singular simple present indicative form of go on the piss is goes on the piss.
The present participle of go on the piss is going on the piss.
The past participle of go on the piss is gone on the piss.