The past tense of go off at a tangent is went off at a tangent.

The third-person singular simple present indicative form of go off at a tangent is goes off at a tangent.

The present participle of go off at a tangent is going off at a tangent.

The past participle of go off at a tangent is gone off at a tangent.