The past tense of throw caution to the winds is threw caution to the winds.
The third-person singular simple present indicative form of throw caution to the winds is throws caution to the winds.
The present participle of throw caution to the winds is throwing caution to the winds.
The past participle of throw caution to the winds is thrown caution to the winds.