The past tense of get under your skin is got under your skin.

The third-person singular simple present indicative form of get under your skin is gets under your skin.

The present participle of get under your skin is getting under your skin.

The past participle of get under your skin is gotten under your skin.