The past tense of keep upright is kept upright.

The third-person singular simple present indicative form of keep upright is keeps upright.

The present participle of keep upright is keeping upright.

The past participle of keep upright is kept upright.