The past tense of lay the first stone of is laid the first stone of.

The third-person singular simple present indicative form of lay the first stone of is lays the first stone of.

The present participle of lay the first stone of is laying the first stone of.

The past participle of lay the first stone of is laid the first stone of.