What get inverted, or turned over in a thermal inversion?

In normal atmosphere, temperature decreases with increasing altitude ...

it gets colder as you go up.

During relatively unusual conditions, a mass of warmer air sits on top of

the cooler air below. The temperature increases with increasing altitude ...

it gets warmer as you go up.

That's the unusual, abnormal situation, called a "temperature inversion".