Are air temperatures over land always higher than the air temperatures over the ocean

It depends, it can get much hotter and much cooler over the land. The bigger change in temperature is because of how much heat is absorbed by the land (compared to water). Water is constantly moving around, swirling, and mixing in the ocean.