How did castles differ from manor houses

The main difference is in where they lie on the defensive/administrative scale. A manor house is a country house, which formed the administrative center of a manor, the lowest unit of territorial organization in the feudal system in Europe. A castle is a mix between fortress and palace, in that it is both the local administrative center of the feudal world, a prestigious home for it's owner and a defensible structure.