The name Ogilvie is derived from Ocel-Fa, which means high plain. The lands of Ogilvie are in Angus and the family derives the name from there, after they were given to Gilbert, son of the Earl of Angus, by his father.

The Ogilvies held many positions all over Aberdeenshire being Earls of Airlie, Findlater, Seafield and Deskford. In the 14th and 15th Centuries they were sheriffs of Angus. Branches of the family also came from Inverquharity, Lintrathern (later the Earls of Airlie) and Inchmartine.

The Ogilvies were royalists supporting Charles I and were also Jacobites supporting both the 1715 and 1745 uprisings. Lord Ogilvie again turned out to fight at Culloden, fleeing to France after the battle was lost. In more recent times Ogilvies have distinguished themselves fighting for Britain and indeed the Earl of Seafield was a renowned supporter of the Act of Union of 1707.