This was the ancestral stronghold of the Menzies clan from the 16th - 19th centuries. It was occupied by Jacobite rebels in 1715 and 1745 and, in 1746, Charles Edward Stuart - Bonnie Prince Charlie - the Young Pretender - stayed at Castle Menzies on his way to defeat at Culloden. 4 days later, the Duke of Cumberland, commander of the Government forces in hot pursuit of the rebels, stopped by too.
In 1957, the castle was purchased as a ruin for just £300 by the Menzies Clan Society who have proceeded to, very gradually, restore it. It is somewhere between a mansion and a fortress. It has a walled garden too, though the website suggests this may not be particularly well kept. It is also possible to visit the Old Kirk of Weem - the Menzies Mausoleum - in the nearby village of Weem.