A graceful 18th-century colonial state palace set within the Botanical Gardens, best known for the herd of spotted deer grazing its lawns — still used for official state occasions.