Zeist castle was built by William of Nassau Odijk, a bastard cousin of the king-statholder. It is a smaller copy of Het Loo palace, and it was also designed by Jacob Roman and Daniel Marot.
In the 18th century, the "Brother- and sister Houses" were built alongside the entrance lane. They used to house the Hernhutters, a protestant community.