The house at 50 Paul Kruger Street was built in 1860. Among the 7 previous owners of the house before Mr William Henry Dutton English purchased it in 1883, was Mr Thomas Barry Senior, the well-known blacksmith who lived here from 1867 - 1873 and Mr Thomas Connell the Chief Constable 1873 - 1875. Mr English who had been appointed Civil Commissioner and Resident Magistrate to Robertson in 1881, with his wife Katherine Human, purchased the property, added the flat-roofed portion on the left (the Office and the Nursery) and gave the house the name Druids Lodge. It was here that their children Maud, Elsabe, Arthur, Jessie and Violet were born.

In 1890 Mr English was transferred to Victoria West where the two youngest sons Fred and Henry were born. During this period from 1890 to 1895 Mr English's first cousin Sarah Bowler Little (daughter of Thomas Bowler, one of South Africa's best-known early artists) held school here assisted by her daughter Edith.

In 1895 Mr English retired from the Colonial Service due to ill health and returned to Druids Lodge where he died the following year. His widow lived on in the house until her death in 1924 by which time all her children except Maud had left home. The house was then let to the Hooper family for 20 odd years, and many of the English possessions were stored in the loft for safe keeping, remaining there until 1976.

In 1947 Violet having retired from teaching in Southern Rhodesia (now Zimbabwe) re-opened the family home for her two spinster sisters Maud and Jessie and her then unmarried brother Fred. Violet, the last surviving member of the family lived on in the house till her death in 1976, at which time the Municipality purchased the property.

Druids Lodge was declared a National Monument in 1977 and with the Municipality's consent the small museum collection so far gathered together was housed here and the official opening took place on 7'1' of June 1977. The severe floods that ravaged the area in 1981 caused extensive damage to the building and the contents of the house were removed and stored in the then recently completed annex. The house was restored in 1984 and the museum was finally and fittingly re-opened in 1985 by Dr Frank Bradlow the historian, writer and authority on early South African artists, particularly Thomas Bowler and Thomas Bains.