The Toll House was built in 1867 when the railway was extended from Picton to Mittagong. The railway line crossed the road near this point. Besides being the gatekeeper for the railway the gatekeeper also held the position of toll collector. Travellers on the road had to pay a toll up until the 1870s.