The name Challock is of Saxon origin and means 'enclosure of calves', calves being large standing stones some of which were used for the foundations of the church. A considerable village was situated round the church in the Middle Ages. The village is now situated at the top of the hill.

The village centre is located between Faversham town (8 miles to the north) and Ashford town (6 miles to the south). It dates from around AD823. Challock is situated close to one of the highest points on the North Downs, the 700-foot (210 m) contour lies close to the village. Snowfall is often heavy as a result. 

The ancient church of St. Cosmas and St. Damian was built in the 13th century on the site of an earlier church. The church boasts one of only two remaining candle beams in the country and features two sets of murals, one painted by John Ward RA, which depicts the life of Christ using villagers as models.

Challock Lees is common land and was granted a charter by William I to be used as a racecourse. Challock Lees is now owned by the Parish Council.