The Beaumont family lived on the site of Whitley Hall as far back as 1390.
Parts of the hall dated back to Elizabethan times in 1560. The hall was extensively remodelled in 1704 when a new frontage containing 30 bedrooms was constructed to bridge the gap between the two existing Elizabethan wings forming an enclosed quadrangle.

The hall always had a somewhat chequered history during the early 1800's. Richard Henry Beaumont the then occupier was said to have let the buildings condition deteriorate to such an appalling state that it was in danger of collapse around him. The Beaumont family continued to occupy the hall until 1917 when once again the hall had begun to fall into disrepair, the contents of the hall were sold by auction and after six century's the Beaumonts finally left the hall.