Flint rubble stone wall with lime mortar is a cheap and simple wall construction, although time-consuming. The critical points, like corners and door or window openings can be built in red brick or some other more easily shaped ashlar stone if necessary. Brick isn't cheap but in this kind of construction you don't need much of it. We have Ancient Roman era examples of this kind of construction still standing.
https://hell.twtr.plus/media/afe955e20d9bb8fc8cfa621484d8722254f372d14015193f5dea04d3cc010a6c.file