The theory I learnt in school was that they placed the bricks on a row of tree trunks that served as “wheels” or rather, a type of conveyor belt.
The trunk that was freed at the back by pulling the brick forward was placed in front again. Not sure if that’s still the current theory.