Actually (talking about what I know about the Netherlands) the countryside used to be more circles and weird shapes. But the farmers found that inconvenient so they started trading pieces of land with each other. We call this "ruilverkaveling". Google says the English is land consolidation.
Anyway, when more and more land was being traded, the land farmers owned started to be more rectangular.