UK Property Prices Lakehouse
Planned
Overview
A planned medallion lakehouse on Azure for HM Land Registry Price Paid Data, the open record of residential property sales in England and Wales.
Problem statement
Price Paid Data covers millions of property sales back to 1995 and is republished monthly with additions, changes and deletions. The project practises incremental loads and layered cloud storage on a dataset large enough to need them.
Architecture
Planned design: raw monthly CSVs land in Azure Data Lake Storage (bronze), Databricks notebooks apply the change records and standardise types (silver), and aggregated tables of prices by region and property type are published for analysis (gold).
Technologies
Azure
Databricks
PySpark
- SQL