Skip to content
All projects

Cloud lakehouse

UK Property Prices Lakehouse

Planned

Overview

A planned medallion lakehouse on Azure for HM Land Registry Price Paid Data, the open record of residential property sales in England and Wales.

Problem statement

Price Paid Data covers millions of property sales back to 1995 and is republished monthly with additions, changes and deletions. The project practises incremental loads and layered cloud storage on a dataset large enough to need them.

Architecture

Planned design: raw monthly CSVs land in Azure Data Lake Storage (bronze), Databricks notebooks apply the change records and standardise types (silver), and aggregated tables of prices by region and property type are published for analysis (gold).

Technologies

  • Azure
  • Databricks
  • PySpark
  • SQL