This article explains why Deep data observability is different from shallow: deep data observability is truly comprehensive in terms of data sources, data formats, data granularity, validator configuration, cadence, and user focus.
The Need for “Deep” Data Observability
2022 was the year when data observability really took off as a category (as opposed to old-school “data quality tools”), with the official Gartner terminology for the space. Similarly, Matt Turck consolidated the data quality and data observability categories in the 2023 MAD Landscape analysis. Nevertheless, the industry is nowhere near fully formed. In his 2023 report titled “Data Observability—the Rise of the Data Guardians,” Oyvind Bjerke at MMC Ventures discusses the space as having massive amounts of untapped potential for further innovation.