It's Monday morning, and your phone won't stop buzzing.
You wake up to messages from your CEO saying, "The numbers in this report don't seem right...again."
How to Quarterback Data Incident Response
Is DataOps the Future of the Modern Data Stack?
Before DevOps took the software engineering world by storm, developers were left in the dark once their applications were up and running.
Instead of being the first to know when outages occurred, engineers would only find out when customers or stakeholders complained of “laggy websites” or one too many 503 pages.
Data Lineage Is Broken — Here Are 5 Ways to Fix It
Data lineage isn’t new, but automation has finally made it accessible and scalable—to a certain extent.
In the old days (way back in the mid-2010s), lineage happened through a lot of manual work. This involved identifying data assets, tracking them to their ingestion sources, documenting those sources, mapping the path of data as it moved through various pipelines and stages of transformation, and pinpointing where the data was served up in dashboards and reports.
What Is a Data Reliability Engineer, and Do You Really Need One?
As software systems became increasingly complex in the late 2000s, merging development and operations (DevOps) was a no-brainer.
One-half software engineer, one-half operations admin, and the DevOps professional are tasked with bridging the gap between building performant systems and making them secure, scalable, and accessible. It wasn’t an easy job, but someone had to do it.