How to Test Data Pipelines in CI/CD
Bruin Data Blog getbruin.com
Aurekai listening
Listen to this summary
Original instrumental score; voice stays in front.
Ready to listen
This reads the text available on this page using your browser's voice. It is not a publisher-recorded narration; voice processing depends on your browser.The four kinds of tests a data pipeline needs in CI/CD, cheapest first: validation, unit tests on mocked rows, data quality checks in a dev environment, and a data diff against production. What each one catches, when to run it, and how to set it up with Bruin, dbt, Great Expectations, Soda and GitHub Actions.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.