[Wranglers] Data Quality checks in Snowflake using Data Metric Functions
Ali, Saqib
docbook.xml at gmail.com
Mon Apr 1 01:52:35 UTC 2024
Data Metrics Functions (DMF) are here! DMFs allow you to automate data
quality validation and monitoring in Snowflake. Snowflake has several
Pre-defined DMFs like NULL_COUNT, DUPLICATE_COUNT, UNIQUE_COUNT, FRESHNESS,
ROW_COUNT. If you need something more advanced, you can roll your own
custom Data Metric Functions. Creating custom DMFs is as easy as creating
UDFs and then attaching them to tables as follows. Sample SQL available on
GitHub:
https://qosf.com/data-metric-function-in-snowflake.html
Thanks,
Saqib
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://analyticsengineering.net/pipermail/wranglers/attachments/20240331/49d9b8c0/attachment.htm>
More information about the Wranglers
mailing list