[Wranglers] Data Quality Monitoring using Data Metric Functions Snowflake

Ali, Saqib docbook.xml at gmail.com
Tue Jun 11 03:54:41 UTC 2024


Another excellent blogpost on Snowflake Data Metric Functions (DMF) by
Peter Beck:
https://medium.com/snowflake/monitoring-data-quality-using-snowflake-data-metric-functions-6b04229c6597

Couple of interesting insights from the article:

   1. Snowflake runs DMFs under a warehouse it creates on your behalf. You
   are billed for this consumption under a special “Data Quality Monitoring”
   section of your bill. This enables you to see immediately what the costs
   associated with this kind of activity are. You can also query
   DATA_QUALITY_MONITORING_USAGE_HISTORY to see your consumption.
   2. Scheduling of DMFs is simple, and you don’t need to build your own
   target table to store the results.


Saqib



On Thu, May 30, 2024 at 9:55 PM Ali, Saqib <docbook.xml at gmail.com> wrote:

> Another excellent blogpost on Snowflake Data Metric Functions (DMF) by
> Arihant Shashank:
>
> https://medium.com/@arihant.shashank01/native-custom-data-quality-monitoring-in-snowflake-fcf002ec9afb
>
> On Tue, May 7, 2024 at 8:42 AM Ali, Saqib <docbook.xml at gmail.com> wrote:
>
>> Another excellent blogpost on Snowflake Data Metric Functions (DMF) by
>> Maja Ferle:
>>
>> https://medium.com/snowflake/monitoring-data-quality-natively-in-snowflake-6cdbcef70de5
>>
>> saqib
>>
>> On Sat, Apr 27, 2024 at 12:30 PM Ali, Saqib <docbook.xml at gmail.com>
>> wrote:
>>
>>> here is another blogpost on Data Metrics Functions in Snowflake by
>>> Mandar Athavale:
>>>
>>> https://medium.com/@athavale.mandar/snowflake-data-metric-functions-and-alerts-21d610bbcb67
>>>
>>> Saqib
>>>
>>> On Wed, Apr 17, 2024 at 7:50 AM Ali, Saqib <docbook.xml at gmail.com>
>>> wrote:
>>>
>>>>
>>>> Also, Jessica Zhang has blogged the Built-in Data Quality Metrics in
>>>> Snowflake:
>>>>
>>>> https://medium.com/@jesszhangcyz/monitor-data-pipelines-using-snowflakes-data-metric-functions-0df71c46f04a
>>>>
>>>>
>>>> On Thu, Apr 11, 2024 at 10:20 AM Ali, Saqib <docbook.xml at gmail.com>
>>>> wrote:
>>>>
>>>>> Augusto Kiniama Rosa also has a detailed blogpost on the Built-in Data
>>>>> Quality Metrics in Snowflake:
>>>>>
>>>>> https://medium.com/snowflake/snowflake-built-in-quality-metrics-3417d7d9f040
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Apr 8, 2024 at 8:55 PM Ali, Saqib <docbook.xml at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> A nice overview of Data Quality Monitoring using Data Metric
>>>>>> Functions Snowflake by Sandamali De Zoysa:
>>>>>> https://www.youtube.com/watch?v=cwHLfWg6Da4
>>>>>>
>>>>>> Saqib
>>>>>>
>>>>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://analyticsengineering.net/pipermail/wranglers/attachments/20240610/810b4dc2/attachment.htm>


More information about the Wranglers mailing list