Wranglers List Archive Search

You can get more information about this list.

This index contains 197 documents and 3,376 keywords.

Last modified: 2025-06-20

1. zen (score: 26)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 29 Dec 2024 18:33:18 +0000

Azure SQL now supports JSON DataType. It is a binary data type that is way more performant than using a non-binary datatype to store JSON. https://www.youtube.com/watch?v=WigP5PLQXhY More info: https

/pipermail/wranglers/2024/000083.html (3,912 bytes)

2. alefree (score: 23)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Regex support in SQL Server 2025, Azure SQL Database, SQL DB in Fabric, and Azure SQL Managed Instance: https://devblogs.microsoft.com/azure-sql/unlocking-the-power-of-regex-in-sql-server/ A good ove

/pipermail/wranglers/2025/000174.html (3,302 bytes)

3. sql online compiler (score: 23)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

A running list of Online SQL Compilers. Please feel free to suggest more. https://www.programiz.com/sql/online-compiler/ https://sqliteonline.com/ https://www.mycompiler.io/online-sql-editor https://

/pipermail/wranglers/2025/000099.html (3,967 bytes)

4. oon (score: 22)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Following in Google BigQuery's footsteps, Snowflake will be adding support for the SQL Pipe Operator soon. The new pipe operator (->>) will enable chaining of SQL statements. In the chain of SQL stat

/pipermail/wranglers/2025/000150.html (3,386 bytes)

5. Calculating Geometric Mean using SQL (score: 22)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Recently I had to calculate the Geometric Mean of columns in a table using SQL. To calculate the geometric mean, you have to first multiply all values and then take the nth root of that number, where

/pipermail/wranglers/2024/000025.html (3,502 bytes)

6. pes (score: 21)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Snowflake's Pipe Operator (aka the Arrow Operator) is much more than the Google Bigquery's Pipe (|>) operator. It is a way to write SQL based DAGs. Here is an example: select c_mktsegment , count(*)

/pipermail/wranglers/2025/000162.html (5,615 bytes)

7. Announcing General Availability of Native Vector Type & Functions in Azure SQL (score: 20)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Fri, 20 Jun 2025 02:43:12 +0000

Azure SQL now has a native Vector Data Type. In addition to that, following Vector functions have been added: VECTOR_DISTANCE: Calculates the distance between two vectors using a specified distance m

/pipermail/wranglers/2025/000196.html (3,943 bytes)

8. oon (score: 20)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Looks like Snowflake is officially calling the "->>" a Flow Operator. See: https://docs.snowflake.com/en/sql-reference/operators-flow Flow Operator allows you to chain SQL statements together, where

/pipermail/wranglers/2025/000169.html (9,230 bytes)

9. SQL User Defined Aggregate Functions are now available in Google BigQuery! (score: 20)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 28 Jul 2024 22:43:58 +0000

DDL syntax for SQL based User Defined Aggregate Functions (UDAF) here: https://cloud.google.com/bigquery/docs/reference/standard-sql/data-definition-language#sql-create-udaf-function Saqib -- next pa

/pipermail/wranglers/2024/000055.html (4,487 bytes)

10. Now you can execute an Azure Function in response to a data change event Azure SQL DB Table (score: 20)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Ever wanted to trigger an Azure Function in response to a data change event that happened on a Azure SQL Database table? Well now you can: https://devblogs.microsoft.com/azure-sql/azure-sql-trigger-b

/pipermail/wranglers/2024/000021.html (3,842 bytes)

11. Amazon EC2 now supports automated recovery of Microsoft SQL Server with VSS (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Amazon EC2 now supports automated recovery of Microsoft SQL Server with VSS: https://aws.amazon.com/about-aws/whats-new/2025/02/amazon-ec2-automated-recovery-microsoft-sql-server-vss/ -- next part --

/pipermail/wranglers/2025/000115.html (3,492 bytes)

12. Stratified sampling using SQL given an absolute sample size (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

I have the following population: a b b c c c c I am looking for a SQL statement to generate a stratified sample of arbitrary size. For example, I would like a sample size of 4. I would expect the out

/pipermail/wranglers/2025/000116.html (3,574 bytes)

13. ace (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Snowflake now supports Asynchronous execution of statements in SQL stored procedures: https://qosf.com/asynchronous-execution-of-statements-in-SQL-stored-procedures-in-snowflake.html -- next part --

/pipermail/wranglers/2025/000138.html (3,560 bytes)

14. ing (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

A nice overview of advanced analytical SQL in Snowflake: https://medium.com/snowflake/modern-sql-in-snowflake-designed-for-simplicity-for-complex-tasks-cbbe568a18dd FILTER, REDUCE, TRANSFORM [2] to M

/pipermail/wranglers/2025/000164.html (4,177 bytes)

15. SQL User Defined Aggregate Functions are now available in Google BigQuery! (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 28 Jul 2024 22:43:58 +0000

SQL User Defined Aggregate Functions (UDAF) are now available in Google BigQuery. Sample SQL available on GitHub: https://qosf.com/UDAF-in-google-bigquery.html Saqib -- next part -- An HTML attachmen

/pipermail/wranglers/2024/000052.html (3,401 bytes)

16. Accurate estimation of the costs of each SQL statement in Snowflake (score: 19)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Estimating the cost of each SQL query in Snowflake is a challenge. I have been struggling with this a lot lately. A tiny query could be running as part of a Large Warehouse that is already up and run

/pipermail/wranglers/2024/000017.html (4,143 bytes)

17. Running SQL Graph Queries in Oracle at a Specific SCN (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Mon, 16 Jun 2025 04:02:03 +0000

I did not know you can Time Travel in SQL Graph Queries in Oracle by specifying the System Change Number (SCN) or the TIMESTAMP: https://docs.oracle.com/en/database/oracle/property-graph/25.1/spgdg/r

/pipermail/wranglers/2025/000186.html (4,034 bytes)

18. Any ETA on when Oracle Live SQL will be upgraded to Oracle Database 23ai, Release Update 23.7? (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Anyone know when Oracle Live SQL will be upgraded to Oracle Database 23ai, Release Update 23.7? -- next part -- An HTML attachment was scrubbed... URL: <https://analyticsengineering.net/pipermail/wra

/pipermail/wranglers/2025/000118.html (3,379 bytes)

19. eer (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

I am curious why Snowflake chose "->>" as the Pipe Operator when Google Bigquery has already adopted "|>" as the Pipe Operator for SQL. ¯\_(&#12484;)_/¯

/pipermail/wranglers/2025/000151.html (3,451 bytes)

20. oon (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Here is another example of Snowflake Pipe Operator (aka. Arrow Operator) using the Pseudo-SQL SHOW WAREHOUSES: show warehouses "name" , "state" , "type" , "size" from $1 where "state" in ('STARTED',

/pipermail/wranglers/2025/000163.html (6,553 bytes)

21. oon (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

One thing I realized is that if you convert an existing [complex] query to use Pipe Operator for readability, the pushdown optimization will not be applied. Pushdown optimization improves performance

/pipermail/wranglers/2025/000167.html (7,796 bytes)

22. DuckDB now support Property Graph and SQL/PGQ (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

Following in the footsteps of Oracle 23ai and Google Spanner, DuckDB now supports Property Graphs and SQL/PGQ: https://duckpgq.org/ -- next part -- An HTML attachment was scrubbed... URL: <https://an

/pipermail/wranglers/2025/000097.html (3,129 bytes)

23. tions (score: 18)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 29 Dec 2024 18:33:18 +0000

A nice overview of GROUP BY ROLLUP SQL syntax https://help.sap.com/docs/hana-cloud-data-lake/administration-guide-for-data-lake-relational-engine/rollup-and-subtotal-rows-in-data-lake-relational-engi

/pipermail/wranglers/2024/000091.html (3,357 bytes)

24. ies (score: 17)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Maybe Snowflake should have called it an Arrow Operator instead of Pipe Operator: Bigquery and Databricks use "|>" Snowflake uses "->>" -- next part -- An HTML attachment was scrubbed... URL: <https:

/pipermail/wranglers/2025/000156.html (4,244 bytes)

25. ies (score: 17)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Also curious if Snowflake will support the same Pipe Operators as BigQuery e.g. AGGREGATE, EXTEND, SET, DROP, RENAME and JOIN&#8230; -- next part -- An HTML attachment was scrubbed... URL: <https://a

/pipermail/wranglers/2025/000154.html (4,204 bytes)

26. DuckDB now support Property Graph and SQL/PGQ (score: 17)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

Quick overview by Daniël ten Wolde on how DuckPGQ brings property graphs to DuckDB https://www.youtube.com/watch?v=QDdTbhSR2Vo <https://qosf.com> -- next part -- An HTML attachment was scrubbed... UR

/pipermail/wranglers/2025/000117.html (3,584 bytes)

27. SQL User Defined Aggregate Functions are now available in Google BigQuery! (score: 17)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 28 Jul 2024 22:43:58 +0000

here is the official documentation: https://cloud.google.com/bigquery/docs/user-defined-aggregates Saqib -- next part -- An HTML attachment was scrubbed... URL: <https://analyticsengineering.net/pipe

/pipermail/wranglers/2024/000053.html (3,868 bytes)

28. SQL User Defined Aggregate Functions are now available in Google BigQuery! (score: 17)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 28 Jul 2024 22:43:58 +0000

Javascript based UDAF are now also available in BigQuery: https://cloud.google.com/bigquery/docs/user-defined-aggregates#create-javascript-udaf Saqib -- next part -- An HTML attachment was scrubbed..

/pipermail/wranglers/2024/000066.html (5,044 bytes)

29. Stoolap (score: 6)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Since last year I have been using the SQL/PGQ in Oracle to perform some graph analysis that would be very cumbersome in a SQL only database. More recently I have had a need for a Transactional DB for

/pipermail/wranglers/2025/000180.html (3,694 bytes)

30. Databases that added support for Translytical workloads in 2024 (score: 5)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sat, 11 Jan 2025 01:55:48 +0000

Here are three databases that added support for translytical workloads in 2024: 1. SQL DB in Microsoft Fabric. All data is replicated in near-real time to open-source delta parquet format in OneLake.

/pipermail/wranglers/2025/000094.html (3,714 bytes)

31. nDB (score: 3)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

An excellent blogpost by Philipp Salvisberg on why implicit type conversion should be avoided in Oracle especially when working with JSON data: https://www.salvis.com/blog/2025/01/28/avoid-implicit-t

/pipermail/wranglers/2025/000126.html (4,060 bytes)

32. Passing a table name as a variable to Snowflake Stored Procedure (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

I wanted to add some exception handling to the store procedure. Here is what I came up with so that we get meaningful error messages in case there are any errors. CREATE OR REPLACE PROCEDURE SP__INSE

/pipermail/wranglers/2025/000113.html (5,279 bytes)

33. Passing a table name as a variable to Snowflake Stored Procedure (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Looks like for table names we have to use the IDENTIFIER() keyword as follows: CREATE OR REPLACE PROCEDURE SP__INSERT_TO_CUSTOMERS(table_name varchar) RETURNS string LANGUAGE SQL AS BEGIN insert into

/pipermail/wranglers/2025/000109.html (4,303 bytes)

34. Passing a table name as a variable to Snowflake Stored Procedure (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

I am trying to define a Stored Procedure in Snowflake as follows. But it is erroring out on the variable binding for :table_name. Error: Syntax error: unexpected 'into'. How do I achieve this? CREATE

/pipermail/wranglers/2025/000108.html (3,511 bytes)

35. Graph Databases after 15 Years – Where Are They Headed? (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

An excellent presentation by Keith Hare of JCC Consulting on GQL for SQL Users: https://www.youtube.com/watch?v=FpLV8OkQjhg -- next part -- An HTML attachment was scrubbed... URL: <https://analyticse

/pipermail/wranglers/2025/000131.html (3,797 bytes)

36. ? (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Brief history of development of the SQL/PGQ and GQL Standards by Gábor Szárnyas of DuckDB https://www.youtube.com/watch?v=X_RFo616M_U -- next part -- An HTML attachment was scrubbed... URL: <https://

/pipermail/wranglers/2025/000123.html (3,421 bytes)

37. ake (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Looks like CedarDB, a relational-first Database, wants to be multi-modal database of choice by supporting Transactional to Analytical to Graph workloads: https://cedardb.com/ The website has some int

/pipermail/wranglers/2025/000135.html (3,681 bytes)

38. acle? (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

DuckDB supported the Arrow Operator (->) for the Lambda Functions for List operations like list_transform(). This was consistent with how it is implemented in Snowflake. Snowflake syntax: SELECT TRAN

/pipermail/wranglers/2025/000168.html (3,471 bytes)

39. Server (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Stoolap is a SQL based HTAP database written in Go: https://stoolap.io/ Hybrid Transactional/Analytical Processing (HTAP) unifies OLTP and OLAP workloads in a single system, eliminating the need for

/pipermail/wranglers/2025/000170.html (3,067 bytes)

40. c Views (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Thu, 12 Jun 2025 04:38:12 +0000

Just noticed that Snowflake has improved error messages for Data Manipulation Language (DML) commands: https://docs.snowflake.com/en/release-notes/2025/9_12#sql-updates DML error messages used to be

/pipermail/wranglers/2025/000181.html (3,677 bytes)

41. Databases that added support for Translytical workloads in 2024 (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

A nice overview of how the GaussDB supports HTAP workloads. Unlike SQL DB in Microsoft Fabric that provides two different end-points, one for OLAP and one for OLTP loads separately, GaussDB offers a

/pipermail/wranglers/2025/000175.html (6,374 bytes)

42. Windows frames with array_agg Window function in Snowflake (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

Much awaited feature is now available in Snowflake. array_agg() window function in Snowflake now supports Window frames: https://docs.snowflake.com/en/sql-reference/functions/array_agg#syntax -- next

/pipermail/wranglers/2025/000100.html (3,229 bytes)

43. e (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Tue, 27 May 2025 12:53:19 +0000

Both Snowflake and Redshift assign unique identifiers to SQL queries that can be used to track and monitor the performance of queries over time. Redshift calls it generic_query_hash whereas Snowflake

/pipermail/wranglers/2025/000105.html (4,274 bytes)

44. Databases that added support for Translytical workloads in 2024 (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 12 Jan 2025 13:55:36 +0000

Forgot to mention that Snowflake also has Hybrid tables that support OLTP workloads with ability to define and enforce Primary Keys and Unique Key constraints. In general, I think, analytical databas

/pipermail/wranglers/2025/000095.html (4,900 bytes)

45. ver (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Sun, 29 Dec 2024 18:33:18 +0000

Snowflake now supports Variable Binding in Queries using TO_QUERY(): https://docs.snowflake.com/en/user-guide/querying-construct-at-runtime https://docs.snowflake.com/en/sql-reference/functions/to_qu

/pipermail/wranglers/2024/000084.html (3,501 bytes)

46. cts (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 21 Aug 2024 18:51:12 +0000

An excellent blogpost by Sepideh Jahangiri and Philip Laserstein on One Big Table vs. Dimensional Modeling for Information Marts: https://medium.com/dbsql-sme-engineering/one-big-table-vs-dimensional

/pipermail/wranglers/2024/000060.html (3,389 bytes)

47. Flattening JSON with a recursive query in BigQuery (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

An interesting post by Ross Lovelace on how to flatten a nested JSON using a SQL Recursive CTE: https://medium.com/@rossalovelace/flattening-json-with-a-recursive-query-in-bigquery-a8cf76eedca8 -- ne

/pipermail/wranglers/2024/000015.html (3,422 bytes)

48. Syntactic Sugar: Snowflake Now Supports Trailing Comma for the SELECT Clause (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

A brief post by Qinyi Ding on how Snowflake now supports trailing comma for the SELECT clause: https://medium.com/snowflake/snowflake-supports-trailing-comma-for-the-select-clause-407eb46271ba Basica

/pipermail/wranglers/2024/000016.html (3,586 bytes)

49. New Table Function RANGE_SESSIONIZE in Google BigQuery (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Google published a blogpost about RANGE_SESSIONIZE and GAP_FILL Table Functions aka Table-Valued Function (TVF) here: https://cloud.google.com/blog/products/data-analytics/bigquery-sql-gets-time-wind

/pipermail/wranglers/2024/000023.html (4,293 bytes)

50. NULL-safe GREATEST and LEAST now available in Snowflake (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Snowflake now supports GREATEST_IGNORE_NULLS and LEAST_IGNORE_NULLS. In the past if you used LEAST or GREATEST on a list of expressions that contained NULL these functions always returned NULL, which

/pipermail/wranglers/2024/000029.html (6,289 bytes)

51. NULL-safe GREATEST and LEAST now available in Snowflake (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Snowflake now supports GREATEST_IGNORE_NULLS and LEAST_IGNORE_NULLS. In the past if you used LEAST or GREATEST on a list of expressions that contained NULL these functions always returned NULL, which

/pipermail/wranglers/2024/000030.html (3,762 bytes)

52. Data Quality checks in Snowflake using Data Metric Functions (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Wed, 15 May 2024 03:53:21 +0000

Data Metrics Functions (DMF) are here! DMFs allow you to automate data quality validation and monitoring in Snowflake. Snowflake has several Pre-defined DMFs like NULL_COUNT, DUPLICATE_COUNT, UNIQUE_

/pipermail/wranglers/2024/000031.html (3,654 bytes)

53. Snowflake now has support for ASOF Joins (score: 2)

Author: Ali, Saqib <docbook.xml at gmail.com>

Date: Fri, 26 Apr 2024 01:37:27 +0000

Snowflake now has support for ASOF JOINs. Checkout: https://docs.snowflake.com/en/sql-reference/constructs/asof-join Sincerely, Saqib https://qosf.com -- next part -- An HTML attachment was scrubbed.

/pipermail/wranglers/2024/000000.html (2,848 bytes)