61 KiB
61 KiB
Changelog
v16.2.0 - 2023-06-15
🐛 Bug Fixes
🔧 Chores
v16.1.4 - 2023-06-15
🐛 Bug Fixes
4a1068b- Postgres: Set INDEX_OFFSET to 1 (PR #1782 by @vegarsti)f523dd6- build uppercasing everything (commit by @tobymao)
v16.1.3 - 2023-06-15
✨ New Features
🐛 Bug Fixes
fd0fc97- bigquery timestamp -> timestamptz (commit by @tobymao)b86f7e8- dialect build (commit by @tobymao)
v16.1.1 - 2023-06-15
🐛 Bug Fixes
697c8b1- bigquery: allow SPLIT call with 1 argument (PR #1770 by @GeorgeSittas)0796cdc- join using struct (commit by @tobymao)b13d0b9- map "RETURNING" to its token in the base Tokenizer (PR #1773 by @GeorgeSittas)- ↘️ fixes issue #1771 opened by @LilyFoote
a2deee3- parser: don't parse an alias for non-source UNNESTs (PR #1774 by @GeorgeSittas)0a1362b- bigquery regexp_extract closes #1776 (commit by @tobymao)f84732e- bigquery timestamp mapping (commit by @tobymao)
♻️ Refactors
1dbed85- optimizer: make the type annotator more dry (PR #1777 by @GeorgeSittas)
v16.1.0 - 2023-06-13
✨ New Features
a4934cb- add hint builder (PR #1758 by @GeorgeSittas)b87fa35- add copy flag to replace_tables (commit by @tobymao)6cfc873- snowflake: add support for // comments (PR #1765 by @GeorgeSittas)- ↘️ addresses issue #1763 opened by @florian-ernst-alan
🐛 Bug Fixes
146e66a- select x.update (commit by @tobymao)2b46782- json_object(*) closes #1757 (commit by @tobymao)0264b43- limit offset multi arg order (commit by @tobymao)4fcdb0f- tokenizer: improve tokenization of decimals ending in . (PR #1766 by @GeorgeSittas)- ↘️ fixes issue #1764 opened by @florian-ernst-alan
35d960a- parser: disallow no paren functions when parsing table parts (PR #1767 by @GeorgeSittas)- ↘️ fixes issue #1762 opened by @florian-ernst-alan
5955b9e- values inner alias snowflake closes #1768 (commit by @tobymao)0a9cecb- Postgres: Support UNNEST (PR #1761 by @vegarsti)
♻️ Refactors
46abf16- simplify list comprehension in hint parser (commit by @GeorgeSittas)
v16.0.0 - 2023-06-12
💥 BREAKING CHANGES
-
due to
e00647a- output name for parens (commit by @tobymao):output name for parens
-
due to
2dd8cba- misc. improvements in formatting, type hints, dialect class variables (PR #1750 by @GeorgeSittas):misc. improvements in formatting, type hints, dialect class variables (#1750)
-
due to
a233afa- bigquery cast date format closes #1753 (commit by @tobymao):bigquery cast date format closes #1753
✨ New Features
99c41d9- clickhouse: support CREATE VIEW TO syntax (PR #1752 by @pkit)e00647a- output name for parens (commit by @tobymao)
🐛 Bug Fixes
48ad1f1- bigquery table with hyphen number (commit by @tobymao)68b9128- index using closes #1751 (commit by @tobymao)55a14a3- selecting from table with same name as cte (commit by @tobymao)7000a6f- presto offset limit order closes #1754 (commit by @tobymao)1553bfa- count with multiple args closes #1755 (commit by @tobymao)a233afa- bigquery cast date format closes #1753 (commit by @tobymao)
♻️ Refactors
2dd8cba- misc. improvements in formatting, type hints, dialect class variables (PR #1750 by @GeorgeSittas)
🔧 Chores
v15.2.0 - 2023-06-09
💥 BREAKING CHANGES
-
due to
c6a540c- store type dump so it is not reparsed (commit by @tobymao):store type dump so it is not reparsed
✨ New Features
e028d98- redshift,presto: transpile FROM_BASE to STRTOL and vice versa (PR #1744 by @GeorgeSittas)- ↘️ addresses issue #1742 opened by @pangyifish
bb1f1a0- redshift,presto: transpile DATEADD, DATEDIFF to presto (PR #1746 by @GeorgeSittas)- ↘️ addresses issue #1745 opened by @pangyifish
🐛 Bug Fixes
9b56fc9- add ts_or_ds to postgres (commit by @tobymao)0cc09cf- is true for presto closes #1740 (commit by @tobymao)6168fbf- redshift len->length closes #1741 (commit by @tobymao)824fcb2- bigquery table with hyphen number (commit by @tobymao)
🔧 Chores
d2e46c3- fix README example (commit by @GeorgeSittas)c6a540c- store type dump so it is not reparsed (commit by @tobymao)
v15.1.0 - 2023-06-07
💥 BREAKING CHANGES
-
due to
6ad00ca- convert left and right closes #1733 (commit by @tobymao):convert left and right closes #1733
✨ New Features
5867fc4- postgres: add support for all range/multirange types (PR #1718 by @GeorgeSittas)dd29f3f- presto: transpile 'epoch' to '1970-01-01 00:00:00' in time-like casts (PR #1726 by @GeorgeSittas)- ↘️ addresses issue #1725 opened by @pangyifish
🐛 Bug Fixes
4f31a50- clickhouse backslash str escape closes #1719 (commit by @tobymao)95f7ac7- bigquery: treat HASH as a reserved keyword (PR #1721 by @GeorgeSittas)cad14bd- conditionally quote identifiers that start with a digit (PR #1729 by @GeorgeSittas)e058513- ensure pivot can be used as a table name (PR #1734 by @GeorgeSittas)be0de6e- window sql gen closes #1739 (commit by @tobymao)
🔧 Chores
1eb338a- optimizer: fix pushdown_predicates comment example (PR #1732 by @GeorgeSittas)a30a828- cleanup identifer (commit by @tobymao)
v15.0.0 - 2023-06-02
✨ New Features
24d44ad- schema: allow passing kwargs in ensure_schema (PR #1706 by @GeorgeSittas)1b1d9f2- mysql: add support for the UNIQUE KEY constraint (PR #1708 by @GeorgeSittas)17dc0e1- duckdb: add support for simplified pivot syntax (PR #1714 by @GeorgeSittas)- ↘️ addresses issue #1712 opened by @csubhodeep
🐛 Bug Fixes
ec7c863- ensure maybe parse doesn't get none (commit by @tobymao)5f45e18- teradata partition order (PR #1696 by @tobymao)764ce6f- clear errors on schema parse closes #1698 (commit by @tobymao)a9e1483- Minor Dataframe cleanup (PR #1700 by @eakmanrq)264e9d7- make error message more robust (commit by @tobymao)da17c4d- snowflake object_construct to struct closes #1699 (commit by @tobymao)2792eaa- bigquery record -> struct (commit by @tobymao)6045b74- allow type column ops for bigquery (commit by @tobymao)910166c- set quote_identifiers in qualify, add normalize flag in schema (PR #1701 by @GeorgeSittas)611c234- parse query modifiers for ddl selects (PR #1703 by @GeorgeSittas)6833823- duckdb: transpile DATE_SUB into a subtraction (PR #1705 by @GeorgeSittas)- ↘️ fixes issue #1704 opened by @muscovitebob
dd5457c- schema: ensure the correct dialect is used in schema methods (PR #1710 by @GeorgeSittas)92dbace- interval preceding closes #1715 (commit by @tobymao)
♻️ Refactors
12d3cca- schema: replace _ensure_table with exp.maybe_parse (PR #1709 by @GeorgeSittas)5d6fbfe- factor out the the name sequence generation logic (PR #1716 by @GeorgeSittas)
🔧 Chores
810522b- fix return type of and_, or_ methods (commit by @GeorgeSittas)c2c955c- make exception less broad (commit by @tobymao)e7abaef- cleanup (commit by @tobymao)223c58d- fix tests (commit by @tobymao)
v14.1.1 - 2023-05-26
🐛 Bug Fixes
🔧 Chores
v14.1.0 - 2023-05-26
💥 BREAKING CHANGES
-
due to
a6fdd59- improve python type hints (PR #1689 by @GeorgeSittas):improve python type hints (#1689)
🐛 Bug Fixes
964b04c- allow optimizer to handle non unionables (commit by @tobymao)7771609- redshift type (commit by @tobymao)543b565- raw strings bigquery escape closes #1691 (PR #1694 by @tobymao)fbf5f47- create index with order closes #1692 (commit by @tobymao)8465a77- clickhouse: allow aliases in tuple function arguments (PR #1695 by @GeorgeSittas)
🔧 Chores
a6fdd59- improve python type hints (PR #1689 by @GeorgeSittas)6cce5fc- make bigquery hex less lenient (commit by @tobymao)
v14.0.0 - 2023-05-24
💥 BREAKING CHANGES
-
due to
267ea8f- cleanup unnecessary tokens (PR #1688 by @tobymao):cleanup unnecessary tokens (#1688)
-
due to
e995ab0- use maybe_parse in exp.to_table, fix exp.Table expression parser (PR #1684 by @GeorgeSittas):use maybe_parse in exp.to_table, fix exp.Table expression parser (#1684)
✨ New Features
a392114- databricks: add support for GENERATED ALWAYS AS (expr) clause (PR #1686 by @GeorgeSittas)1cb9614- implement transform to add column names to recursive CTEs (PR #1687 by @GeorgeSittas)
🐛 Bug Fixes
c567a0b- snowflake: preserve TIME type instead of converting it to TIMESTAMP (PR #1685 by @GeorgeSittas)- ↘️ fixes issue #1682 opened by @wedotech-ashley
e995ab0- use maybe_parse in exp.to_table, fix exp.Table expression parser (PR #1684 by @GeorgeSittas)
🔧 Chores
v13.3.1 - 2023-05-23
✨ New Features
ea130b4- add dot to executor closes #1676 (commit by @tobymao)b875aa4- executor: add strftime (PR #1679 by @GeorgeSittas)
🐛 Bug Fixes
129931b- snowflake: allow 2nd argument in initcap (PR #1670 by @GeorgeSittas)1a88b17- parser: add asc, desc to id var tokens (PR #1671 by @GeorgeSittas)be5217d- teradata: improve post index property parsing (PR #1675 by @GeorgeSittas)- ↘️ fixes issue #1674 opened by @MarkBell920
903dde0- replace between before normalization (commit by @tobymao)1de5684- tokenizer: initialize self._col properly to avoid edge case (PR #1678 by @GeorgeSittas)17be003- start and end of tokens now respect quotes closes #1677 (commit by @tobymao)
v13.3.0 - 2023-05-19
💥 BREAKING CHANGES
-
due to
8c9e5ec- multi threading issues with simplify (commit by @tobymao):multi threading issues with simplify
🐛 Bug Fixes
v13.2.2 - 2023-05-19
🐛 Bug Fixes
v13.2.1 - 2023-05-19
✨ New Features
e7f6455- executor: add support for qualified table references (PR #1659 by @GeorgeSittas)- ↘️ addresses issue #1657 opened by @wmaiouiru
🐛 Bug Fixes
3f2f4df- redshift: handle VALUES clause more robustly (PR #1654 by @GeorgeSittas)da51f1e- cast to boolean closes #1658 (commit by @tobymao)2cefcaa- add exp.Neg to UNWRAPPED_INTERVAL_VALUES (PR #1662 by @GeorgeSittas)- ↘️ fixes issue #1660 opened by @joshmarcus
7130db0- lineage: remove unnecessary optimization (PR #1663 by @GeorgeSittas)cfbadfa- optimizer: expand refs in QUALIFY into corresponding projections (PR #1665 by @GeorgeSittas)- ↘️ fixes issue #1661 opened by @homebase3
🔧 Chores
19a56d9- explain versioning system in README (PR #1652 by @GeorgeSittas)862deab- snowflake: remove select_sql and values_sql as the bug was resolved (PR #1653 by @GeorgeSittas)
v13.2.0 - 2023-05-18
🔧 Chores
v13.1.0 - 2023-05-18
✨ New Features
🐛 Bug Fixes
f88ea48- snowflake: add support for GEOGRAPHY, GEOMETRY types (PR #1640 by @GeorgeSittas)- ↘️ fixes issue #1639 opened by @dlouseiro
6d04523- Spark table format vs file format (PR #1644 by @barakalon)6f9d531- postgres, redshift: use single string interval logic (PR #1651 by @GeorgeSittas)- ↘️ fixes issue #1649 opened by @ibestvina
72c5995- interval execution closes #1650 (commit by @tobymao)c4ef23c- clickhouse: absorb _parse_ternary logic in _parse_conjunction (PR #1646 by @GeorgeSittas)- ↘️ fixes issue #1645 opened by @ArtjomKotkov
🔧 Chores
1d1c0d7- issue a warning if version can't be imported (PR #1648 by @GeorgeSittas)
v13.0.2 - 2023-05-16
✨ New Features
🐛 Bug Fixes
cc7a5de- ensure unit is a var in parse_date_delta (PR #1637 by @GeorgeSittas)
♻️ Refactors
b9140b6- CI/CD: make it so that deployment only requires tag push (PR #1638 by @GeorgeSittas)
v13.0.1 - 2023-05-16
✨ New Features
8610298- snowflake: add support for the CLONE clause in DDL statements (PR #1627 by @GeorgeSittas)50025ea- clickhouse: add support for clickhouse's placeholders (PR #1628 by @GeorgeSittas)4b1aa02- optimizer: optimize pivots (PR #1617 by @GeorgeSittas)13a731a- snowflake: translate [CHAR|NCHAR] VARYING into VARCHAR (PR #1634 by @GeorgeSittas)06d6990- snowflake: translate CHARACTER VARYING into VARCHAR too (commit by @GeorgeSittas)c01edb0- create builders for the INSERT statement (PR #1630 by @GeorgeSittas)
🐛 Bug Fixes
99532d9- tablesample losing db closes #1629 (commit by @tobymao)409f13d- missing from comment and spacing closes #1631 (commit by @tobymao)bba360c- clickhouse: map ApproxDistinct to uniq, AnyValue to any (PR #1635 by @GeorgeSittas)- ↘️ fixes issue #1633 opened by @ewjoachim
v13.0.0 - 2023-05-15
✨ New Features
31a82cc- add math associativity simplification (commit by @tobymao)a973113- reparse bigquery nested identifiers (commit by @tobymao)a33112f- bigquery: allow first part of table names to contain dashes (PR #1624 by @GeorgeSittas)
🐛 Bug Fixes
0acfaf7- clickhouse settings and format closes #1605 closes #1604 (commit by @tobymao)b5f0abc- global join clickhouse closes #1606 (commit by @tobymao)d92964b- clickhouse attach command closes #1608 (commit by @tobymao)72f1984- clickhouse cast to string closes #1607 (commit by @tobymao)2f34d6f- clickhouse group by with totals closes #1609 (commit by @tobymao)b75b006- clickhouse paramaterized func closes #1610 (commit by @tobymao)4601831- join/pivot/lateral order and simplify (commit by @tobymao)29e5af2- remove unconditional expression copy (PR #1611 by @tobymao)a67b2de- clickhouse: join type/kind ordering issues (PR #1614 by @pkit)6875d07- clickhouse:USINGallows unwrapped col list (PR #1615 by @pkit)2f7473b- presto sequence to unnest closes #1600 (commit by @tobymao)966dfbb- tokenizer: avoid edge case bug in the trie lookup loop (PR #1619 by @GeorgeSittas)4833953- simplify from to a single expression closes #1620 (PR #1620 by @tobymao)bc0b021- allow identifier params. (commit by @tobymao)
v12.4.0 - 2023-05-12
✨ New Features
f585eef- clickhouse: parse ternary operator (PR #1603 by @GeorgeSittas)- ↘️ addresses issue #1602 opened by @ArtjomKotkov
🐛 Bug Fixes
41b90be- snowflake: Handle form of CONVERT_TIMEZONE with a source TZ (PR #1598 by @pmsanford)4dd413b- expand alias refs was buggy and did the samething expand lateral… (PR #1599 by @tobymao)
v12.2.0 - 2023-05-09
✨ New Features
1fa8ae9- sqlite primary key transforms closes #1557 (commit by @tobymao)fb819f0- optimizer: expand join constructs into SELECT * from subqueries (PR #1560 by @GeorgeSittas)- ↘️ addresses issue #1554 opened by @SudarshanVS
e173dd5- improve tokenizer perf significantly on sql with many strings (commit by @tobymao)c9103fe- Clickhouse: Support large data types (PR #1568 by @matthax)
🐛 Bug Fixes
34b6038- bigquery conversion without table alias (commit by @tobymao)6124d0c- bigquery select distinct as struct (commit by @tobymao)54a7637- postgres exponent precedence closes #1555 (commit by @tobymao)ac60698- array_join -> concat_ws closes #1558 (commit by @tobymao)79a478e- comments refactor closes #1561 (commit by @tobymao)7b09bff- options inside of bigquery struct closes #1562 (commit by @tobymao)4f0b3ed- bigquery date_part WEEK(WEEKDAY) closes #1563 (commit by @tobymao)4744742- presto, spark: remove WITHIN GROUP when transpiling percentile_[cont|disc] (PR #1565 by @GeorgeSittas)23cf246- need to differentiate between peek and curr tokenizers (commit by @tobymao)9f13b6c- base64 closes #1567 (commit by @tobymao)bcfae2c- subquery selects (PR #1569 by @barakalon)34d99ab- spark: unqualify columns in PIVOT expressions (PR #1572 by @GeorgeSittas)e1713f3- preserve quotes in aliases (commit by @tobymao)fa0f3a1- allow any identifier as name when parsing a struct field (PR #1573 by @GeorgeSittas)
♻️ Refactors
951d407- preserve the full text of hex/bin literals (PR #1552 by @GeorgeSittas)5bbb7e8- simplify tokenizer alnum logic (PR #1570 by @GeorgeSittas)
🔧 Chores
c580cb3- update README optimizer example (commit by @GeorgeSittas)
v12.1.0 - 2023-05-05
🐛 Bug Fixes
0b46fa6- remove bigquery workaround for values type inference (commit by @tobymao)dfae784- sqlite no table options closes #1553 (commit by @tobymao)aef9cfa- double json spark closes #1547 (commit by @tobymao)
🔧 Chores
v12.0.0 - 2023-05-04
✨ New Features
862cbeb- Use alternative transform for dialects that do not support distinct on (PR #1524 by @crericha)52c80e0- Support regex function in Starrocks (PR #1528 by @acreux)00b4779- spark: new Spark2 dialect, improve DATEDIFF sql generation BREAKING (PR #1529 by @GeorgeSittas)e2593ba- Add BYTES type to BigQuery dialect (PR #1536 by @relud)911e4e9- distinct on builder (commit by @tobymao)
🐛 Bug Fixes
5c26f56- windowspec generator (commit by @tobymao)e7111ba- trino: wrap SEQUENCE in an UNNEST call if used as a source (PR #1527 by @GeorgeSittas)3d964c6- use preprocess instead of expanding transform dicts BREAKING (PR #1525 by @GeorgeSittas)5fc27d3- trim with double pipes (commit by @tobymao)9778c16- create table options for bigquery closes #1531 (commit by @tobymao)55dc509- bigquery: allow 2nd argument for PERCENTILE_[CONT|DISC] (PR #1537 by @GeorgeSittas)5c59747- qualifying correlated subqueries (commit by @tobymao)19c0490- parse unnest array type closes #1532 (commit by @tobymao)51ca411- expand laterals first if no schema is present (commit by @tobymao)abfbce2- bigquery udf existing func clash closes #1535 (commit by @tobymao)444dd94- Spark: Add DOUBLE, FLOAT cast functions (PR #1530 by @vegarsti)0578d6d- oracle: allow parsing of @dblink in table names (PR #1540 by @GeorgeSittas)b7e08cc- duckdb: parse DATEDIFF correctly (PR #1546 by @GeorgeSittas)f21abb7- oracle: set post_tablesample_alias=True to fix alias parsing (PR #1548 by @GeorgeSittas)8ebba48- binary_double/float types closes #1543 (commit by @tobymao)2a6a3e7- make some SQL builders pure (PR #1526 by @GeorgeSittas)99310c4- duckdb: remove parentheses from CurrentTimestamp, CurrentDate (PR #1551 by @GeorgeSittas)- ↘️ fixes issue #1550 opened by @BTheunissen
a113685- spark: cast UnixToTime to TIMESTAMP BREAKING (PR #1549 by @GeorgeSittas)- ↘️ fixes issue #1545 opened by @joshmarcus
🔧 Chores
v11.7.0 - 2023-05-02
✨ New Features
20cacba- tsql, oracle: add support for NEXT VALUE FOR clause (PR #1521 by @GeorgeSittas)96bb150- builder methods for basic ops (PR #1516 by @tobymao)e11a5ce- add case when change func to parse BREAKING (commit by @tobymao)455b9e9- oracle: support KEEP (.. [FIRST|LAST] ..) window function syntax (PR #1522 by @GeorgeSittas)
🐛 Bug Fixes
94fed8c- call _parse_bitwise as a fallback for nested type args (PR #1515 by @GeorgeSittas)52ab03d- array with method calls (commit by @tobymao)c3db2b8- allow parsing 'if' as an identifier (PR #1517 by @GeorgeSittas)
🔧 Chores
d5d360a- Remove older CHANGELOG entries and let CI handle it from now on (commit by @GeorgeSittas)
v11.6.3 - 2023-05-01
✨ New Features
80287dd- presto: transpile explode/posexplode into (cross join) unnest (PR #1501 by @GeorgeSittas)
🐛 Bug Fixes
efd8c05- redshift doesn't support locks (commit by @tobymao)f4ece7c- comment after paren closes #1504 (commit by @tobymao)85b2c00- postgres doesn't support plural interval closes #1503 (commit by @tobymao)2e0eee6- postgres date_part type closes #1506 (commit by @tobymao)2dcbc7f- tsql hashbytes closes #1508 (commit by @tobymao)5347c7a- change str to Expression in alias_ isinstance check (PR #1510 by @GeorgeSittas)f137815- BigQueryTIMESTAMPandTIMESTAMPTZtypes (PR #1511 by @plaflamme)6143491- allow $ to appear in postgres/redshift identifiers (PR #1512 by @GeorgeSittas)
🔧 Chores
adc526c- add note about conventional commit naming in CONTRIBUTING.md (commit by @GeorgeSittas)9421650- set action for automatic conventional changelog generation (PR #1513 by @GeorgeSittas)