Commit Graph

413 Commits

Author SHA1 Message Date
Kijin-Seija
a5c6d2e1f8 init 2024-06-19 20:14:16 +08:00
Kijin-Seija
fe2b0fd9ea 4.0.2-0 2024-06-07 15:49:18 +08:00
Kijin-Seija
9ac6039146 init 2024-06-07 15:41:22 +08:00
Hayden
63df067ae6 chore(release): 4.0.1 2024-04-28 11:42:05 +08:00
Hayden
f1c3bbe17c
feat: deprecate legacy APIs (#304)
* feat: deprecation of legacy APIs

* feat: deprecate plsql language
2024-04-28 11:41:13 +08:00
Hayden
a5387e4729 chore(release): 4.0.0 2024-04-28 10:53:12 +08:00
琉易
25358ec653
fix: #301 pgsql truncate table suggestion (#302) 2024-04-26 09:38:15 +08:00
Hayden
8baabd027b chore(release): 4.0.0-beta.4.15 2024-04-21 12:17:42 +08:00
琉易
0e752fb9a8
fix: #298 support hive set configuration properties (#299)
* fix: #298 support hive set configuration properties

* feat: simplify the hive syntax file
2024-04-21 12:13:06 +08:00
琉易
31b57a494b
fix: #295 #297 optimize impala data types suggestion and create table (#296)
* fix: #295 impala data types suggestion

* fix: #297 impala create table with STRUCT
2024-04-21 12:10:36 +08:00
Hayden
fa30fe9253 chore(release): 4.0.0-beta.4.14 2024-04-19 17:22:16 +08:00
琉易
37974ca0cb
fix: #290 hive lifecycle (#293) 2024-04-19 17:19:36 +08:00
Hayden
1a0e2fa77b chore(release): 4.0.0-beta.4.13 2024-04-19 09:35:29 +08:00
琉易
da77180a50
feat: #290 support dtstack SparkSQL/HiveSQL lifecycle (#292) 2024-04-19 09:32:10 +08:00
Hayden
8bb27ee771
fix: #285 No longer just export types from libs (#286) 2024-04-07 18:25:23 +08:00
Hayden
87c46a999b chore(release): 4.0.0-beta.4.12 2024-03-28 19:45:28 +08:00
Hayden
ddf6c8fd8f
docs: update README (#280)
* docs: update readme.md

* docs: update readme

* docs: update docs
2024-03-28 19:39:06 +08:00
Hayden
c6615aecac
build: open ts strict check (#279)
* feat: no check lib dir

* feat: open strict check to src dir

* test: update test tsconfig.json

* feat: remove any type

* feat: do not export AbstractParseTreeVisitor

* feat: export StmtContextType as enum

* build: improve antlr4 script
2024-03-27 19:04:16 +08:00
Hayden
bb0fad1dbe
refactor: standard naming (#278)
* refactor: rename flinksql to flink

* refactor: rename pgsql to postgresql

* refactor: rename trinosql to trino

* refactor: replace all default exports with named export

* refactor: rename basicParser to basicSQL

* refactor: rename basic-parser-types to types

* refactor: replace arrow func with plain func
2024-03-27 10:33:25 +08:00
Hayden
a99721162b
feat: collect entity (#265)
* feat: add text and word utils

* feat: add entity collector class

* refactor: rename SyntaxContextType to EntityContextType

* refactor: improve EntityCollector

* feat: improve mysql parser grammar

* feat: add mysql entity collector

* test: mysql entity collector tests

* feat: remove useless method

* feat: improve spark grammar file

* feat: add spark entity collector

* test: spark entity collector unit tests

* feat: remove useless code

* feat: add queryStatement label

* feat: add crateDatabaseStmt

* feat: add trino entity collector

* feat: rename trinosql to trino

* test: trino collect entity unit tests

* test: fix spark test

* feat(impala): support impale entity collector (#256)

* Feat/collect entity hive (#263)

* feat(hive): support hive collect entity

* feat(hive): update tableAllColumns

* feat: replace antlr4ts with antlr4ng

* feat(pgsql): pgsql collect entity (#268)

* feat(pgsql): pgsql collect entity

* feat(pgsql): optimize some name

---------

Co-authored-by: zhaoge <>

* feat: get word text by token.text

* feat: supprt collect db/function and add splitListener (#270)

* feat: supprt collect db/function and add splitListner

* feat: remove SplitListener interface in baseParser to use SplitListener in root

* fix(mysql): fix show create xxx not celloct as createXXXEntity type

* test: fix pgsql unit tests

* Feat/error recover predicate (#274)

* feat: optimize pgsql grammar

* feat: add sql parser base

* feat: apply SQLParserBase

* feat: add geAllEntities method

* test: test collect table when missing column

* feat: compose collect and suggestion (#276)

* feat: mark stmt which contain caret

* test: correct name of getAllEntities

* test: remove misscolumn unit tests

* test: add suggestionWithEntity tests

* feat: flink collect entity (#277)

* feat: improve flink sql parser

* feat: support flink entity collector

* test: flink entity collect unit test

* feat: move combine entities to parent class

---------

Co-authored-by: 霜序 <976060700@qq.com>
Co-authored-by: XCynthia <942884029@qq.com>
2024-03-26 14:28:27 +08:00
Hayden
3f62ad0d32
feat: use SLL mode (#269)
* feat: use SLL(*) PredictionMode for better performance

* feat: optimize mysql grammar to fit SLL mode

* feat: optimize postgre grammmar to fit SLL mode

* feat: optimize spark grammar to fit SLL mode

* test: correct unit tests

* feat: optimize pgsql grammar
2024-03-19 11:27:23 +08:00
JackWang032
a05f099aa1
feat: add toMatchUnorderedArrary matcher and apply it (#271)
* feat: add toMatchUnorderedArrary matcher replace tokenSuggestion test

* fix: revert benchmark and replace matcher of trinosql

---------

Co-authored-by: jialan <jialan@dtstack.com>
2024-03-01 16:48:53 +08:00
Hayden
195878da9b
feat: migrate to antlr4ng (#267)
* feat: replace antlr4ts with antlr4ng

* feat: switch caseInsensitive option on

* feat: recompile all g4 file

* feat:  update parser to fit antlr4ng

* test: update test to fit antlr4ng
2024-02-26 20:25:09 +08:00
JackWang032
5ce89cb421
feat(spark): support materialized view for spark sql (#262)
* feat(spark): support materialized view for spark sql

* fix(spark): code review update

* fix(spark): update spark  materilized view and zorder grammar

* test(spark): add syntaxSuggestion test of materialized view

---------

Co-authored-by: jialan <jialan@dtstack.com>
2024-02-26 17:25:19 +08:00
hayden
081ff7f067 docs: update feature_request issue template 2024-02-06 14:32:23 +08:00
hayden
d11a39556b docs: add issue templates 2024-02-06 14:28:35 +08:00
XCynthia
337885be8b
fix(pgsql): (issue #255) select from support view name (#257)
Co-authored-by: zhaoge <>
2024-02-05 16:24:14 +08:00
Hayden
ecbbee32c7
test: remove barrier files to improve unit testing performance (#249)
* test: remove barrier files to improve unit testing performance

* chore: change check-types command
2024-01-19 21:10:00 +08:00
Hayden
1038a3a828
fix: trino validation (#248)
* fix: #246 program does not match standaloneClause

* test: patch unit tests
2024-01-16 11:14:03 +08:00
hayden
30b7f27486 chore(release): 4.0.0-beta.4.11 2024-01-04 11:48:51 +08:00
霜序
4d19f05890 fix: rename createLexerFormCharStream to createLexerFromCharStream (#243) 2024-01-04 11:47:19 +08:00
hayden
1c288b737a docs: replace index png 2023-12-25 16:10:34 +08:00
Hayden
9c52542ec7
Feat/range boundary (#241)
* feat: unify the index, line and column in all APIs

* docs: describe index, line and column
2023-12-22 19:12:29 +08:00
hayden
f6bc7594e1 docs: update visitor demo 2023-12-20 11:12:18 +08:00
hayden
24dee75dfe chore(release): 4.0.0-beta.4.10 2023-12-19 20:55:17 +08:00
hayden
447ab7f331 docs: update visitor demo and listener demo 2023-12-19 20:51:40 +08:00
hayden
d4c97ef833 feat: export visitor and listener as type 2023-12-19 20:03:15 +08:00
Hayden
8f72a5af60
Fix/export abstract visitor (#237)
* fix: #236 export AbstractParseTreeVisitor

* build: set isolatedModules true

* feat: import parser about from filters
2023-12-19 19:22:27 +08:00
hayden
55a4832047 chore(release): 4.0.0-beta.4.9 2023-12-13 11:45:39 +08:00
hayden
2ce915cf5d build: remove baseUrl conf because it is danger 2023-12-13 11:38:30 +08:00
Hayden
3c7c59fb70
feat: optimize suggestion (#231)
* feat: optimize the strategy of finding the right range

* test: apply commentOtherLine util to all suggestion tests

* test: decomment suggestion test cases

* test: add suggestion test cases in multiple statements

* chore: improve comments

* test: update log info in test
2023-12-13 11:33:47 +08:00
Hayden
fd50c09a86
docs: update README (#234) 2023-12-12 20:30:44 +08:00
Hayden
14a5214e82
support format g4 (#232)
* chore: install antlr-format-cli to format g4 files

* style: format all g4 files

* chore: apply antlr-format to lint-staged
2023-12-12 20:05:21 +08:00
hayden
17eba1f2aa feat: add readonly modifier 2023-12-12 20:04:18 +08:00
hayden
eb5b0a5550 refactor: move findCaretTokenIndex file to parser/common/utils 2023-12-12 20:04:18 +08:00
hayden
96b0376510 fix: correct import path 2023-12-12 20:04:18 +08:00
Hayden
ee8b468778
feat: add ErrorStrategy(#230)
* refactor: rename errorHandler to errorListener

* feat: add ErrorStrategy to mark context exceptions

* test: errorStrategy unit tests
2023-12-11 17:34:49 +08:00
hayden
61a00d7bb8 build: remove sourceMap 2023-12-08 20:29:34 +08:00
Hayden
23f5aac113
Fix/split listener (#228)
* feat: improve FlinkSqlSplitListener

* feat: improve ImpalaSqlSplitListener

* feat: improve MysqlSplitListener

* fix: correct PgSqlSplitListener

* feat: improve TrinoSqlSplitListener

* test: add split listener unit test

* chore: ignore iml file

* feat: add pgsql missing rules

* test: fix pgsql unit tests
2023-12-08 18:33:16 +08:00
霜序
8c594cf0f2
fix(impala): update impala nonReserved and keywords use as functionName (#229) 2023-12-07 13:52:09 +08:00