Hayden
c6615aecac
build: open ts strict check ( #279 )
...
* feat: no check lib dir
* feat: open strict check to src dir
* test: update test tsconfig.json
* feat: remove any type
* feat: do not export AbstractParseTreeVisitor
* feat: export StmtContextType as enum
* build: improve antlr4 script
2024-03-27 19:04:16 +08:00
Hayden
bb0fad1dbe
refactor: standard naming ( #278 )
...
* refactor: rename flinksql to flink
* refactor: rename pgsql to postgresql
* refactor: rename trinosql to trino
* refactor: replace all default exports with named export
* refactor: rename basicParser to basicSQL
* refactor: rename basic-parser-types to types
* refactor: replace arrow func with plain func
2024-03-27 10:33:25 +08:00
Hayden
a99721162b
feat: collect entity ( #265 )
...
* feat: add text and word utils
* feat: add entity collector class
* refactor: rename SyntaxContextType to EntityContextType
* refactor: improve EntityCollector
* feat: improve mysql parser grammar
* feat: add mysql entity collector
* test: mysql entity collector tests
* feat: remove useless method
* feat: improve spark grammar file
* feat: add spark entity collector
* test: spark entity collector unit tests
* feat: remove useless code
* feat: add queryStatement label
* feat: add crateDatabaseStmt
* feat: add trino entity collector
* feat: rename trinosql to trino
* test: trino collect entity unit tests
* test: fix spark test
* feat(impala): support impale entity collector (#256 )
* Feat/collect entity hive (#263 )
* feat(hive): support hive collect entity
* feat(hive): update tableAllColumns
* feat: replace antlr4ts with antlr4ng
* feat(pgsql): pgsql collect entity (#268 )
* feat(pgsql): pgsql collect entity
* feat(pgsql): optimize some name
---------
Co-authored-by: zhaoge <>
* feat: get word text by token.text
* feat: supprt collect db/function and add splitListener (#270 )
* feat: supprt collect db/function and add splitListner
* feat: remove SplitListener interface in baseParser to use SplitListener in root
* fix(mysql): fix show create xxx not celloct as createXXXEntity type
* test: fix pgsql unit tests
* Feat/error recover predicate (#274 )
* feat: optimize pgsql grammar
* feat: add sql parser base
* feat: apply SQLParserBase
* feat: add geAllEntities method
* test: test collect table when missing column
* feat: compose collect and suggestion (#276 )
* feat: mark stmt which contain caret
* test: correct name of getAllEntities
* test: remove misscolumn unit tests
* test: add suggestionWithEntity tests
* feat: flink collect entity (#277 )
* feat: improve flink sql parser
* feat: support flink entity collector
* test: flink entity collect unit test
* feat: move combine entities to parent class
---------
Co-authored-by: 霜序 <976060700@qq.com>
Co-authored-by: XCynthia <942884029@qq.com>
2024-03-26 14:28:27 +08:00
Hayden
3f62ad0d32
feat: use SLL mode ( #269 )
...
* feat: use SLL(*) PredictionMode for better performance
* feat: optimize mysql grammar to fit SLL mode
* feat: optimize postgre grammmar to fit SLL mode
* feat: optimize spark grammar to fit SLL mode
* test: correct unit tests
* feat: optimize pgsql grammar
2024-03-19 11:27:23 +08:00
JackWang032
a05f099aa1
feat: add toMatchUnorderedArrary matcher and apply it ( #271 )
...
* feat: add toMatchUnorderedArrary matcher replace tokenSuggestion test
* fix: revert benchmark and replace matcher of trinosql
---------
Co-authored-by: jialan <jialan@dtstack.com>
2024-03-01 16:48:53 +08:00
Hayden
195878da9b
feat: migrate to antlr4ng ( #267 )
...
* feat: replace antlr4ts with antlr4ng
* feat: switch caseInsensitive option on
* feat: recompile all g4 file
* feat: update parser to fit antlr4ng
* test: update test to fit antlr4ng
2024-02-26 20:25:09 +08:00
JackWang032
5ce89cb421
feat(spark): support materialized view for spark sql ( #262 )
...
* feat(spark): support materialized view for spark sql
* fix(spark): code review update
* fix(spark): update spark materilized view and zorder grammar
* test(spark): add syntaxSuggestion test of materialized view
---------
Co-authored-by: jialan <jialan@dtstack.com>
2024-02-26 17:25:19 +08:00
Hayden
ecbbee32c7
test: remove barrier files to improve unit testing performance ( #249 )
...
* test: remove barrier files to improve unit testing performance
* chore: change check-types command
2024-01-19 21:10:00 +08:00
Hayden
1038a3a828
fix: trino validation ( #248 )
...
* fix : #246 program does not match standaloneClause
* test: patch unit tests
2024-01-16 11:14:03 +08:00
Hayden
8f72a5af60
Fix/export abstract visitor ( #237 )
...
* fix : #236 export AbstractParseTreeVisitor
* build: set isolatedModules true
* feat: import parser about from filters
2023-12-19 19:22:27 +08:00
Hayden
3c7c59fb70
feat: optimize suggestion ( #231 )
...
* feat: optimize the strategy of finding the right range
* test: apply commentOtherLine util to all suggestion tests
* test: decomment suggestion test cases
* test: add suggestion test cases in multiple statements
* chore: improve comments
* test: update log info in test
2023-12-13 11:33:47 +08:00
Hayden
ee8b468778
feat: add ErrorStrategy( #230 )
...
* refactor: rename errorHandler to errorListener
* feat: add ErrorStrategy to mark context exceptions
* test: errorStrategy unit tests
2023-12-11 17:34:49 +08:00
Hayden
23f5aac113
Fix/split listener ( #228 )
...
* feat: improve FlinkSqlSplitListener
* feat: improve ImpalaSqlSplitListener
* feat: improve MysqlSplitListener
* fix: correct PgSqlSplitListener
* feat: improve TrinoSqlSplitListener
* test: add split listener unit test
* chore: ignore iml file
* feat: add pgsql missing rules
* test: fix pgsql unit tests
2023-12-08 18:33:16 +08:00
Hayden
31a811d1bb
Feat column codeCompletion ( #218 )
...
* feat: flink support column suggestion
* feat: flink column suggestion unit test
* feat: hive support column suggestion
* feat: hive column suggestion unit test
* feat: trinosql support column suggestion
* feat: trino column suggest unit test
* feat: sparksql collect column suggesstion
* feat: spark column suggestion unit test
* feat: rebuild flinksql lib
2023-11-28 21:18:44 +08:00
琉易
0d9d3d65f3
test: accurate description ( #183 )
...
* test: accurate description
* refactor: optimize the use of tableName and viewName for
---------
Co-authored-by: liuyi <liuyi@dtstack.com>
2023-10-18 10:53:43 +08:00
Hayden
f9dbd9fc23
Refactor/basic parser ( #182 )
...
* feat: replace errorCollector with ParserErrorListener to collect lexer error
* refactor: remove useless method in basicParser
* feat: correct splitSQLByStatement method
* feat: rename parse to parseWithCache and add new parse method
* refactor: rename parserTree to parseTree
* test: rename parserTree to parseTree
* refactor: rename parserError to parseError
* feat: export ErrorHandler type
* feat: use errorhandler form params
* test: basic parser unit tests
* style: lint via prettier
2023-10-16 17:59:28 +08:00
Hayden
7de192d486
chroe: devops ( #180 )
...
* ci: add dependencies about lint tool
* ci: replace eslint with prettier
* ci: add husky, cz and commitlint
* style: lint fix via prettier
* ci: add prettier and check-types to github workflow
'
2023-10-13 11:16:36 +08:00
琉易
4d1dfa676f
feat: support spark sql auto complete ( #179 )
...
* refactor: spark sql g4
* feat: support spark sql suggestion
* test: spark sql suggestion unit test
* test: hive spell check
* feat: spark sql keyword has multiple values
* test: KW_NOT KW_RLIKE split into two value
---------
Co-authored-by: liuyi <liuyi@dtstack.com>
2023-10-12 17:08:21 +08:00
Frank
d0ad381833
test: spark sql query syntax unit test ( #173 )
...
* test: add spark query unit test and check grammar
* test: add select explain、lateralSubQuery、transform unit test
* chore: fileName exchange
---------
Co-authored-by: dilu <dilu@dtstack.com>
2023-10-10 16:25:43 +08:00
琉易
7bbaba6398
test: spark DML test ( #169 )
...
Co-authored-by: liuyi <liuyi@dtstack.com>
2023-10-09 09:51:16 +08:00
琉易
d13a92914d
feat: spark sql DDL test ( #170 )
...
Co-authored-by: liuyi <liuyi@dtstack.com>
2023-10-09 09:49:48 +08:00
Frank
d1c2920f80
Feat/spark sql auxiliary syntax ( #165 )
...
* feat: supplement SparkSQL add syntax unit test
* chore: recompile spark listener & visitor
---------
Co-authored-by: dilu <dilu@dtstack.com>
2023-10-09 09:49:22 +08:00
Frank
05da14d007
Feat/spark g4 ( #168 )
...
* feat: spark g4 test
* fix: fixed build lint
---------
Co-authored-by: liuyi <liuyi@dtstack.com>
Co-authored-by: dilu <dilu@dtstack.com>
2023-10-08 14:23:06 +08:00
Ziv
34f64e6bea
refactor: migrate antlr4 v4.12.0 to antlr4ts(4.9.0) ( #106 )
...
* build: ignore gen folder
* refactor: remove useless code
* fix: correct the Javascript usage in grammar
* refactor: move to antlr4ts
* fix: remove useless
* fix: update grammars for javascript target
* refactor: migrate to antlr4ts
* refactor: migrate to antlr4ts
* refactor: implements ParserErrorListener
* fix: rename the start reserved word
* refactor: remove unused import
* refactor: migrate to antlr4ts
* test: update the expects of test cases
* refactor: migrate hive to antlr4ts
* refactor: update the incompatible syntax for antlr4ts
* refactor: migrate pgsql grammar to antlr4ts, increasing tests
* refactor: migrate the plsql to antlr4ts
* build: remove unused config
* build: migrate to antlr4ts
* build: migrate ts-jest to @swc/jest
* refactor: migrate to anltr4ts
* build: migrate ts-jest to @swc/jest
2023-05-30 14:44:03 +08:00
Ziv
c1c72def30
feat: upgrade antlr4 to 4.12.0 ( #88 )
2023-05-04 10:13:05 +08:00
xiaowei
5404cdd4d0
test: unit test for the custom variables
2021-09-10 17:50:58 +08:00
xiaowei
dc9974bbff
refactor(spark): extract spark export into src index
2021-01-05 17:57:33 +08:00
xigua
084efe1aab
modify sparkSql grammar
2020-12-17 16:35:49 +08:00
xigua
edbc87e8f1
update sql parser name
2020-12-17 11:44:45 +08:00
xigua
0d47b7debc
modify grammar, add syntax test
2020-11-05 20:37:07 +08:00
xigua
bfe055be71
add sparkSql base grammar
2020-10-28 21:34:13 +08:00
