oushu/lava-oushudb-dt-sql-parser
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
409 Commits 1 Branch 0 Tags 47 MiB
f1c3bbe17c
Commit Graph

41 Commits

Author SHA1 Message Date
琉易
0e752fb9a8
fix: #298 support hive set configuration properties (#299) 
* fix: #298 support hive set configuration properties

* feat: simplify the hive syntax file
 2024-04-21 12:13:06 +08:00
琉易
37974ca0cb
fix: #290 hive lifecycle (#293) 2024-04-19 17:19:36 +08:00
琉易
da77180a50
feat: #290 support dtstack SparkSQL/HiveSQL lifecycle (#292) 2024-04-19 09:32:10 +08:00
Hayden
c6615aecac
build: open ts strict check (#279) 
* feat: no check lib dir

* feat: open strict check to src dir

* test: update test tsconfig.json

* feat: remove any type

* feat: do not export AbstractParseTreeVisitor

* feat: export StmtContextType as enum

* build: improve antlr4 script
 2024-03-27 19:04:16 +08:00
Hayden
bb0fad1dbe
refactor: standard naming (#278) 
* refactor: rename flinksql to flink

* refactor: rename pgsql to postgresql

* refactor: rename trinosql to trino

* refactor: replace all default exports with named export

* refactor: rename basicParser to basicSQL

* refactor: rename basic-parser-types to types

* refactor: replace arrow func with plain func
 2024-03-27 10:33:25 +08:00
Hayden
a99721162b
feat: collect entity (#265) 
* feat: add text and word utils

* feat: add entity collector class

* refactor: rename SyntaxContextType to EntityContextType

* refactor: improve EntityCollector

* feat: improve mysql parser grammar

* feat: add mysql entity collector

* test: mysql entity collector tests

* feat: remove useless method

* feat: improve spark grammar file

* feat: add spark entity collector

* test: spark entity collector unit tests

* feat: remove useless code

* feat: add queryStatement label

* feat: add crateDatabaseStmt

* feat: add trino entity collector

* feat: rename trinosql to trino

* test: trino collect entity unit tests

* test: fix spark test

* feat(impala): support impale entity collector (#256)

* Feat/collect entity hive (#263)

* feat(hive): support hive collect entity

* feat(hive): update tableAllColumns

* feat: replace antlr4ts with antlr4ng

* feat(pgsql): pgsql collect entity (#268)

* feat(pgsql): pgsql collect entity

* feat(pgsql): optimize some name

---------

Co-authored-by: zhaoge <>

* feat: get word text by token.text

* feat: supprt collect db/function and add splitListener (#270)

* feat: supprt collect db/function and add splitListner

* feat: remove SplitListener interface in baseParser to use SplitListener in root

* fix(mysql): fix show create xxx not celloct as createXXXEntity type

* test: fix pgsql unit tests

* Feat/error recover predicate (#274)

* feat: optimize pgsql grammar

* feat: add sql parser base

* feat: apply SQLParserBase

* feat: add geAllEntities method

* test: test collect table when missing column

* feat: compose collect and suggestion (#276)

* feat: mark stmt which contain caret

* test: correct name of getAllEntities

* test: remove misscolumn unit tests

* test: add suggestionWithEntity tests

* feat: flink collect entity (#277)

* feat: improve flink sql parser

* feat: support flink entity collector

* test: flink entity collect unit test

* feat: move combine entities to parent class

---------

Co-authored-by: 霜序 <976060700@qq.com>
Co-authored-by: XCynthia <942884029@qq.com>
 2024-03-26 14:28:27 +08:00
JackWang032
a05f099aa1
feat: add toMatchUnorderedArrary matcher and apply it (#271) 
* feat: add toMatchUnorderedArrary matcher replace tokenSuggestion test

* fix: revert benchmark and replace matcher of trinosql

---------

Co-authored-by: jialan <jialan@dtstack.com>
 2024-03-01 16:48:53 +08:00
Hayden
195878da9b
feat: migrate to antlr4ng (#267) 
* feat: replace antlr4ts with antlr4ng

* feat: switch caseInsensitive option on

* feat: recompile all g4 file

* feat:  update parser to fit antlr4ng

* test: update test to fit antlr4ng
 2024-02-26 20:25:09 +08:00
Hayden
ecbbee32c7
test: remove barrier files to improve unit testing performance (#249) 
* test: remove barrier files to improve unit testing performance

* chore: change check-types command
 2024-01-19 21:10:00 +08:00
Hayden
1038a3a828
fix: trino validation (#248) 
* fix: #246 program does not match standaloneClause

* test: patch unit tests
 2024-01-16 11:14:03 +08:00
Hayden
8f72a5af60
Fix/export abstract visitor (#237) 
* fix: #236 export AbstractParseTreeVisitor

* build: set isolatedModules true

* feat: import parser about from filters
 2023-12-19 19:22:27 +08:00
Hayden
3c7c59fb70
feat: optimize suggestion (#231) 
* feat: optimize the strategy of finding the right range

* test: apply commentOtherLine util to all suggestion tests

* test: decomment suggestion test cases

* test: add suggestion test cases in multiple statements

* chore: improve comments

* test: update log info in test
 2023-12-13 11:33:47 +08:00
Hayden
ee8b468778
feat: add ErrorStrategy(#230) 
* refactor: rename errorHandler to errorListener

* feat: add ErrorStrategy to mark context exceptions

* test: errorStrategy unit tests
 2023-12-11 17:34:49 +08:00
Hayden
23f5aac113
Fix/split listener (#228) 
* feat: improve FlinkSqlSplitListener

* feat: improve ImpalaSqlSplitListener

* feat: improve MysqlSplitListener

* fix: correct PgSqlSplitListener

* feat: improve TrinoSqlSplitListener

* test: add split listener unit test

* chore: ignore iml file

* feat: add pgsql missing rules

* test: fix pgsql unit tests
 2023-12-08 18:33:16 +08:00
Hayden
31a811d1bb
Feat column codeCompletion (#218) 
* feat: flink support column suggestion

* feat: flink column suggestion unit test

* feat: hive support column suggestion

* feat: hive column suggestion unit test

* feat: trinosql support column suggestion

* feat: trino column suggest unit test

* feat: sparksql collect column suggesstion

* feat: spark column suggestion unit test

* feat: rebuild flinksql lib
 2023-11-28 21:18:44 +08:00
琉易
0d9d3d65f3
test: accurate description (#183) 
* test: accurate description

* refactor: optimize the use of tableName and viewName for

---------

Co-authored-by: liuyi <liuyi@dtstack.com>
 2023-10-18 10:53:43 +08:00
Hayden
f9dbd9fc23
Refactor/basic parser (#182) 
* feat: replace errorCollector with ParserErrorListener to collect lexer error

* refactor: remove useless method in basicParser

* feat: correct splitSQLByStatement method

* feat: rename parse to parseWithCache and add new parse method

* refactor: rename parserTree to parseTree

* test: rename parserTree to parseTree

* refactor: rename parserError to parseError

* feat: export ErrorHandler type

* feat: use errorhandler form params

* test: basic parser unit tests

* style: lint via prettier
 2023-10-16 17:59:28 +08:00
Hayden
7de192d486
chroe: devops (#180) 
* ci: add dependencies about lint tool

* ci: replace eslint with prettier

* ci: add husky, cz and commitlint

* style: lint fix via prettier

* ci: add prettier and check-types to github workflow

'
 2023-10-13 11:16:36 +08:00
琉易
4d1dfa676f
feat: support spark sql auto complete (#179) 
* refactor: spark sql g4

* feat: support spark sql suggestion

* test: spark sql suggestion unit test

* test: hive spell check

* feat: spark sql keyword has multiple values

* test: KW_NOT KW_RLIKE split into two value

---------

Co-authored-by: liuyi <liuyi@dtstack.com>
 2023-10-12 17:08:21 +08:00
Hayden
c4030929b2
Feat/auto complete (#175) 
* feat: update hive grammar to adapt to c3

* feat: support viewName, dbName, fnName autoComplete to hive

* test: add hive suggestion unit test

* test: optimze flink suggestion unit tests
 2023-10-10 16:37:49 +08:00
XCynthia
0a9a7d15d3
test: hive complete data types' check and unit tests (#160) 
* feat: add Authorization SQL and update syntax file

* test: hive complete data types' check and unit tests

* feat: hive add syntax complete automaticlly

* feat: update hive's syntax complete

feat:update hive's syntax complete

---------

Co-authored-by: zhaoge <>
 2023-10-08 14:14:03 +08:00
XCynthia
2ec03f1770
feat: hive Authorization syntax and unit tests (#159) 
Co-authored-by: zhaoge <>
 2023-09-12 20:10:43 +08:00
XCynthia
6a99d63d71
test: hive select/describe/load/alterTable syntax unit test (#158) 
Co-authored-by: zhaoge <>
 2023-09-11 18:52:25 +08:00
XCynthia
97ab76af76
Feat check hive create syntax (#157) 
* check and update abort and alter sql

* delete superfluous space

* update grammar lib after change alter parser

* update alter parser to be compatible

* check create sql

---------

Co-authored-by: zhaoge <>
 2023-09-06 16:42:04 +08:00
Hayden
885b85e842
Test/hive dml (#155) 
* feat: add showIndex parser rule

* test: uncomment show index test cases

* test: add unit tests about DML syntax to HiveSQL

* test: add unit tests about export and import syntax to HiveSQL

* refactor: recompile hive grammar

* test: correct description of HiveSQL unit tests
 2023-09-06 15:15:04 +08:00
XCynthia
6dad62ddf4
check alter sql and syntax (#156) 
* check and update abort and alter sql

* delete superfluous space

* update grammar lib after change alter parser

* update alter parser to be compatible

---------

Co-authored-by: zhaoge <>
 2023-09-06 11:46:46 +08:00
Hayden
af1d71c576
Feat/hive ddl (#150) 
* test: test cases about Alter Either Table or Partition

* feat: support alter protection and correct alter compact

* feat: improve keyword rules

* feat: recompile hive grammar
 2023-08-30 17:58:20 +08:00
hayden
13e52f50f7 test: hivesql schedule query ddl syntax unit tests 2023-07-10 10:37:19 +08:00
hayden
faabeffe8a test: hivesql abort syntax unit tests 2023-07-10 10:21:16 +08:00
hayden
c6f6599126 test: hivesql describe syntax unit tests 2023-07-10 10:19:30 +08:00
hayden
5f0a0851a6 test: hivesql show syntax unit tests 2023-07-10 10:09:28 +08:00
hayden
af1c640c9d test: hivesql drop syntax unit tests 2023-07-10 10:09:03 +08:00
hayden
6f7a59775c test: hivesql alter syntax unit tests 2023-07-07 17:04:37 +08:00
hayden
f1ca0738d3 test: hiveSQL test units of index 2023-07-07 14:52:59 +08:00
hayden
28de63e1f0 test: hiveSQL createStatement unit tests 2023-07-07 14:48:44 +08:00
Ziv
34f64e6bea
refactor: migrate antlr4 v4.12.0 to antlr4ts(4.9.0) (#106) 
* build: ignore gen folder

* refactor: remove useless code

* fix: correct the Javascript usage in grammar

* refactor: move to antlr4ts

* fix: remove useless

* fix: update grammars for javascript target

* refactor: migrate to antlr4ts

* refactor: migrate to antlr4ts

* refactor: implements ParserErrorListener

* fix: rename the  start reserved word

* refactor: remove unused import

* refactor: migrate to antlr4ts

* test: update the expects of test cases

* refactor: migrate hive to antlr4ts

* refactor: update the incompatible syntax for antlr4ts

* refactor: migrate pgsql grammar to antlr4ts, increasing tests

* refactor: migrate the plsql to antlr4ts

* build: remove unused config

* build: migrate to antlr4ts

* build: migrate ts-jest to @swc/jest

* refactor: migrate to anltr4ts

* build: migrate ts-jest to @swc/jest
 2023-05-30 14:44:03 +08:00
Ziv
c1c72def30
feat: upgrade antlr4 to 4.12.0 (#88) 2023-05-04 10:13:05 +08:00
xiaowei
57aba357ab refactor(hive): extract hive export into src index 2021-01-05 17:45:54 +08:00
chenfeng
cb1fcb7ed6 test: add hivesql unit test 2020-11-25 17:04:55 +08:00
chenfeng
110c4f1fa5 test: add hive validate unit test 2020-11-25 15:04:22 +08:00
xiaowei
f85163892a feat: add generic and plsql basic parser file 2020-09-11 17:39:10 +08:00