oushu/lava-oushudb-dt-sql-parser
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
394 Commits 1 Branch 0 Tags 47 MiB
a99721162b
Commit Graph

152 Commits

Author SHA1 Message Date
hayden
faabeffe8a test: hivesql abort syntax unit tests 2023-07-10 10:21:16 +08:00
hayden
c6f6599126 test: hivesql describe syntax unit tests 2023-07-10 10:19:30 +08:00
hayden
5f0a0851a6 test: hivesql show syntax unit tests 2023-07-10 10:09:28 +08:00
hayden
af1c640c9d test: hivesql drop syntax unit tests 2023-07-10 10:09:03 +08:00
hayden
6f7a59775c test: hivesql alter syntax unit tests 2023-07-07 17:04:37 +08:00
hayden
f1ca0738d3 test: hiveSQL test units of index 2023-07-07 14:52:59 +08:00
hayden
28de63e1f0 test: hiveSQL createStatement unit tests 2023-07-07 14:48:44 +08:00
wewoor
72c13b7bc7 docs: update content 2023-06-14 10:51:01 +08:00
Ziv
e914cf2c33
test: add benchmark for flinksql (#120) 2023-06-13 09:28:48 +08:00
Hayden
e34a9f6128
Fix/basic suggestion (#119) 
* fix: correct suggetion logic in multiple sql case

* test: add multiple sql test case of suggestion

* feat: export SyntaxContextType as enum
 2023-06-12 15:21:27 +08:00
Hayden
1b02ff5d75
feat: FlinkSQL supports auto complete (#115) 
* feat: add antlr4-c3 dependencies

* feat: distinguish table, catalog and database from uid

* feat: move semicolon from sqlStatements to sqlStatement

* chore: move antlr4ts-cli to devDependencies

* feat: improve basic parser and support suggestions of token and syntax

* feat: implement suggest method in sql parsers

* test: flink sql suggestion test cases

* feat: optimize ts defination of suggestion

* feat: add split listener and optimize performance of auto-completion

* test: supplementary flink suggestion unit tests
 2023-06-09 11:22:53 +08:00
Hayden
d750fcd574
test: split flink sql syntax.test.ts (#116) 2023-06-07 09:34:24 +08:00
Ziv
34f64e6bea
refactor: migrate antlr4 v4.12.0 to antlr4ts(4.9.0) (#106) 
* build: ignore gen folder

* refactor: remove useless code

* fix: correct the Javascript usage in grammar

* refactor: move to antlr4ts

* fix: remove useless

* fix: update grammars for javascript target

* refactor: migrate to antlr4ts

* refactor: migrate to antlr4ts

* refactor: implements ParserErrorListener

* fix: rename the  start reserved word

* refactor: remove unused import

* refactor: migrate to antlr4ts

* test: update the expects of test cases

* refactor: migrate hive to antlr4ts

* refactor: update the incompatible syntax for antlr4ts

* refactor: migrate pgsql grammar to antlr4ts, increasing tests

* refactor: migrate the plsql to antlr4ts

* build: remove unused config

* build: migrate to antlr4ts

* build: migrate ts-jest to @swc/jest

* refactor: migrate to anltr4ts

* build: migrate ts-jest to @swc/jest
 2023-05-30 14:44:03 +08:00
Hayden
793ff6ef0e
feat: replace fliePath with slashText to resolve conflict between filePath and arithmetic (#112) 2023-05-30 10:19:13 +08:00
wewoor
99ee6c0998 Merge branch 'master' of github.com:DTStack/dt-sql-parser 2023-05-25 10:53:40 +08:00
wewoor
8084c7919a fix: rename TrinoSqlParser to TrinoSql 2023-05-25 10:53:03 +08:00
Hayden
3509964afc
test: add flink template test cases (#111) 
* feat: rebuild flink sql parser

* test: add sqls templates in stream app test cases
 2023-05-25 09:24:24 +08:00
mumiao
89b22af5ce
docs(readme): fix documentation error (#110) 2023-05-24 17:01:17 +08:00
mumiao
9c82a5d248
feat: support trino(presto) sql language (#105) 
* feat(trino): intergrate prestoGrammar to dt-sql-parser

* feat(trino): add trinoSQl test framework

* feat(trino): intergrate test files for trinoSQL

* test(trino): support alterStatement test

* test(trino): support alter table set authorization statement

* feat(trino): complete trinosql alter unit tests

* test(trino): complete dropStatement unit cases for trinosql

* test(trino): complete create statement unit cases for trinoSQL

* test(trino): complete insertStatement unit cases for trinoSQl

* test(trino): dropStatement test files changed to short line split

* test(trino): complete selectStatement unit cases and grammar check

* test(trino): complete commentStatement unit case for trinoSQL

* test(trino): complete analyze commit and call clause unit case

* test(trino): complete delete deny and describe statement unit case

* test(trino): complete explain execute and grant statement unit case

* feat(trino): improve GRANT Role grammar

* test(trino): complete show statement unit case

* test(trino): complete truncateTable startTransaction update and values  statement unit case

* test(trino): improve update statement test cases

* test(trino): complete revoke revoke roles  and rollback statement unit case

* test(trino): add set statement test case

* feat: generator new trino parser and lexer file

* feat(trino): improve alter statement grammar

* test(trino): complete alter statement unit cases

* feat(trino): support case-insensitive lexers

* fix(trino): rm unless gen files

* test(trino): complete merge and reset session statement unit cases

* test(trino): complete merge anduse statement unit cases

* test(trino): complete prepare and refresh materialized view statement unit cases

* test(trino): improve statement unit cases

* test(trino): complete match recognize statement unit cases

* test(trino): complete window with row pattern recognition statement unit cases
 2023-05-24 15:07:02 +08:00
Hayden
0924acf730
feat: update the builtin funcs of flinksql (#102) 
* style: put evrry branch on a single line

* feat: support ASYMMETRIC and SYMMETRIC for between and

* feat: support SIMILAR TO predicate

* feat: support nested boolean expression

* feat: support escape to like and similar in flink sql

* test: add where clause test cases

* feat: add reservedKeywordsUsedAsFunctionName rule

* feat: add timepointLiteral rule and improve function call grammar
 2023-05-24 15:03:08 +08:00
mumiao
c409b80ee1
feat(flink): support insert multipe tables statement for FlinkSQL 1.15(#104) 
* feat(flink): support insert multipe tables statement for FlinkSQL 1.15

* test: recover jest.config info

* fix(flink): correct typo

* fix(flinksql): resolve conflicts
 2023-05-23 14:40:52 +08:00
野迂迂
4b824fb500
feat(flink): support NOT NULL syntax (#103) 
* feat(flink): support NOT NULL syntax

* feat(flinksql): support NULL
 2023-05-23 10:12:05 +08:00
Hayden
40c911597b
refactor: improve keywords definations (#100) 
* feat: improve keywords definations and add prefix named KW_

* test: capitalize keywords in alter sql test cases

* test: capitalize keywords in create sql test cases

* feat: merge interval rule and timeIntervalExpression rule in flinksql grammar

* test: put keywords in quotation marks around insert sql test cases

* test: put keywords in quotation marks around select sql test cases

* feat: improve uid rule

* test: rename sum to _sum because it is a reserved keyword

* docs: improve comments in flinkSqlLexer
 2023-05-19 14:28:25 +08:00
Hayden
a026ae0592
feat: complete Query statements of FlinkSQL (#93) 
* feat: add inlineDataValueClasue rule

* test: update tests of select statements

* feat: support flinksql window TVF grammar

* test: flink sql windown TVF statement test

* feat: support grouping sets grammar

* test: window TVF Aggregation and Group Window Aggregation tests

* test: supplemental selectAggregation with test cases

* test: add Having statement test case

* feat: support flinkSql over aggregation grammar

* test: add over aggregation grammar test cases

* test: flink sql join statement test cases

* test: flink sql set Operations grammar test cases

* test: flink sql limit clause test case

* feat: remove allPlusUid and replace with uid

* feat: support flink sql pattern recognition grammar

* test: flink sql pattern recognition tests

* feat: add flink sql with clause rule

* test: flink sql with clasue select tests

* feat: rebuild flink sql parser
 2023-05-17 10:30:25 +08:00
Ziv
fbee70cde5
feat: update alter and drop statements (#94) 
* feat: add UNIQUE keyword

* feat: support ifExist, addConstraint, dropConstraint and addUnique of alter table statement

* feat: support ifExist, addConstraint, dropConstraint and addUnique of alter table statement

* tests: add tests of alter statements

* docs: add comments for sql syntax

* build: optimize promote of build/antlr4

* ci: add max_old_space_size

* ci: add max_old_space_size

* ci: update tests script
 2023-05-17 10:00:35 +08:00
wewoor
526a58ad2e Merge branch 'master' of github.com:DTStack/dt-sql-parser 2023-05-12 10:47:46 +08:00
mumiao
dc417e1381
feat: improve flinksql insertStatement 
* feat: feat: improve flinksql insertStatement

* feat: complete insertFromSelectQueries syntax unit tests

* feat: complete insertValuesIntoTable syntax unit tests

* feat: improve insertValuesIntoTable sql case data

* feat: complete insertMultipeTables unit cases

* feat: depracate insertMulStatement grammar for 1.1.4

* fix: depracate unless files

* test: recover jest.config info

* feat:  improve  insertMultipleTable.sql  test case

* feat: build new flinksql parser and lexer

* feat: generator new flink parser and lexer file

* test: improve readSQL logic

* test: fix insertMultipleTable sql error

* test:  recover jest.config.js info
 2023-05-12 09:31:54 +08:00
野迂迂
c41beeaa5a
refactor: readSQL support multiple tables (#95) 2023-05-11 19:31:03 +08:00
wewoor
7b7c2ab8d8 test: drop statment tests 2023-05-11 19:06:19 +08:00
wewoor
65a754e533 test: update tests of alter statemnts 2023-05-11 18:54:56 +08:00
wewoor
04a56ba618 refactor: import readSQL function 2023-05-11 18:12:50 +08:00
wewoor
4af913cf30 feat: extracting the common readSQL function 2023-05-11 18:11:12 +08:00
野迂迂
370cccf8d9
feat: improve flinksql createStatement (#91) 
* feat: improve flinksql createStatement

* feat: complete CREATE syntax unit tests

* feat: complete CREATA TABLE syntax tests

* feat: develop flinkSQL grammar

* feat: improve tableConstraint

* fix: convert TIMESTAMP_LTZ

* test: improve tests

* feat: build new flinksql parser and lexer

* test: add CREATE TEMPLATE TABLE test
 2023-05-11 17:41:34 +08:00
Ziv
c1c72def30
feat: upgrade antlr4 to 4.12.0 (#88) 2023-05-04 10:13:05 +08:00
nankaNULL
c0842b3e07
Feat/flink dt sql (#75) 
* feat: dt self develop grammar

* feat: dt self develop grammar
 2023-03-21 09:53:25 +08:00
nankaNULL
4f02f9aca0
Feat/flink grammar (#73) 
* feat: complete flink sql insert statement

* feat: complete flink sql drop statement

* feat: complete flink sql alert statement

* feat: complete flink sql create statement, remove console log

* feat: complete flink sql describe, show, explain, use statement

* feat(flinksql): add statement, such as set, load

* fix(flinksql): fix insert, add temporary table
 2023-02-27 19:03:32 +08:00
Ziv
14c2534de7
fix: remove space character in line comment rule (#69) 
* fix: remove space character in line comment rule

* build: recompile grammars

* test: add cases for line comment
 2023-01-09 11:01:10 +08:00
nankaNULL
0c9a831585
fix: fix flinksql create table grammar, add test (#65) 
* fix: fix flinksql create table grammar, add test

* feat: add cross join, left outer join and time temporal join

* test: supplement flinksql join test

* fix: fix catalog table grammar, add test

* fix: fix flinksql data type, add test

* fix: delete console

* feat: add query with clause, add test
 2022-12-28 14:20:33 +08:00
nankanull
d4ac1ae940 test: add nested bracket test 2022-12-25 13:30:43 +08:00
Salvatore Ravidà
ea0f061ff9 Added tests - restore target es6 - transpile base into es5 2022-12-16 15:13:56 +08:00
xiaowei
850b6087fd test: split special sqls 2021-09-10 17:50:58 +08:00
xiaowei
5404cdd4d0 test: unit test for the custom variables 2021-09-10 17:50:58 +08:00
xiaowei
5f5af0a4ab fix: lexer for comment 2021-05-11 13:40:52 +08:00
Ziv
dc49697302
fix: clean sql white spaces #21 2021-05-11 13:39:42 +08:00
Ziv
bff1618742
Revert "fix: clea sql white spaces \n fix #21 (#26)" (#28) 
This reverts commit b632f62678.
 2021-05-11 13:37:34 +08:00
Ziv
b632f62678
fix: clea sql white spaces \n fix #21 (#26) 2021-05-11 13:35:45 +08:00
xiaowei
788374c1ec refactor(utils): import methods from src index 2021-01-05 18:02:01 +08:00
xiaowei
dc9974bbff refactor(spark): extract spark export into src index 2021-01-05 17:57:33 +08:00
xiaowei
221482cc7c refactor(plsql): extract plsql export into src index 2021-01-05 17:49:34 +08:00
xiaowei
57aba357ab refactor(hive): extract hive export into src index 2021-01-05 17:45:54 +08:00
xiaowei
0f6c7849f2 refactor(test): import from src index file 2021-01-05 17:41:21 +08:00
Erindcl
da2581533f fix: delete mock data 2021-01-05 11:49:40 +08:00
zhifei
a059f79585 Merge branch 'build' into 'dev' 
ci: integrate with gitlab-ci

See merge request dt-insight-front/infrastructure/dt-sql-parser!7
 2020-12-30 10:01:55 +08:00
Erindcl
6b16f752e4 fix: ts problem 2020-12-28 19:07:13 +08:00
xigua
084efe1aab modify sparkSql grammar 2020-12-17 16:35:49 +08:00
xigua
8418c42c26 Merge branch 'dev' into feat_sparkSql 2020-12-17 14:59:52 +08:00
xigua
edbc87e8f1 update sql parser name 2020-12-17 11:44:45 +08:00
Erindcl
e6ee2ff411 Merge branch 'dev' into feat_flinkSql 2020-12-14 14:03:28 +08:00
Erindcl
771b562c78 fix(flink): clear useless comments 2020-12-14 11:48:08 +08:00
Erindcl
3054e90917 feat(flin): add split sql test 2020-12-14 11:23:40 +08:00
Erindcl
7d6c753d82 feat(utils): add cleanSql、splitSql、lexer func and test 2020-12-09 17:59:24 +08:00
Erindcl
a9b1e90d73 feat(flink): update grammar to match special columnName 2020-12-09 11:08:56 +08:00
Erindcl
e67f991ede feat(flink): modify grammar to match keywords 2020-12-08 16:04:56 +08:00
Erindcl
cc1d5abcdd feat(flink): add performance test 2020-12-04 11:14:20 +08:00
Erindcl
c9d88d00a6 feat(flink): update flinkSql grammar and add some test 2020-12-03 20:03:25 +08:00
Erindcl
8cfdd0e856 test(flink): add flink visitor and listener test 2020-12-02 10:35:37 +08:00
Erindcl
0ef80696f4 feat(flink): add describe/explain/use/show statement and some test 2020-11-26 11:20:57 +08:00
chenfeng
cb1fcb7ed6 test: add hivesql unit test 2020-11-25 17:04:55 +08:00
chenfeng
110c4f1fa5 test: add hive validate unit test 2020-11-25 15:04:22 +08:00
Erindcl
0735269f4e feat(flink): merge parser and lexer in order to java test 2020-11-18 20:05:49 +08:00
Erindcl
a5ea7be606 feat: add some query grammar 2020-11-11 19:58:14 +08:00
xigua
0d47b7debc modify grammar, add syntax test 2020-11-05 20:37:07 +08:00
Erindcl
9fc91a572a feat(flink): add drop/alter test add add part of queryStatement 2020-11-04 18:03:41 +08:00
xigua
bfe055be71 add sparkSql base grammar 2020-10-28 21:34:13 +08:00
Erindcl
6082c2b151 feat(flinksql): add some lexer 2020-10-23 17:52:43 +08:00
Erindcl
b7df08f012 feat(flink): add createTable grammar 2020-10-22 19:57:13 +08:00
xiaowei
f85163892a feat: add generic and plsql basic parser file 2020-09-11 17:39:10 +08:00
xiaowei
d86a6e7638 build: optimize cli and add eslint 2020-08-28 13:29:47 +08:00
HSunboy
3bf241408c fix insert rowValuesList syntax 2020-03-26 13:06:16 +08:00
HSunboy
0c5f6164f4 fix hive insert syntax 2020-03-26 11:47:47 +08:00
HSunboy
364dc5fcae fix impala create table as select column bug 2020-01-10 17:00:09 +08:00
HSunboy
93125a715a update new parser 2019-12-31 18:34:31 +08:00
HSunboy
6eda025e39 add left function 2019-12-27 19:30:37 +08:00
HSunboy
a486270ab1 add impala lifecycle 2019-12-25 10:58:12 +08:00
HSunboy
67b3f68113 fix impala 2019-12-23 17:57:22 +08:00
HSunboy
02b00e17e0 add primary key support 2019-11-15 11:01:55 +08:00
HSunboy
2962271262 support MATCH_RECOGNIZE 2019-10-21 16:52:16 +08:00
HSunboy
eb0d32751b add lateral table support 2019-10-08 17:22:35 +08:00
HSunboy
3b6c224e0e fix split bug 2019-09-29 17:38:52 +08:00
HSunboy
966a8d31f4 fix error position 2019-09-25 17:04:43 +08:00
HSunboy
325a2db4cf add empty sql support 2019-09-25 16:48:19 +08:00
HSunboy
8d7040d04b add flinksql 2019-09-25 15:43:36 +08:00
HSunboy
e79a5a3d07 fix bugs 2019-06-04 17:54:27 +08:00
HSunboy
711721ec0e add test folder 2019-05-31 15:58:34 +08:00
HSunboy
7096f4be00 .gitignore is working, fixed untracked files 2018-12-13 14:23:40 +08:00
HSunboy
77bbf57d28 fix escape bug 2018-11-30 13:40:48 +08:00
HSunboy
e4ee8218e4 update readme 2018-08-16 19:30:22 +08:00
HSunboy
11ea28e790 ignore 2018-07-06 16:28:54 +08:00
HSunboy
152f186a2e 用pegjs重写过滤逻辑 2018-07-05 11:16:30 +08:00
HSunboy
6eb8a18c48 add peg source file 2018-07-03 11:33:53 +08:00