Clone
Aditya Manglam Sharma <aditya300899@gmail.com>
committed
on 31 Aug
TEIID-4594 Parquet Translator (#1310)
* initial implementation of parquet execution

* adding test for verifying the execution implementatio… Show more
TEIID-4594 Parquet Translator (#1310)

* initial implementation of parquet execution

* adding test for verifying the execution implementation

* TEIID-4594 adding a check for the page row count

(cherry picked from commit 00731926edaaf01ec590268237cd1b0df91db6d3)

* adding some logic for handling binary primitive type

* adding support for non nested list types and managing int96 and including test for list

* adding filteredSchema mechanism, implementation for direct repeated types and returning ArrayImpl from getList and getRepeatedList

* removing the metadata extension property for column_number, adding null check, adding the fix_len_byte_array primitive type

* adding the initial implementation for directory based partitioning and for getting reviewed

* refining the directory based partitioning scheme

* adding more refinements to make the visitor more generic for future

* adding test for projected columns, adding case for when the nextRowGroup is not null and some initial logic for rowGroupFilter

* Implementation for rowGroupFilter

* Adding test case for partitioning and rowfilter together, adding capabilities

* refinement except tests and rebasing to master

* TEIID-6019 creating common file logic for testing

* TEIID-6019 creating common file logic for testing

* adding initial implementation for selecting partitioned columns

* adding tests and refining with a failing test for help

* fixing the logic for row filtering handling the null rows, adding tests and refining the getDirectory method

* refining, adding multimap for multiple predicates on same column and adding test for the same

Co-authored-by: shawkins <shawkins@redhat.com> Show less