v7.0.0

Changes from v6.0.1:

• Breaking: Change the default handler of Apache Arrow data from the apache-arrow JS reference implementation to the smaller, faster, and more flexible @uwdata/flechette.

  This change improves performance and simplifies Arquero internals, as it obviates the need for internal custom Arrow data conversion steps and a variety of earlier performance and correctness workarounds. Arrow IPC binary decoding (in fromArrow) and building/encoding (in toArrow and toArrowIPC) now use Flechette.

  If passing an already instantiated Arrow table to fromArrow, Arquero supports both apache-arrow and @uwdata/flechette tables, including optimizations for groupby and filter operations over dictionary types. However, special extraction of decimals, dates, and nested types (lists, structs) is no longer provided by Arquero; instead we default to whatever the Arrow implementation provides. For Flechette, this includes customizable extraction options and efficient serialization to native JS array and object types. For Arrow-JS, decimals are not well-supported and lists are returned as Arrow Vector types and structs as slow Proxy row objects.

  If loading data directly from IPC bytes, Arquero results should be consistent. Moreover, as Flechette is small, it is bundled directly with Arquero, so (unlike before) no additional imports are needed to process Arrow data. However, when passing-in already-parsed apache-arrow tables, results will differ for some data types.

Full Changelog: v6.0.1...v7.0.0

v6.0.1

• Update package.json, use main again to resolve CDN issues.
• Update dependencies.

v6.0.0

• Breaking: Switch project to type module, update imports for node compatibility.
• Breaking: Remove serialized Query functionality; it does not seem to be used at all.
• Breaking: Limit extensibility methods to op functions only, remove table method and package registration. New table methods can instead be added by directly assigning them to ColumnTable.prototype.
• Breaking: Remove Table.columns() method. Use Table.data() instead.
• Breaking: Remove Table.columnArray() method. Use Table.array() instead.
• Breaking: Rename toArrowBuffer() to toArrowIPC().
• Breaking: Refactor module exports to be flat, including internal classes and toXXX format methods.
• Add lightweight base Table representation, ColumnTable subclass adds transformations and format methods.
• Add array type checks for columns to optimize access.
• Add more Arrow conversions (Date, Decimal, etc.) and corresponding arrowColumn() option flags.
• Add object freeze to table column object.
• Remove internal column wrapper interface, use array-like objects directly.
• Refactor verb definitions to a single location, remove previous engine folder.
• Refactor verb argument parsing to consolidate in top-level verb methods.
• Refactor all Apache Arrow functionality to the arrow folder.
• Use Mocha as the test runner.
• Improve TypeScript types and testing.
• Update build process, drop node bundle, retain UMD builds.
• Update dependencies.

v5.4.1

Changes from v5.4.0:

• Update dependencies and dev dependencies (thanks @domoritz)
• Fix errors in JSDoc TypeScript annotations (thanks @FilipBac)
• Update links in documentation (thanks @HQFOX)

v5.4.0

Changes from v5.3.0:

• Chore: Drop yarn, use npm only. Update docs accordingly.
• CI: Update CI settings.
• Deps: Bump dependencies.

v5.3.0

Changes from v5.2.0:

• Fix: join should handle empty string as suffix (fix #317, thanks @wpercy)
• Fix: add iso-date-string check for invalid dates (thanks @calvinfo)
• Deps: Bump dependencies, including Apache Arrow version.

v5.2.0

Changes from v5.1.0:

• Add format option for Arrow IPC serialization (thanks @stuartlynn!)
• Fix parser bug when compiling code for parameterized member property.
• Update dependencies.
• Update tested CI node versions.

v5.1.0

Changes from v5.0.0:

• Table print() now returns the table instance.
• Fix error checking of aggregate and window function calls when parsing expressions.
• Update dependencies.

v5.0.0

Changes from v4.8.8:

• Breaking. Update to Apache Arrow v8.0, remove export of arrow Type enum. To specify types using integer type ids, use the Apache Arrow Type export directly. Arrow v8.0 has a significant number of API changes that affect calls to Arrow tables produced by Arquero. For example, arrowTable.getColumn() no longer exists, use arrowTable.getChild() instead.
• Fix pivot count aggregation to respect pivot keys. (#273)
• Update dependencies.

v4.8.8

Changes from v4.8.7:

• Fix version number export (#258) (thanks @domoritz!)