v1.0.4

Spark Cyclone release refs/tags/v1.0.4.

What's Changed

• [transpiler] Support for transpilation of Block, ValDef Assign, and If code by @q10 in #556
• [transpiler] Add support for While, DoWhile, and IfOnlyStatement by @q10 in #557
• [NS-10] Clean up ByteArrayColVector implementation by @q10 in #559
• [NS-17] Remove CMake tests by @q10 in #560
• [NS-9] De-genericize the column vector classes by @q10 in #561
• [NS-18] De-genericize the column batch classes by @q10 in #562
• Remove tuples in grouping function by @treo in #564
• Don't use clever way of counting by @treo in #565
• Re-enable support for varchar in grouping code by @treo in #566
• [NS-12] Clean up tests by @q10 in #567
• Use asynchronous memory access by @treo in #568
• Force initialization of Metrics before plan execution by @treo in #569
• Bugfix: Memcpy on shortcircuit by @treo in #570
• Add guard to only write non-zero buffers by @treo in #571
• [NS-25] Create benchmarks to measure different strategies of data transfers to the VE by @q10 in #572
• [NS-38] New VeProcess implementation by @q10 in #573
• [NS-29] Partition level transfer by @treo in #574
• Bugfix: Handle alignment correctly by @treo in #576
• [NS-39] VectorEngine implementation by @q10 in #575
• [NS-41][metrics] Add metrics to the new VeProcess and VectorEngine implementations by @q10 in #577
• Re-enable append_bitsets by @treo in #578
• Bugfix: Synchronize on the map that is mutated by @treo in #579
• [NS-37] Integrate partition level transfer into the new VectorEngine implementation by @q10 in #580
• [NS-43] Integrate the new VeProcess, part 1 by @q10 in #581
• Bugfixes: Calculate validity buffer steps based on processed elements & fix sort order issues by @treo in #583

Full Changelog: v1.0.3...v1.0.4

v1.0.3

Spark Cyclone release refs/tags/v1.0.3.

What's Changed

• Add support for VeColBatch to Tuple conversion by @treo in #550
• Prime Compiler ToolBox on Creation by @treo in #551
• [transpiler] Rewrite Map functions to expand Tuple parameters by @q10 in #548
• Use another level of indirection to receive arbitrary groups counts by @treo in #549
• [transpiler] Add support for primitive type conversions, fix some unhandled Tree cases by @q10 in #553
• Add Tuple Support for more Operations by @treo in #552
• Add support for equi join operation on VeRDD by @treo in #554
• Add free calls after function calls. by @wmeddie in #555

Full Changelog: v1.0.2...v1.0.3

v1.0.2

Spark Cyclone release refs/tags/v1.0.2.

What's Changed

• Support for NULLS FIRST and NULLS LAST in SortFunction by @q10 in #532
• Conversions for Array[T] to BytePointerColVector by @q10 in #535
• Migrate existing code to use the new ArrowConversions by @q10 in #537
• Conversions for Spark SQL ColumnVector to BytePointerColVector by @q10 in #540
• Conversions for Seq[Option[T]] to BytePointerColVector by @q10 in #543
• Trivial filters in Transpiler by @markonussbaum in #542
• Very basic support for RDD[Instant] by @q10 in #545
• [transpile] Use typed trees for evalFunc by @q10 in #546
• Add additional type information to compiled functions by @treo in #547
• VERDD Support by @wmeddie in #539
• VeRDD Implementation by @wmeddie in #533

New Contributors

• @markonussbaum made their first contribution in #542

Full Changelog: v1.0.1...v1.0.2

v1.0.1

Spark Cyclone release refs/tags/v1.0.1.

What's Changed

• Replace std::max and std::min with MIN/MAX macros. by @wmeddie in #527
• [sort] Code generation cleanups around sort by @q10 in #525
• Architectural Documentation by @wgip in #520
• Update frovedis code to the latest master. by @wmeddie in #528
• use count in nullable_varchar_vector by @hisashimasu in #529
• Miscellaneous code cleanups by @q10 in #530
• 1.0.1 release by @wmeddie in #531

New Contributors

• @hisashimasu made their first contribution in #529

Full Changelog: v1.0.0...v1.0.1

v1.0.0

Spark Cyclone release refs/tags/v1.0.0.

What's Changed

• Simplification of StringProducer and renderProjection() by @q10 in #521
• Refactor VERewriteStrategy by @treo in #522
• Implement ProjectionFunction by @q10 in #523
• Performance Improvements by @wmeddie in #524

New Contributors

• @treo made their first contribution in #522

Full Changelog: v0.9.3...v1.0.0

v0.9.3

Spark Cyclone release refs/tags/v0.9.3.

What's Changed

• Serialize the JOIN by @wgip in #494
• Simplification of GroupingFunction and MergerFunction by @q10 in #498
• Simplification of FilterFunction by @q10 in #502
• D varchar words unification by @Wosin in #497
• Try next VE if unable to start executor procs on the VE assigned. by @wmeddie in #504
• [cpp] Miscellaneous updates by @q10 in #506
• Fix Parquet loading by @wgip in #501
• [cpp] Move sorting and hashing down to C++ by @q10 in #508
• Add VEHints to enable/disable options per-query. by @wmeddie in #509
• [build] Updates to the Cyclone C++ library build process by @q10 in #514
• Fix test failures. by @Wosin in #511
• Remove redundant Spark-VE-Spark and VE-Spark-VE conversions. by @wmeddie in #515
• Support columnar-to-columnar conversion by @wgip in #507
• Simplification of generated code from StringHoleEvaluations, GenericJoiner, and GroupByPartialGenerator by @q10 in #518
• Disable unoptimized rewrite options by default. by @wmeddie in #519

Full Changelog: v0.9.2...v0.9.3

v0.9.2

Spark Cyclone release refs/tags/v0.9.2.

What's Changed

• 0.9.1 release by @wmeddie in #486
• Restructure the src/main/resources/com/nec/cyclone/cpp directory by @q10 in #481
• add else case messages by @BrainyGuyOrg in #484
• change sizeof(void *) to sizeof(nullptr) by @BrainyGuyOrg in #487
• change malloc to calloc in validityBuffer allocations by @BrainyGuyOrg in #485
• Bytepointers merged with 0.9.0 main by @wmeddie in #480
• Changed the old style C casts into new style C++ casts. by @BrainyGuyOrg in #489
• Added code to call the ceil_div() function by @BrainyGuyOrg in #490
• Implement clone() and equals() methods for the nullable_T_vector structs by @q10 in #491
• D exchange fix by @Wosin in #493
• Implement filter() and bucket() methods for the nullable_T_vector structs by @q10 in #495
• Implement convenience constructors, pseudo-destructor, and set/get_validity for the nullable_T_vector structs by @q10 in #496
• Use a custom Serializer for exchanges by @wgip in #492
• Add transfering .so files via Akka. by @Wosin in #482

Full Changelog: v0.9.1...v0.9.2

v0.9.1

Spark Cyclone release refs/tags/v0.9.1.

What's Changed

• [tcp debug] Remove TCP debug code generation by @q10 in #478
• Added compiler options to src/test/resources/dbgen/makefile by @BrainyGuyOrg in #483

New Contributors

• @BrainyGuyOrg made their first contribution in #483

Full Changelog: v0.9.0...v0.9.1

v0.9.0

Spark Cyclone release refs/tags/v0.9.0.

What's Changed

• Fix Query 7, 8, 9 by @wgip in #475
• Fix Query 16: exclude Distinct queries by @wgip in #476
• Prepare for first release. by @wmeddie in #474
• Switch default to GNU-C++17 by @wmeddie in #477

Full Changelog: v0.1.3...v0.9.0

v0.1.3

Spark Cyclone release refs/tags/v0.1.3.