Skip to content

Tags: poguez/delta-rs

Tags

python-v0.19.1

Toggle python-v0.19.1's commit message
chore: bump python

python-v0.19.0+1

Toggle python-v0.19.0+1's commit message
attempting a second 0.19.0 release from GitHub actions

This is just to produce linux wheels which were not properly created
during the origin python-v0.19.0 release

rust-v0.19.0

Toggle rust-v0.19.0's commit message
Datafusion 41 and a number of big performance improvements and features

python-v0.19.0

Toggle python-v0.19.0's commit message
fix: allow missing file stats in log replay

rust-v0.18.2

Toggle rust-v0.18.2's commit message
introducing additional CDF support and other fixes

python-v0.18.2

Toggle python-v0.18.2's commit message
chore(deps): update dashmap requirement from 5 to 6

Updates the requirements on [dashmap](https://github.com/xacrimon/dashmap) to permit the latest version.
- [Release notes](https://github.com/xacrimon/dashmap/releases)
- [Commits](xacrimon/dashmap@v5.0.0...v6.0.1)

---
updated-dependencies:
- dependency-name: dashmap
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

rust-v0.18.1

Toggle rust-v0.18.1's commit message
Regression fix and deltalake-hdfs package comes along

rust-v0.18.0

Toggle rust-v0.18.0's commit message
new datafusion and a bunch of other goodies

python-v0.18.1

Toggle python-v0.18.1's commit message
remove bump on rust bild

python-v0.18.0

Toggle python-v0.18.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
fix: cast support fields nested in lists and maps (delta-io#2541)

# Description

The current implementation of cast only works for structs nested in
structs. This PR adds supports for structs contained in other types
(lists and maps). This PR also prevents cast from adding nullable column
if the field is not nullable, instead it will throw an error.

Note: This is only a partial solution which would let you merge schema
with nested missing columns, it does not allow delta-rs to read the
merged schema (though Spark can). To read the merged schema will require
another change where delta-rs defines its own datafusion parquet
schemaAdapter.