Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reader features must not be present when minimum reader version = 1 or 2 #151

Open
riziles opened this issue Feb 10, 2025 · 2 comments
Open

Comments

@riziles
Copy link

riziles commented Feb 10, 2025

Maybe I'm doing something wrong, but the error message said to report so here it is:

duckdb.duckdb.IOException: IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table: 'deltafiles/test/'): Hit
 error: 31 (InternalError) with message (Internal error Reader features must not be present when minimum reader version = 1 or 2. Thi
s is a kernel bug, please report.)

Steps to reproduce:

import duckdb
import deltalake as dl
import os
import shutil

if os.path.isdir("deltafiles"):
    shutil.rmtree("deltafiles")

ducktbl = duckdb.sql("select unnest(range(1,100)) a")

dl.write_deltalake("deltafiles/test", ducktbl, mode="overwrite")

ducktbl2 = duckdb.sql("select a * 10 as a from delta_scan('deltafiles/test')")

dl.write_deltalake("deltafiles/test", ducktbl2, mode="overwrite")

dl.DeltaTable("deltafiles/test").restore(0)

duckdb.sql("select * from delta_scan('deltafiles/test') limit 3").show()
@riziles
Copy link
Author

riziles commented Feb 10, 2025

... it works fine without the restore(0) bit

@samansmink
Copy link
Collaborator

Thanks for reporting @riziles! I think this is a problem in the delta-kernel-rs library we use internally, I will forward the issue there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants