Skip to content

duckdb: bump to v1.5.6 - #662

Merged
mkaruza merged 4 commits into
supabase:mainfrom
cobac:coba/duckdb-1.5
Oct 20, 2026
Merged

mkaruza merged 4 commits into
supabase:mainfrom
cobac:coba/duckdb-1.5

Conversation

@cobac

@cobac cobac commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

DuckDB v1.3 reached end-of-life on November last year.

cobac added 4 commits October 8, 2026 11:18
in DuckDB v1.5 secrets are lazily initialized on disk by default,
so 'create secret' was failing with a LocalFileSystem permission error
since file system access is not available on the sandbox

'allow_persistent_secrets=false' needs to be set before loading any extension,
because that initializes the secret manager and it's not possble to change it's settings
after initialization

not relevant for MotherDuck, it already runs without local file system access
since DuckDB v1.5 extension autoloading goes through the filesystem permission check, so
all extensions required need to explicitly loaded before the filesystem is locked
DuckDB 1.5 no longer bundle the parquet and json extensions in the default bundled
amalgamation, so reading a parquet file now attempts to autoload the extentions, which
fails because LocalFileSystem access is disabled.
@cobac
cobac requested a review from a team as a code owner October 8, 2026 10:50
match self {
Self::Iceberg | Self::S3Tables | Self::R2Catalog | Self::Polaris | Self::Lakekeeper => {
"install iceberg;load iceberg;"
"install httpfs;load httpfs;install iceberg;load iceberg;"

@mkaruza mkaruza Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cobac Why httpfs is required?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

httpfs is the extension required read from those sources (blob storage, any remote files basically).

If not installed explicitly DuckDB will try to autoload it when a query tries to interact with a remote file, and that autoload fails on v1.5 because the filesystem is locked in your sandbox at query time.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm, I've just a quick sanity check with a v1.3 CLI and it also fails to autoload httpfs with the file system disabled. But your testing suite on main passes with v1.3 so I was confused.

$ duckman run v1.3.2 -c "SET allow_persistent_secrets=false; SET disabled_filesystems='LocalFileSystem'; load httpfs;"

Permission Error:
File system LocalFileSystem has been disabled by configuration

$ duckman run v1.5.6 -c "SET allow_persistent_secrets=false; SET disabled_filesystems='LocalFileSystem'; load httpfs;"        
                                                
Permission Error:
File system LocalFileSystem has been disabled by configuration

I've narrowed it down: on v1.3 the autoloading that happens on create secret was not gated by the filesystem access check, while it is in v1.5.

$ duckman run v1.3.2 -c "SET allow_persistent_secrets=false; SET disabled_filesystems='LocalFileSystem'; CREATE SECRET (TYPE S3, KEY_ID 'a', SECRET 'b', REGION 'us-east-1');"

true

$ duckman run v1.5.6 -c "SET allow_persistent_secrets=false; SET disabled_filesystems='LocalFileSystem'; CREATE SECRET (TYPE S3, KEY_ID 'a', SECRET 'b', REGION 'us-east-1');"


Extension Autoloading Error: An error occurred while trying to automatically
install the required extension 'httpfs':
File system LocalFileSystem has been disabled by configuration

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cobac thank you, approving

@mkaruza
mkaruza self-requested a review October 19, 2026 15:26
@cobac

cobac commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor Author

@mkaruza thanks for the review! I cannot merge and CI hasn't run yet since it need approval

@mkaruza
mkaruza merged commit 57b01fa into supabase:main Oct 20, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants