Skip to content

fix(python/sedonadb): Tweaks to support pandas>=3.0#538

Merged
paleolimbot merged 1 commit intoapache:mainfrom
paleolimbot:pandas-3-fix
Jan 22, 2026
Merged

fix(python/sedonadb): Tweaks to support pandas>=3.0#538
paleolimbot merged 1 commit intoapache:mainfrom
paleolimbot:pandas-3-fix

Conversation

@paleolimbot
Copy link
Member

@paleolimbot paleolimbot commented Jan 22, 2026

There are two issues introduced by the recent pandas 3.0 release:

  • The qualified name of the DataFrame changed. In the current release these dataframes will still work but can only be queried exactly once. This PR fixes that so that pandas>=3.0 and pandas<3.0 data frames work exaclty the same.
  • There is a new default string type that defaults to LargeUtf8 when getting translated to Arrow. There was at least one operation in our tests that failed because DataFusion didn't support LargeUtf8 in some internal. This PR just updates the test but I'll also file an issue in DataFusion.

Closes #536.

@paleolimbot paleolimbot merged commit 90601cd into apache:main Jan 22, 2026
5 checks passed
@paleolimbot paleolimbot deleted the pandas-3-fix branch January 22, 2026 21:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

python/sedonadb: Several tests fail after pandas 3.0 release

2 participants