GH-38607: [Python] Disable PyExtensionType autoload#38608
Merged
raulcd merged 2 commits intoapache:mainfrom Nov 6, 2023
Merged
GH-38607: [Python] Disable PyExtensionType autoload#38608raulcd merged 2 commits intoapache:mainfrom
raulcd merged 2 commits intoapache:mainfrom
Conversation
PyExtensionType autoload is really a misfeature. Disable it and deprecate PyExtensionType instantiation.
Member
Author
|
@raulcd You may want to pick this up once CI is green. |
Member
Author
|
@github-actions crossbow submit -g python -g wheel |
|
Revision: 1990150 Submitted crossbow builds: ursacomputing/crossbow @ actions-58962cba56
|
Member
|
The dask, pandas, substrait, hdfs failures are existing nightly failures on main. |
raulcd
approved these changes
Nov 6, 2023
Member
raulcd
left a comment
There was a problem hiding this comment.
CI looks good to me and the change also looks good to me.
raulcd
pushed a commit
that referenced
this pull request
Nov 6, 2023
### Rationale for this change PyExtensionType autoload is really a misfeature. It creates PyArrow-specific extension types, though using ExtensionType is almost the same complexity while allowing deserialization from non-PyArrow software. ### What changes are included in this PR? * Disable PyExtensionType autoloading and deprecate PyExtensionType instantiation. * Update the docs to emphasize ExtensionType. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * Closes: #38607 Authored-by: Antoine Pitrou <antoine@python.org> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
|
After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit c73cb13. There were no benchmark performance regressions. 🎉 The full Conbench report has more details. It also includes information about 4 possible false positives for unstable benchmarks that are known to sometimes produce them. |
8 tasks
loicalleyne
pushed a commit
to loicalleyne/arrow
that referenced
this pull request
Nov 13, 2023
### Rationale for this change PyExtensionType autoload is really a misfeature. It creates PyArrow-specific extension types, though using ExtensionType is almost the same complexity while allowing deserialization from non-PyArrow software. ### What changes are included in this PR? * Disable PyExtensionType autoloading and deprecate PyExtensionType instantiation. * Update the docs to emphasize ExtensionType. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * Closes: apache#38607 Authored-by: Antoine Pitrou <antoine@python.org> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
|
Would it also be possible to patch this into version 12.0.1 or other versions that are compatible with python 3.7? I am stuck on a particular version and cannot patch. |
Member
Author
|
@milovanderlinden We have published a hotfix specifically for this: |
bveeramani
added a commit
to ray-project/ray
that referenced
this pull request
Nov 20, 2023
Arrow nightly tests are failing because our custom tensor extension uses pyarrow.PyExtensionType, and apache/arrow#38608 deprecated pyarrow.PyExtensionType in favor of pyarrow.ExtensionType. This PR updates our tensor extension to use the now-recommended APIs. --------- Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
ujjawal-khare
pushed a commit
to ujjawal-khare-27/ray
that referenced
this pull request
Nov 29, 2023
Arrow nightly tests are failing because our custom tensor extension uses pyarrow.PyExtensionType, and apache/arrow#38608 deprecated pyarrow.PyExtensionType in favor of pyarrow.ExtensionType. This PR updates our tensor extension to use the now-recommended APIs. --------- Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
dgreiss
pushed a commit
to dgreiss/arrow
that referenced
this pull request
Feb 19, 2024
### Rationale for this change PyExtensionType autoload is really a misfeature. It creates PyArrow-specific extension types, though using ExtensionType is almost the same complexity while allowing deserialization from non-PyArrow software. ### What changes are included in this PR? * Disable PyExtensionType autoloading and deprecate PyExtensionType instantiation. * Update the docs to emphasize ExtensionType. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * Closes: apache#38607 Authored-by: Antoine Pitrou <antoine@python.org> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
This was referenced Apr 22, 2025
pitrou
pushed a commit
that referenced
this pull request
Apr 29, 2025
### Rationale for this change `PyExtensionType` has been deprecated in #38608 and can now be removed. ### What changes are included in this PR? `PyExtensionType` functionality is removed from PyArrow code. ### Are these changes tested? Existing tests should pass. ### Are there any user-facing changes? Deprecated classes are removed. * GitHub Issue: #46198 Authored-by: AlenkaF <frim.alenka@gmail.com> Signed-off-by: Antoine Pitrou <antoine@python.org>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Rationale for this change
PyExtensionType autoload is really a misfeature. It creates PyArrow-specific extension types, though using ExtensionType is almost the same complexity while allowing deserialization from non-PyArrow software.
What changes are included in this PR?
Are these changes tested?
Yes.
Are there any user-facing changes?
Yes.