Skip to content

deps: include pyarrow as a dependency #529

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Mar 27, 2024
Merged

deps: include pyarrow as a dependency #529

merged 7 commits into from
Mar 27, 2024

Conversation

tswast
Copy link
Collaborator

@tswast tswast commented Mar 27, 2024

Test with a minimum version of pyarrow to confirm compatibility.

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

🦕

Test with a minimum version of pyarrow to confirm compatibility.
@tswast tswast requested review from a team as code owners March 27, 2024 16:32
@tswast tswast requested a review from milkshakeiii March 27, 2024 16:32
@product-auto-label product-auto-label bot added size: xs Pull request size is extra small. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Mar 27, 2024
@milkshakeiii milkshakeiii added the automerge Merge the pull request once unit tests and other checks pass. label Mar 27, 2024
@@ -12,6 +12,7 @@ google-cloud-resource-manager==1.10.3
google-cloud-storage==2.0.0
ibis-framework==8.0.0
pandas==1.5.0
pyarrow==3.0.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can this be higher? looks like
E AttributeError: type object 'pyarrow.lib.RecordBatch' has no attribute 'from_pydict'
is due to 3.0.0 being too old

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Work-in-progress. I need to determine what our minimum version actually is. Will update this PR with a bit of a binary search to determine.

@milkshakeiii milkshakeiii removed the automerge Merge the pull request once unit tests and other checks pass. label Mar 27, 2024
@product-auto-label product-auto-label bot added size: s Pull request size is small. and removed size: xs Pull request size is extra small. labels Mar 27, 2024
@tswast tswast merged commit 9b1525a into main Mar 27, 2024
16 checks passed
@tswast tswast deleted the tswast-pyarrow branch March 27, 2024 21:30
Genesis929 pushed a commit that referenced this pull request Apr 9, 2024
* deps: include `pyarrow` as a dependency

Test with a minimum version of pyarrow to confirm compatibility.

* fix unit test

* fix unit tests

* try pyarrow 11

* try pyarrow 8

* skip failing astype test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: s Pull request size is small.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants