You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PyArrow does not support writing bloom filters. I opened an issue in the Arrow project apache/arrow#43530. I know that it's implemented in C++, but I don't know how easy it is to add it to the Python implementation. Therefore, I will try to contribute to the Arrow project.
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
@raphaelauv Thanks, I've removed the label. The PR that we want to track is apache/arrow#37400. It is open since Aug 2023, but there is still activity. Hope it will land soon 🤞
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
From my understanding the feature has been implemented on Arrow C++ but the capability hasn't been exposed to pyarrow yet. If someone wants to open an issue on the Arrow repository and work on the bindings for pyarrow I am happy to help on the review on the Arrow side. Otherwise unless someone starts working on it, I might try and work on it in the future but currently I am quite busy with other priorities.
Bloomfilter writing is now implemented in pyarrow and looks like it is set to be released in pyarrow 24 in a couple days. Is anyone looking into adding support to pyiceberg?
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Activity
ndrluis commentedon Aug 1, 2024
@sungwy I want to work on this. Can you assign it to me?
ndrluis commentedon Aug 1, 2024
PyArrow does not support writing bloom filters. I opened an issue in the Arrow project apache/arrow#43530. I know that it's implemented in C++, but I don't know how easy it is to add it to the Python implementation. Therefore, I will try to contribute to the Arrow project.
github-actions commentedon Jan 29, 2025
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
raphaelauv commentedon Feb 5, 2025
No stale
Fokko commentedon Feb 5, 2025
@raphaelauv Thanks, I've removed the label. The PR that we want to track is apache/arrow#37400. It is open since Aug 2023, but there is still activity. Hope it will land soon 🤞
github-actions commentedon Aug 5, 2025
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
raphaelauv commentedon Sep 1, 2025
no stale
greenlaw commentedon Jan 28, 2026
Just stumbled across this issue and noticed that the reference pyarrow ticket has been merged as of ~2 weeks ago: apache/arrow#37400
so PyIceberg may be unblocked now.
raulcd commentedon Jan 28, 2026
From my understanding the feature has been implemented on Arrow C++ but the capability hasn't been exposed to pyarrow yet. If someone wants to open an issue on the Arrow repository and work on the bindings for pyarrow I am happy to help on the review on the Arrow side. Otherwise unless someone starts working on it, I might try and work on it in the future but currently I am quite busy with other priorities.
greenlaw commentedon Feb 10, 2026
@raulcd You're right, my mistake--the feature has only been merged in Arrow C++.
renaudb commentedon Apr 6, 2026
Bloomfilter writing is now implemented in pyarrow and looks like it is set to be released in pyarrow 24 in a couple days. Is anyone looking into adding support to pyiceberg?
apache/arrow#49376
apache/arrow#49377
renaudb commentedon Apr 21, 2026
Here's a first pass at a PR: #3265
It requires
pyarrow>=24, which was released today. Unfortunately,bodorequirespyarrow<=23.1, so until this is fixed, it won't work.raulcd commentedon Apr 22, 2026
Thanks for following this up @renaudb
github-actions commentedon Oct 20, 2026
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
raphaelauv commentedon Oct 20, 2026
No stale