[feature request] remove pyarrow upperbound

[kevinjqliu]

Apache Iceberg version

None

Please describe the bug 🐞

@ehsantn raised this during community sync
upper bound makes dependency a pain to manage for end users

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[ehsantn]

Thanks for opening the issue @kevinjqliu. Any decision on this? Arrow 21 is out and would be great to use it (resolves some other dependency issues too).

[ehsantn]

Just opened a PR to facilitate and run tests: #2262