Improve performance of FFI calls that use many handles

[mkustermann]

When passing many handles to C functions the handle allocation becomes a bottleneck. We'd therefore like to improve the performance of the simple implementation done in 6544c69.

[mkustermann]

Closing in favor of #42341