Discussion: Optimize RollingFileWriter by closing asynchronously #1551
Description
Is your feature request related to a problem or challenge?
Reference: #1547 (comment)
When rolling over to a new file, instead of waiting on the current writer to close, we can spawn a thread to improve its efficiency. But we need to be careful about the max parallelism since too many writers or an over-sized buffer can exhaust the memory
Describe the solution you'd like
No response
Willingness to contribute
None