Skip to content

Improve customizing Aggregator memory weight #24511

@nik9000

Description

@nik9000

Right now all Aggregators report that they consume the same amount of memory: 5k. There are absolutely aggregations that can make a better estimate but it is probably important for aggregations that take more than 5k report that. If they don't then a sufficiently evil aggregation can knock out the cluster.

Note that this weight only has to include the non-BigArrays portion of the aggregation. The BigArrays portion is of the aggregation is tracked using the BigArrays breaker and doesn't need any estimation because it is based on the actual memory usage at the time.

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions