-
Notifications
You must be signed in to change notification settings - Fork 297
Closed
Labels
Description
Benchmark comparison has identified performance shifts at:
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
Performance Benchmark Report: b6e39d7
Performance shifts
| Change | Before [10cec691] <main~1> | After [b6e39d75] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|------------------------------------------------------------------------------------|
| - | 69.9609 | 52.8008 | 0.75 | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(500) |
| Change | Before [10cec691] <main~1> | After [b6e39d75] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------------------|
| + | 47.1094 | 69.9922 | 1.49 | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500) |
Full benchmark results
Benchmarks that have improved:
| Change | Before [10cec691] <main~1> | After [b6e39d75] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|------------------------------------------------------------------------------------|
| - | 69.9609 | 52.8008 | 0.75 | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(500) |
Benchmarks that have stayed the same:
| Change | Before [10cec691] <main~1> | After [b6e39d75] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|-------------------------------------------------------------------------------------------------------|
| | n/a | n/a | n/a | aux_factory.FactoryCommon.time_create |
| | 5.79±0.4μs | 6.69±0.6μs | 1.16 | aux_factory.HybridHeightFactory.time_create |
| | 7.15±0.6μs | 7.10±0.6μs | 0.99 | coords.AncillaryVariable.time_create |
| | 526±20ns | 509±30ns | 0.97 | coords.AuxCoord.time_bounds |
| | 12.1±0.5μs | 13.2±0.3μs | 1.09 | coords.AuxCoord.time_create |
| | 534±20ns | 515±40ns | 0.97 | coords.AuxCoord.time_points |
| | 418±40μs | 437±40μs | 1.05 | coords.AuxCoordLazy.time_bounds |
| | 22.0±1μs | 23.3±2μs | 1.06 | coords.AuxCoordLazy.time_create |
| | 408±40μs | 444±40μs | 1.09 | coords.AuxCoordLazy.time_points |
| | 6.73±0.3μs | 7.34±0.3μs | 1.09 | coords.CellMeasure.time_create |
| | 1.41±0.08μs | 1.49±0.1μs | 1.06 | coords.CellMethod.time_create |
| | n/a | n/a | n/a | coords.CoordCommon.time_create |
| | 198±20μs | 204±20μs | 1.03 | coords.DimCoord.time_create |
| | 63.5±2μs | 67.5±2μs | 1.06 | coords.DimCoord.time_regular |
| | 982±20ms | 1.01±0.03s | 1.03 | cube.Aggregation.time_aggregated_by |
| | 49.8±2μs | 48.2±2μs | 0.97 | cube.AncillaryVariable.time_add |
| | 9.02±0.3μs | 10.4±0.6μs | 1.16 | cube.AncillaryVariable.time_create |
| | 61.0±3μs | 61.4±4μs | 1.01 | cube.AuxCoord.time_add |
| | 7.56±0.6μs | 7.99±0.6μs | 1.06 | cube.AuxCoord.time_create |
| | 8.21±0.5μs | 7.96±0.4μs | 0.97 | cube.AuxCoord.time_return_coord_dims |
| | 5.96±0.2μs | 5.89±0.2μs | 0.99 | cube.AuxCoord.time_return_coords |
| | 61.2±4μs | 64.2±2μs | 1.05 | cube.AuxFactory.time_add |
| | 9.94±0.5μs | 9.86±0.7μs | 0.99 | cube.AuxFactory.time_create |
| | 49.1±3μs | 48.1±3μs | 0.98 | cube.CellMeasure.time_add |
| | 10.2±0.8μs | 9.93±0.6μs | 0.97 | cube.CellMeasure.time_create |
| | 40.4±1μs | 38.3±2μs | 0.95 | cube.CellMethod.time_add |
| | 5.09±0.3μs | 5.69±0.4μs | 1.12 | cube.CellMethod.time_create |
| | n/a | n/a | n/a | cube.ComponentCommon.time_add |
| | n/a | n/a | n/a | cube.ComponentCommon.time_create |
| | 201±10ms | 193±7ms | 0.96 | cube.Concatenate.time_concatenate |
| | 4.51±0.3μs | 4.19±0.3μs | 0.93 | cube.Cube.time_basic |
| | 77.0±6ns | 73.7±3ns | 0.96 | cube.Cube.time_rename |
| | 223±10μs | 222±10μs | 0.99 | cube.Equality.time_equality |
| | 942±200ms | 964±100ms | 1.02 | cube.Merge.time_merge |
| | 36.1±3μs | 35.2±3μs | 0.98 | cube.MeshCoord.time_add(10000) |
| | 41.0±5μs | 41.3±5μs | 1.01 | cube.MeshCoord.time_add(1000000) |
| | 33.2±4μs | 32.6±3μs | 0.98 | cube.MeshCoord.time_add(6) |
| | 17.8±0.6μs | 18.1±1μs | 1.02 | cube.MeshCoord.time_create(10000) |
| | 16.7±0.7μs | 17.8±1μs | 1.07 | cube.MeshCoord.time_create(1000000) |
| | 17.0±1μs | 16.8±0.6μs | 0.99 | cube.MeshCoord.time_create(6) |
| | 62.8±10μs | 58.1±8μs | 0.93 | cube.MeshCoord.time_remove(10000) |
| | 78.3±9μs | 78.8±9μs | 1.01 | cube.MeshCoord.time_remove(1000000) |
| | 55.8±8μs | 56.6±9μs | 1.02 | cube.MeshCoord.time_remove(6) |
| | 3.39±0.2ms | 3.28±0.1ms | 0.97 | experimental.ugrid.Connectivity.time_create(1000000) |
| | 2.33±0.09ms | 2.35±0.08ms | 1.01 | experimental.ugrid.Connectivity.time_create(6) |
| | 878±70ns | 809±30ns | 0.92 | experimental.ugrid.Connectivity.time_indices(1000000) |
| | 870±40ns | 863±30ns | 0.99 | experimental.ugrid.Connectivity.time_indices(6) |
| | 31.4±2ms | 27.9±2ms | 0.89 | experimental.ugrid.Connectivity.time_location_lengths(1000000) |
| | 3.51±0.2ms | 3.44±0.1ms | 0.98 | experimental.ugrid.Connectivity.time_location_lengths(6) |
| | 35.8±3ms | 33.5±3ms | 0.94 | experimental.ugrid.Connectivity.time_validate_indices(1000000) |
| | 5.37±0.3ms | 5.23±0.3ms | 0.97 | experimental.ugrid.Connectivity.time_validate_indices(6) |
| | 5.39±0.4ms | 5.26±0.4ms | 0.97 | experimental.ugrid.ConnectivityLazy.time_create(1000000) |
| | 4.09±0.3ms | 4.00±0.2ms | 0.98 | experimental.ugrid.ConnectivityLazy.time_create(6) |
| | 348±30μs | 336±40μs | 0.97 | experimental.ugrid.ConnectivityLazy.time_indices(1000000) |
| | 346±40μs | 328±30μs | 0.95 | experimental.ugrid.ConnectivityLazy.time_indices(6) |
| | 29.6±2ms | 28.3±1ms | 0.95 | experimental.ugrid.ConnectivityLazy.time_location_lengths(1000000) |
| | 3.95±0.3ms | 3.81±0.3ms | 0.96 | experimental.ugrid.ConnectivityLazy.time_location_lengths(6) |
| | 33.5±2ms | 32.3±2ms | 0.96 | experimental.ugrid.ConnectivityLazy.time_validate_indices(1000000) |
| | 5.56±0.3ms | 5.44±0.3ms | 0.98 | experimental.ugrid.ConnectivityLazy.time_validate_indices(6) |
| | 19.2±1μs | 20.7±1μs | 1.08 | experimental.ugrid.Mesh.time_add_connectivities(1000000) |
| | 412±10μs | 407±10μs | 0.99 | experimental.ugrid.Mesh.time_add_connectivities(6) |
| | 6.49±0.2μs | 6.17±0.5μs | 0.95 | experimental.ugrid.Mesh.time_add_coords(1000000) |
| | 6.25±0.3μs | 6.30±0.4μs | 1.01 | experimental.ugrid.Mesh.time_add_coords(6) |
| | 6.41±0.4μs | 6.58±0.4μs | 1.03 | experimental.ugrid.Mesh.time_connectivities(1000000) |
| | 6.38±0.3μs | 6.55±0.6μs | 1.03 | experimental.ugrid.Mesh.time_connectivities(6) |
| | 7.72±0.4μs | 7.99±0.5μs | 1.04 | experimental.ugrid.Mesh.time_coords(1000000) |
| | 7.69±0.2μs | 8.00±0.5μs | 1.04 | experimental.ugrid.Mesh.time_coords(6) |
| | 71.4±4μs | 72.9±7μs | 1.02 | experimental.ugrid.Mesh.time_create(1000000) |
| | 535±40μs | 540±20μs | 1.01 | experimental.ugrid.Mesh.time_create(6) |
| | 130±8ms | 131±8ms | 1.01 | experimental.ugrid.Mesh.time_eq(1000000) |
| | 424±50μs | 423±20μs | 1.00 | experimental.ugrid.Mesh.time_eq(6) |
| | 6.39±0.4μs | 6.50±0.4μs | 1.02 | experimental.ugrid.Mesh.time_remove_connectivities(1000000) |
| | 6.61±0.5μs | 6.37±0.5μs | 0.96 | experimental.ugrid.Mesh.time_remove_connectivities(6) |
| | 9.48±0.4μs | 10.0±1μs | 1.06 | experimental.ugrid.Mesh.time_remove_coords(1000000) |
| | 10.1±0.7μs | 9.88±0.3μs | 0.98 | experimental.ugrid.Mesh.time_remove_coords(6) |
| | 16.2±0.8μs | 18.1±1μs | 1.12 | experimental.ugrid.MeshCoord.time_bounds(10000) |
| | 303±10ms | 315±20ms | 1.04 | experimental.ugrid.MeshCoord.time_bounds(1000000) |
| | 7.54±0.4μs | 7.30±0.5μs | 0.97 | experimental.ugrid.MeshCoord.time_bounds(6) |
| | 5.45±0.4ms | 5.52±0.4ms | 1.01 | experimental.ugrid.MeshCoord.time_create(10000) |
| | 5.18±0.3ms | 5.53±0.4ms | 1.07 | experimental.ugrid.MeshCoord.time_create(1000000) |
| | 330±10μs | 328±20μs | 0.99 | experimental.ugrid.MeshCoord.time_create(6) |
| | 5.21±0.3μs | 5.17±0.3μs | 0.99 | experimental.ugrid.MeshCoord.time_points(10000) |
| | 6.71±0.3μs | 7.00±0.4μs | 1.04 | experimental.ugrid.MeshCoord.time_points(1000000) |
| | 3.79±0.2μs | 4.23±0.3μs | 1.12 | experimental.ugrid.MeshCoord.time_points(6) |
| | 10.6±0.7ms | 10.6±0.6ms | 1.00 | experimental.ugrid.MeshCoordLazy.time_bounds(10000) |
| | 305±10ms | 307±10ms | 1.01 | experimental.ugrid.MeshCoordLazy.time_bounds(1000000) |
| | 16.2±0.9μs | 16.4±1μs | 1.02 | experimental.ugrid.MeshCoordLazy.time_bounds(6) |
| | 5.19±0.3ms | 5.19±0.3ms | 1.00 | experimental.ugrid.MeshCoordLazy.time_create(10000) |
| | 5.29±0.3ms | 5.43±0.2ms | 1.03 | experimental.ugrid.MeshCoordLazy.time_create(1000000) |
| | 360±50μs | 362±50μs | 1.01 | experimental.ugrid.MeshCoordLazy.time_create(6) |
| | 3.71±0.3ms | 3.77±0.2ms | 1.02 | experimental.ugrid.MeshCoordLazy.time_points(10000) |
| | 8.71±0.5ms | 8.67±0.5ms | 1.00 | experimental.ugrid.MeshCoordLazy.time_points(1000000) |
| | 10.7±0.9μs | 10.9±1μs | 1.02 | experimental.ugrid.MeshCoordLazy.time_points(6) |
| | 51.2±5μs | 52.9±7μs | 1.03 | experimental.ugrid.MeshLazy.time_add_connectivities(1000000) |
| | 477±50μs | 473±40μs | 0.99 | experimental.ugrid.MeshLazy.time_add_connectivities(6) |
| | 25.5±2μs | 25.8±2μs | 1.01 | experimental.ugrid.MeshLazy.time_add_coords(1000000) |
| | 22.4±2μs | 20.9±2μs | 0.93 | experimental.ugrid.MeshLazy.time_add_coords(6) |
| | 24.2±3μs | 23.4±1μs | 0.96 | experimental.ugrid.MeshLazy.time_connectivities(1000000) |
| | 22.7±2μs | 22.3±1μs | 0.98 | experimental.ugrid.MeshLazy.time_connectivities(6) |
| | 28.5±2μs | 27.8±2μs | 0.98 | experimental.ugrid.MeshLazy.time_coords(1000000) |
| | 26.7±3μs | 26.7±2μs | 1.00 | experimental.ugrid.MeshLazy.time_coords(6) |
| | 116±10μs | 116±10μs | 1.00 | experimental.ugrid.MeshLazy.time_create(1000000) |
| | 561±60μs | 546±50μs | 0.97 | experimental.ugrid.MeshLazy.time_create(6) |
| | 141±7ms | 132±6ms | 0.94 | experimental.ugrid.MeshLazy.time_eq(1000000) |
| | 503±60μs | 519±50μs | 1.03 | experimental.ugrid.MeshLazy.time_eq(6) |
| | 26.0±2μs | 26.1±3μs | 1.01 | experimental.ugrid.MeshLazy.time_remove_connectivities(1000000) |
| | 23.7±1μs | 23.4±2μs | 0.99 | experimental.ugrid.MeshLazy.time_remove_connectivities(6) |
| | 44.6±6μs | 45.2±4μs | 1.01 | experimental.ugrid.MeshLazy.time_remove_coords(1000000) |
| | 43.6±7μs | 41.5±2μs | 0.95 | experimental.ugrid.MeshLazy.time_remove_coords(6) |
| | n/a | n/a | n/a | experimental.ugrid.UGridCommon.time_create(1000000) |
| | n/a | n/a | n/a | experimental.ugrid.UGridCommon.time_create(6) |
| | 753±50ns | 703±50ns | 0.93 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| | 411±20ms | 385±20ms | 0.94 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| | 5.0 | 5.0 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(50) |
| | 46.6796875 | 46.484375 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(500) |
| | 18.9±1ms | 18.1±0.9ms | 0.95 | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| | 23.1±0.9ms | 21.5±0.8ms | 0.93 | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| | 5.0 | 5.0 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50) |
| | 5.0 | 5.0 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
| | 218±10ms | 210±8ms | 0.96 | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| | 1.14±0.05s | 1.02±0.03s | 0.90 | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| | 5.80078125 | 5.0 | 0.86 | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(50) |
| | 156±4ms | 146±6ms | 0.94 | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50) |
| | 1.02±0.02s | 959±30ms | 0.94 | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500) |
| | 5.66015625 | 5.0 | 0.88 | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(50) |
| | 2.1752849999999997 | 2.1752849999999997 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| | 216.01528499999998 | 216.01528499999998 | 1.00 | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| | 1.03±0.05ms | 925±30μs | 0.90 | import_iris.Iris.time__concatenate |
| | 281±20μs | 274±10μs | 0.98 | import_iris.Iris.time__constraints |
| | 170±10μs | 158±9μs | 0.93 | import_iris.Iris.time__data_manager |
| | 128±7μs | 124±2μs | 0.97 | import_iris.Iris.time__deprecation |
| | 191±10μs | 184±8μs | 0.96 | import_iris.Iris.time__lazy_data |
| | 1.35±0.07ms | 1.32±0.06ms | 0.98 | import_iris.Iris.time__merge |
| | 108±8μs | 103±5μs | 0.96 | import_iris.Iris.time__representation |
| | 737±60μs | 709±40μs | 0.96 | import_iris.Iris.time_analysis |
| | 241±20μs | 254±20μs | 1.05 | import_iris.Iris.time_analysis__area_weighted |
| | 166±10μs | 162±10μs | 0.98 | import_iris.Iris.time_analysis__grid_angles |
| | 384±30μs | 360±10μs | 0.94 | import_iris.Iris.time_analysis__interpolation |
| | 316±30μs | 307±10μs | 0.97 | import_iris.Iris.time_analysis__regrid |
| | 162±20μs | 171±7μs | 1.05 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 223±10μs | 219±10μs | 0.98 | import_iris.Iris.time_analysis_calculus |
| | 486±30μs | 484±20μs | 1.00 | import_iris.Iris.time_analysis_cartography |
| | 136±7μs | 132±6μs | 0.96 | import_iris.Iris.time_analysis_geomerty |
| | 357±30μs | 367±20μs | 1.03 | import_iris.Iris.time_analysis_maths |
| | 130±8μs | 135±9μs | 1.04 | import_iris.Iris.time_analysis_stats |
| | 299±10μs | 304±10μs | 1.02 | import_iris.Iris.time_analysis_trajectory |
| | 462±20μs | 470±10μs | 1.02 | import_iris.Iris.time_aux_factory |
| | 114±7μs | 120±5μs | 1.05 | import_iris.Iris.time_common |
| | 291±20μs | 258±20μs | 0.89 | import_iris.Iris.time_common_lenient |
| | 1.42±0.1ms | 1.40±0.08ms | 0.98 | import_iris.Iris.time_common_metadata |
| | 214±10μs | 215±20μs | 1.01 | import_iris.Iris.time_common_mixin |
| | 1.64±0.09ms | 1.59±0.08ms | 0.97 | import_iris.Iris.time_common_resolve |
| | 335±20μs | 314±10μs | 0.94 | import_iris.Iris.time_config |
| | 197±10μs | 176±7μs | 0.89 | import_iris.Iris.time_coord_categorisation |
| | 512±40μs | 466±9μs | 0.91 | import_iris.Iris.time_coord_systems |
| | 1.05±0.05ms | 1.01±0.03ms | 0.96 | import_iris.Iris.time_coords |
| | 783±50μs | 771±60μs | 0.98 | import_iris.Iris.time_cube |
| | 328±30μs | 328±20μs | 1.00 | import_iris.Iris.time_exceptions |
| | 101±7μs | 100±3μs | 1.00 | import_iris.Iris.time_experimental |
| | 331±20μs | 309±10μs | 0.93 | import_iris.Iris.time_fileformats |
| | 378±30μs | 351±20μs | 0.93 | import_iris.Iris.time_fileformats__ff |
| | 3.87±0.2ms | 3.65±0.2ms | 0.94 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 117±7μs | 103±6μs | 0.88 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 184±10μs | 170±10μs | 0.92 | import_iris.Iris.time_fileformats_abf |
| | 589±50μs | 538±30μs | 0.91 | import_iris.Iris.time_fileformats_cf |
| | 6.65±0.5ms | 6.44±0.4ms | 0.97 | import_iris.Iris.time_fileformats_dot |
| | 107±6μs | 98.3±5μs | 0.92 | import_iris.Iris.time_fileformats_name |
| | 403±20μs | 402±20μs | 1.00 | import_iris.Iris.time_fileformats_name_loaders |
| | 178±6μs | 169±5μs | 0.95 | import_iris.Iris.time_fileformats_netcdf |
| | 196±10μs | 187±10μs | 0.95 | import_iris.Iris.time_fileformats_nimrod |
| | 355±20μs | 311±20μs | 0.88 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 1.03±0.06ms | 1.02±0.04ms | 0.99 | import_iris.Iris.time_fileformats_pp |
| | 285±10μs | 271±10μs | 0.95 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 199±9μs | 207±10μs | 1.04 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 696±40μs | 708±30μs | 1.02 | import_iris.Iris.time_fileformats_rules |
| | 333±10μs | 336±40μs | 1.01 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 116±7μs | 110±4μs | 0.95 | import_iris.Iris.time_fileformats_um |
| | 259±20μs | 263±10μs | 1.01 | import_iris.Iris.time_fileformats_um__fast_load |
| | 237±10μs | 246±10μs | 1.04 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 109±5μs | 102±6μs | 0.94 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 115±6μs | 119±5μs | 1.04 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 1.42±0.09ms | 1.30±0.06ms | 0.91 | import_iris.Iris.time_fileformats_um_cf_map |
| | 213±10μs | 217±10μs | 1.02 | import_iris.Iris.time_io |
| | 292±10μs | 269±20μs | 0.92 | import_iris.Iris.time_io_format_picker |
| | 333±20μs | 326±20μs | 0.98 | import_iris.Iris.time_iris |
| | 202±20μs | 196±10μs | 0.97 | import_iris.Iris.time_iterate |
| | 15.8±0.8ms | 15.5±0.6ms | 0.98 | import_iris.Iris.time_palette |
| | 531±30μs | 564±40μs | 1.06 | import_iris.Iris.time_plot |
| | 168±5μs | 160±10μs | 0.95 | import_iris.Iris.time_quickplot |
| | 2.73±0.2ms | 2.85±0.2ms | 1.05 | import_iris.Iris.time_std_names |
| | 2.99±0.1ms | 2.96±0.08ms | 0.99 | import_iris.Iris.time_symbols |
| | 131±50ms | 134±200ms | 1.02 | import_iris.Iris.time_tests |
| | 380±20μs | 353±10μs | 0.93 | import_iris.Iris.time_third_party_cartopy |
| | 6.14±0.3ms | 6.14±0.3ms | 1.00 | import_iris.Iris.time_third_party_cf_units |
| | 160±5μs | 151±6μs | 0.94 | import_iris.Iris.time_third_party_cftime |
| | 3.86±0.1ms | 3.84±0.3ms | 0.99 | import_iris.Iris.time_third_party_matplotlib |
| | 1.52±0.1ms | 1.46±0.07ms | 0.97 | import_iris.Iris.time_third_party_numpy |
| | 2.87±0.1ms | 2.86±0.2ms | 1.00 | import_iris.Iris.time_third_party_scipy |
| | 145±10μs | 139±5μs | 0.96 | import_iris.Iris.time_time |
| | 484±20μs | 476±20μs | 0.98 | import_iris.Iris.time_util |
| | 134±9μs | 126±7μs | 0.93 | iterate.IZip.time_izip |
| | 12.1±0.4ms | 11.7±0.3ms | 0.97 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| | 34.0±3ms | 34.5±3ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| | 13.3±0.6ms | 12.8±0.5ms | 0.97 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| | 12.0±0.5ms | 11.8±0.4ms | 0.98 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| | 30.2±2ms | 30.5±2ms | 1.01 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| | 13.3±0.6ms | 12.9±0.6ms | 0.96 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| | 1.89±0.06s | 1.83±0.06s | 0.97 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| | 27.7±2ms | 26.6±0.9ms | 0.96 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| | 2.06±0.08s | 2.02±0.04s | 0.98 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| | 1.85±0.09s | 1.84±0.03s | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| | 27.8±2ms | 27.4±1ms | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| | 2.05±0.07s | 2.04±0.03s | 1.00 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| | 5.81±0.1ms | 5.39±0.2ms | 0.93 | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| | 28.9±1ms | 26.8±2ms | 0.93 | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| | 6.24±0.3ms | 6.11±0.3ms | 0.98 | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| | 5.85±0.2ms | 5.78±0.3ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| | 28.8±1ms | 29.3±2ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| | 6.23±0.3ms | 6.36±0.2ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| | 56.8±2ms | 55.0±2ms | 0.97 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| | 42.6±2ms | 40.9±1ms | 0.96 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| | 19.8±2ms | 19.7±3ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| | 48.4±4ms | 44.4±3ms | 0.92 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| | 95.4±3ms | 93.8±4ms | 0.98 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| | 47.4±3ms | 47.7±3ms | 1.01 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| | 532±20ms | 500±10ms | 0.94 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| | 3.96±0.3ms | 3.91±0.2ms | 0.99 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| | 534±30ms | 525±20ms | 0.98 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| | 532±10ms | 512±20ms | 0.96 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| | 4.26±0.3ms | 4.33±0.4ms | 1.02 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| | 544±20ms | 522±20ms | 0.96 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| | 1.98±0.1ms | 1.74±0.07ms | 0.88 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| | 4.15±0.3ms | 3.97±0.1ms | 0.96 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| | 2.08±0.2ms | 1.84±0.2ms | 0.89 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| | 2.10±0.2ms | 1.80±0.2ms | 0.86 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| | 4.25±0.4ms | 4.01±0.2ms | 0.94 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| | 1.97±0.1ms | 1.87±0.1ms | 0.94 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| | 488±30ms | 472±20ms | 0.97 | load.ManyVars.time_many_var_load |
| | 11.9±0.5ms | 12.0±0.3ms | 1.01 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| | 13.5±0.5ms | 13.8±0.7ms | 1.02 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| | 1.90±0.06s | 1.87±0.03s | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| | 2.10±0.06s | 2.10±0.04s | 1.00 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| | 5.42±0.5ms | 5.19±0.2ms | 0.96 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| | 5.65±0.2ms | 5.58±0.1ms | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| | 11.8±0.4ms | 12.1±0.3ms | 1.03 | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| | 6.69±0.3ms | 6.19±0.2ms | 0.92 | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| | 1.87±0.09s | 1.84±0.06s | 0.98 | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| | 467±30ms | 453±20ms | 0.97 | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| | 5.20±0.3ms | 5.24±0.5ms | 1.01 | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| | 4.89±0.2ms | 4.83±0.4ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| | 229±9ms | 223±7ms | 0.98 | load.TimeConstraint.time_time_constraint(20, 'FF') |
| | 35.1±2ms | 30.8±1ms | 0.88 | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| | 250±6ms | 244±9ms | 0.98 | load.TimeConstraint.time_time_constraint(20, 'PP') |
| | 43.6±0.9ms | 42.4±1ms | 0.97 | load.TimeConstraint.time_time_constraint(3, 'FF') |
| | 32.1±2ms | 33.3±2ms | 1.04 | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| | 47.5±2ms | 47.1±2ms | 0.99 | load.TimeConstraint.time_time_constraint(3, 'PP') |
| | 25.8±1ms | 24.2±1ms | 0.94 | load.ugrid.BasicLoading.time_load_file(1) |
| | 58.6±2ms | 55.0±3ms | 0.94 | load.ugrid.BasicLoading.time_load_file(200000) |
| | 21.3±1ms | 18.9±0.8ms | 0.89 | load.ugrid.BasicLoading.time_load_mesh(1) |
| | 30.6±2ms | 32.0±2ms | 1.05 | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | 25.9±2ms | 23.5±0.6ms | 0.91 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| | 27.3±2ms | 29.6±2ms | 1.08 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| | 19.4±1ms | 19.4±1ms | 1.00 | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | 25.1±2ms | 22.6±2ms | 0.90 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | 26.3±2ms | 25.9±2ms | 0.98 | load.ugrid.Callback.time_load_file_callback(1) |
| | 69.9±3ms | 69.0±3ms | 0.99 | load.ugrid.Callback.time_load_file_callback(200000) |
| | 28.2±2ms | 25.2±0.8ms | 0.89 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| | 31.6±3ms | 30.5±3ms | 0.97 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| | 4.09±0.4ms | 4.11±0.4ms | 1.01 | load.ugrid.DataRealisation.time_realise_data(10000) |
| | 9.34±0.7ms | 9.37±0.6ms | 1.00 | load.ugrid.DataRealisation.time_realise_data(200000) |
| | 65.3±7ms | 64.2±5ms | 0.98 | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | 1.35±0.04s | 1.34±0.04s | 0.99 | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | 147±10ns | 150±10ns | 1.02 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_fields |
| | 1.26±0.05μs | 1.15±0.1μs | 0.91 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_values |
| | 137±4ns | 142±20ns | 1.04 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_fields |
| | 1.16±0.04μs | 1.20±0.1μs | 1.04 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_values |
| | 139±6ns | 139±10ns | 1.00 | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_fields |
| | 1.52±0.1μs | 1.42±0.08μs | 0.93 | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_values |
| | 141±10ns | 139±10ns | 0.98 | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_fields |
| | 1.47±0.09μs | 1.54±0.06μs | 1.05 | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_values |
| | 139±7ns | 137±8ns | 0.98 | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_fields |
| | 1.32±0.06μs | 1.31±0.1μs | 0.99 | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_values |
| | 138±4ns | 145±8ns | 1.05 | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_fields |
| | 1.61±0.1μs | 1.61±0.1μs | 1.00 | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_values |
| | 1.36±0.09μs | 1.32±0.09μs | 0.97 | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(1) |
| | 9.50±0.6μs | 9.21±0.4μs | 0.97 | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(10) |
| | 87.8±3μs | 87.6±4μs | 1.00 | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(100) |
| | 1.27±0.07μs | 1.32±0.07μs | 1.03 | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(1) |
| | 9.98±1μs | 10.0±0.5μs | 1.00 | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(10) |
| | 88.1±5μs | 86.9±4μs | 0.99 | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(100) |
| | 1.38±0.07μs | 1.36±0.1μs | 0.98 | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(1) |
| | 9.93±0.4μs | 10.2±0.5μs | 1.02 | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(10) |
| | 96.5±5μs | 89.5±6μs | 0.93 | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(100) |
| | 1.50±0.1μs | 1.46±0.07μs | 0.98 | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(1) |
| | 10.8±0.9μs | 10.6±0.7μs | 0.99 | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(10) |
| | 104±8μs | 95.7±5μs | 0.92 | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(100) |
| | 1.37±0.03μs | 1.32±0.04μs | 0.97 | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(1) |
| | 10.0±0.8μs | 9.80±0.5μs | 0.98 | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(10) |
| | 92.7±5μs | 95.7±7μs | 1.03 | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(100) |
| | 1.41±0.1μs | 1.47±0.06μs | 1.04 | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(1) |
| | 11.5±0.6μs | 11.1±0.4μs | 0.97 | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(10) |
| | 105±7μs | 101±2μs | 0.96 | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(100) |
| | 145±3ns | 156±10ns | 1.08 | mixin.CFVariableMixin.time_get_attributes |
| | 144±3ns | 144±10ns | 1.01 | mixin.CFVariableMixin.time_get_long_name |
| | 1.30±0.05μs | 1.36±0.1μs | 1.05 | mixin.CFVariableMixin.time_get_metadata |
| | 144±7ns | 157±10ns | 1.09 | mixin.CFVariableMixin.time_get_standard_name |
| | 147±9ns | 140±10ns | 0.95 | mixin.CFVariableMixin.time_get_units |
| | 153±7ns | 156±10ns | 1.02 | mixin.CFVariableMixin.time_get_var_name |
| | 953±30ns | 993±80ns | 1.04 | mixin.CFVariableMixin.time_set_attributes |
| | 168±7ns | 159±20ns | 0.95 | mixin.CFVariableMixin.time_set_long_name |
| | 4.98±0.2μs | 4.74±0.1μs | 0.95 | mixin.CFVariableMixin.time_set_metadata__dict |
| | 6.72±0.3μs | 6.89±0.5μs | 1.03 | mixin.CFVariableMixin.time_set_metadata__metadata |
| | 6.40±0.3μs | 5.84±0.2μs | 0.91 | mixin.CFVariableMixin.time_set_metadata__tuple |
| | 875±40ns | 889±100ns | 1.02 | mixin.CFVariableMixin.time_set_standard_name |
| | 559±30ns | 553±30ns | 0.99 | mixin.CFVariableMixin.time_set_units |
| | 585±20ns | 598±50ns | 1.02 | mixin.CFVariableMixin.time_set_var_name |
| | 594±10ms | 590±20ms | 0.99 | plot.AuxSort.time_aux_sort |
| | 155±5ms | 152±6ms | 0.98 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 584±20ms | 576±20ms | 0.99 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 802±20ms | 779±20ms | 0.97 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 5.36±0.2ms | 5.42±0.1ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | 149±7ms | 146±9ms | 0.98 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| | 60.3±3ms | 59.9±4ms | 0.99 | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | 823±40ms | 826±30ms | 1.00 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| | 131±5ns | 127±9ns | 0.97 | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | 108±7ms | 107±4ms | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| | 135±6ns | 129±20ns | 0.95 | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | 697±20ms | 686±10ms | 0.98 | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | 5.0 | 5.0 | 1.00 | save.NetcdfSave.track_addedmem_netcdf_save(50, False) |
| | 10.625 | 12.2265625 | 1.15 | save.NetcdfSave.track_addedmem_netcdf_save(50, True) |
| | 5.0 | 5.0 | 1.00 | save.NetcdfSave.track_addedmem_netcdf_save(600, False) |
| | 111.19140625 | 105.08203125 | 0.95 | save.NetcdfSave.track_addedmem_netcdf_save(600, True) |
| | 38.0±2ms | 37.5±2ms | 0.99 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 91.4±4ms | 95.4±6ms | 1.04 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [10cec691] <main~1> | After [b6e39d75] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------------------|
| + | 47.1094 | 69.9922 | 1.49 | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500) |
Generated by GHA run 6267964240