Skip to content

Conversation

@jpobst
Copy link
Contributor

@jpobst jpobst commented Sep 21, 2021

Context: https://twitter.com/KirillOsenkov/status/1440192351528374279

Our verbose logging is getting a little out of control. The make jenkins log is ~870 MB and can no longer be viewed in the AzDO UI.

Remove V=1 from our invocations, which removes /v:diag.

Timings aren't stable across build agents so numbers aren't very accurate, but there are definitely improvements:

  • Log file of make jenkins went from 870 MB to 32 MB
  • Build time of make jenkins went from 42:49 to 34:43

Full logs are still available in the .binlog's we already produce and place in artifacts.

@jpobst jpobst changed the title [test] See what turning off V=1 logging looks like and how long it ta… [ci] Make logging less verbose Sep 22, 2021
@jpobst jpobst marked this pull request as ready for review September 22, 2021 15:13
Copy link
Member

@jonathanpeppers jonathanpeppers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pjcollins
Copy link
Member

pjcollins commented Sep 22, 2021

We maybe want to remove this from the JI prepare step as well: https://github.com/xamarin/xamarin-android/blob/6467cda58822b4405a8a105a3268bd5341230187/build-tools/xaprepare/xaprepare/Steps/Step_PrepareExternalJavaInterop.Unix.cs#L24

My only concern with this would be losing out on potential information we get from passing --debug to various mono invocations via $MONO_OPTIONS, though at a glance that usage does look pretty sparse so I think it would be fine to lose that as well.

@jonpryor jonpryor merged commit e2a0d56 into main Sep 24, 2021
@jonpryor jonpryor deleted the log-test branch September 24, 2021 00:28
jonathanpeppers pushed a commit that referenced this pull request Sep 24, 2021
Context: https://twitter.com/KirillOsenkov/status/1440192351528374279

> Too often I see a build taking upwards of 10-20 minutes with all
> sorts of text loggers (file loggers, console loggers), worst of all
> text loggers of diagnostic verbosity.
> 
> Text loggers absolutely kill your build performance.

Our verbose logging is getting a little out of control.
The `make jenkins` log is ~870 MB and can no longer be viewed in the
AzDO UI.

Remove `V=1` from our `make` invocations, which removes `/v:diag`.

Timings aren't stable across build agents so numbers aren't very
accurate, but there are definitely improvements:

  - Log file of `make jenkins` went from 870 MB to 32 MB
  - Build time of `make jenkins` went from 42:49 to 34:43

Full logs are still available in the `.binlog`'s we already produce
and place in artifacts.
@github-actions github-actions bot locked and limited conversation to collaborators Jan 24, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants