[perf] iOS Maui scenarios startup with Native AOT didn't get the fully-drawn magic string event

[kotlarmilos]

Description

iOS Maui performance scenarios with Native AOT can't get the fully-drawn magic string event and terminate the measurements successfully.

[2023/07/20 01:42:04][INFO] {"count":16,"finished":1}
[2023/07/20 01:42:04][INFO] ==========
[2023/07/20 01:42:04][INFO] /private/tmp/helix/working/A9A00928/w/B1E70900/e/mauiblazorios/tmp/iteration0.logarchive
[2023/07/20 01:42:04][INFO] ==========
[2023/07/20 01:42:04][INFO] $ log show --predicate "(processIdentifier == 1511) && (composedMessage contains \"__MAUI_Blazor_WebView_OnAfterRender__\")" --info --style ndjson tmp/iteration0.logarchive
[2023/07/20 01:42:04][INFO] {"count":0,"finished":1}
[2023/07/20 01:42:04][INFO] ==========
[2023/07/20 01:42:04][INFO] /private/tmp/helix/working/A9A00928/w/B1E70900/e/mauiblazorios/tmp/iteration0.logarchive
[2023/07/20 01:42:04][INFO] ==========
Versions: {'mauiVersion': '8.0.0-nightly.8767+sha.15061214f-azdo.8112471.15061214f153f9ed81de921c34a9777d8c8a0230'}
Traceback (most recent call last):
  File "test.py", line 16, in <module>
    Runner(traits).run()
  File "/tmp/helix/working/A9A00928/p/shared/runner.py", line 763, in run
    raise Exception("Didn't get the fully-drawn magic string event.")
Exception: Didn't get the fully-drawn magic string event.
Removing app,tmp,traces,pub,bin,crossgen.out,__pycache__,emsdk if exist ...
Removing empty log files:
ls: /tmp/helix/working/A9A00928/w/B1E70900/uploads/xunit-*.xml: No such file or directory
+ exit_code=1
+ '[' -f /tmp/helix/working/A9A00928/w/B1E70900/e/.retry ']'
+ '[' -f /tmp/helix/working/A9A00928/w/B1E70900/e/.reboot ']'
+ exit 1
+ export _commandExitCode=1
+ _commandExitCode=1
+ export PYTHONPATH=:/etc/helix/scripts
+ PYTHONPATH=:/etc/helix/scripts
+ /usr/local/bin/python3 -u /tmp/helix/working/A9A00928/w/B1E70900/u/xharness-event-processor.py
Reporting 4 events from diagnostics file `/tmp/helix/working/A9A00928/w/B1E70900/e/diagnostics.json`

[kotlarmilos]

This is happening in the Blazor Maui scenario with the Native AOT. The app's end string is not being printed or detected.

performance/src/scenarios/mauiblazorios/pre.py

Lines 26 to 51 in d3e3154

	with open(f"{const.APPDIR}/Pages/Index.razor.cs", "w") as indexCSFile:
	indexCSFile.write('''
	using Microsoft.AspNetCore.Components;
	#if ANDROID
	using Android.App;
	#endif\n\n'''
	+ f" namespace {EXENAME}.Pages" +
	'''
	{
	public partial class Index
	{
	protected override void OnAfterRender(bool firstRender)
	{
	if (firstRender)
	{
	#if ANDROID
	var activity = MainActivity.Context as Activity;
	activity.ReportFullyDrawn();
	#else
	System.Console.WriteLine(\"__MAUI_Blazor_WebView_OnAfterRender__\");
	#endif
	}
	}
	}
	}
	''')

I will try to reproduce the failure locally.

/cc: @ivanpovazan

[kotlarmilos]

I tried the app locally and there is a fully-drawn magic string event. @LoopedBard3 Could the script for measuring startup terminate before the app logs the event?

[kotlarmilos]

I managed to reproduce the issue locally: dotnet/macios#19117.

[LoopedBard3]

It seems this is now happening in the Mono runs: https://dev.azure.com/dnceng/internal/_build/results?buildId=2355112&view=results (Net9.0 testing run hitting what appears to be the same issue).

[kotlarmilos]

It seems this is now happening in the Mono runs: https://dev.azure.com/dnceng/internal/_build/results?buildId=2355112&view=results (Net9.0 testing run hitting what appears to be the same issue).

Is this still relevant for Mono runs?

[LoopedBard3]

Yes, this still seems to be the case for Mono runs. Here is a test run: https://dev.azure.com/dnceng/internal/_build/results?buildId=2379407&view=results that demonstrates this.