Skip to content

Conversation

@antonis
Copy link
Contributor

@antonis antonis commented Aug 14, 2025

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

📜 Description

Temporarily downgrades the affected iOS runners to macos-14 to handle the environment change linked below. The tooling (xcode 16.2) remained the same and there should be no effect in the validity of the CI checks/tests.

An issue was opened to revisit this: #5082

Other solutions considered:

  • Updating the projects to later iOS versions: this is not simple in all cases. E.g the RnDiffApp is specific to the RN version and probably needs to be patched after download to achieve the desired.
  • Installing the missing platforms with tools like xcodes will increase the CI time a lot.

💡 Motivation and Context

Deprecations in actions/runner-images#12734 resulted in:

💚 How did you test it?

CI

📝 Checklist

  • I added tests to verify changes
  • No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • I updated the docs if needed.
  • I updated the wizard if needed.
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

@github-actions
Copy link
Contributor

github-actions bot commented Aug 14, 2025

iOS (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1231.08 ms 1220.84 ms -10.24 ms
Size 2.63 MiB 3.81 MiB 1.18 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
d916aa3+dirty 1221.02 ms 1228.98 ms 7.96 ms
534ba8c+dirty 1230.22 ms 1231.18 ms 0.96 ms
64cd15c+dirty 1216.31 ms 1214.04 ms -2.26 ms
785ffb1+dirty 1237.63 ms 1240.50 ms 2.87 ms
3e0a5f9+dirty 1226.94 ms 1230.02 ms 3.08 ms
eb07ba3+dirty 1222.46 ms 1220.37 ms -2.08 ms
7be1f99+dirty 1226.69 ms 1217.76 ms -8.93 ms
e2fa43d+dirty 1216.04 ms 1232.65 ms 16.61 ms

App size

Revision Plain With Sentry Diff
d916aa3+dirty 2.63 MiB 3.81 MiB 1.18 MiB
534ba8c+dirty 2.63 MiB 3.81 MiB 1.18 MiB
64cd15c+dirty 2.63 MiB 3.81 MiB 1.18 MiB
785ffb1+dirty 2.63 MiB 3.81 MiB 1.18 MiB
3e0a5f9+dirty 2.63 MiB 3.81 MiB 1.18 MiB
eb07ba3+dirty 2.63 MiB 3.81 MiB 1.18 MiB
7be1f99+dirty 2.63 MiB 3.81 MiB 1.18 MiB
e2fa43d+dirty 2.63 MiB 3.81 MiB 1.18 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Aug 14, 2025

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 379.43 ms 447.06 ms 67.63 ms
Size 7.15 MiB 8.42 MiB 1.27 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
3e0a5f9+dirty 379.92 ms 450.96 ms 71.04 ms
d916aa3+dirty 411.72 ms 451.76 ms 40.03 ms
785ffb1+dirty 380.65 ms 451.83 ms 71.18 ms
534ba8c+dirty 472.35 ms 537.31 ms 64.96 ms
7be1f99+dirty 369.02 ms 399.60 ms 30.58 ms
64cd15c+dirty 488.79 ms 483.54 ms -5.24 ms
eb07ba3+dirty 419.49 ms 482.12 ms 62.63 ms
e2fa43d+dirty 326.56 ms 372.88 ms 46.32 ms

App size

Revision Plain With Sentry Diff
3e0a5f9+dirty 7.15 MiB 8.42 MiB 1.27 MiB
d916aa3+dirty 7.15 MiB 8.42 MiB 1.27 MiB
785ffb1+dirty 7.15 MiB 8.42 MiB 1.27 MiB
534ba8c+dirty 7.15 MiB 8.42 MiB 1.27 MiB
7be1f99+dirty 7.15 MiB 8.42 MiB 1.27 MiB
64cd15c+dirty 7.15 MiB 8.42 MiB 1.27 MiB
eb07ba3+dirty 7.15 MiB 8.42 MiB 1.27 MiB
e2fa43d+dirty 7.15 MiB 8.42 MiB 1.27 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Aug 14, 2025

iOS (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1206.06 ms 1198.94 ms -7.12 ms
Size 3.19 MiB 4.38 MiB 1.19 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
d916aa3+dirty 1211.02 ms 1221.33 ms 10.31 ms
534ba8c+dirty 1225.00 ms 1237.43 ms 12.43 ms
64cd15c+dirty 1213.50 ms 1223.54 ms 10.04 ms
785ffb1+dirty 1213.71 ms 1213.37 ms -0.35 ms
3e0a5f9+dirty 1233.65 ms 1239.10 ms 5.45 ms
eb07ba3+dirty 1214.49 ms 1221.59 ms 7.10 ms
7be1f99+dirty 1222.43 ms 1217.15 ms -5.28 ms
e2fa43d+dirty 1224.43 ms 1235.40 ms 10.98 ms

App size

Revision Plain With Sentry Diff
d916aa3+dirty 3.19 MiB 4.38 MiB 1.19 MiB
534ba8c+dirty 3.19 MiB 4.38 MiB 1.19 MiB
64cd15c+dirty 3.19 MiB 4.38 MiB 1.19 MiB
785ffb1+dirty 3.19 MiB 4.38 MiB 1.19 MiB
3e0a5f9+dirty 3.19 MiB 4.38 MiB 1.19 MiB
eb07ba3+dirty 3.19 MiB 4.38 MiB 1.19 MiB
7be1f99+dirty 3.19 MiB 4.38 MiB 1.19 MiB
e2fa43d+dirty 3.19 MiB 4.38 MiB 1.19 MiB

@antonis antonis changed the title chore(ci): Bump iOS simulator to 18.6 chore(ci): Handle GH runner image deprecations Aug 14, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Aug 14, 2025

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 388.54 ms 371.02 ms -17.52 ms
Size 17.75 MiB 20.15 MiB 2.41 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
64cd15c 439.02 ms 427.63 ms -11.39 ms
7be1f99 454.83 ms 461.36 ms 6.53 ms
e2fa43d 451.68 ms 462.42 ms 10.74 ms
3e0a5f9 401.72 ms 394.98 ms -6.74 ms
d916aa3 425.37 ms 427.02 ms 1.65 ms
785ffb1 471.92 ms 460.96 ms -10.96 ms
534ba8c 484.00 ms 499.93 ms 15.93 ms
eb07ba3 470.04 ms 473.35 ms 3.31 ms

App size

Revision Plain With Sentry Diff
64cd15c 17.75 MiB 20.15 MiB 2.41 MiB
7be1f99 17.75 MiB 20.15 MiB 2.41 MiB
e2fa43d 17.75 MiB 20.15 MiB 2.41 MiB
3e0a5f9 17.75 MiB 20.15 MiB 2.41 MiB
d916aa3 17.75 MiB 20.15 MiB 2.41 MiB
785ffb1 17.75 MiB 20.15 MiB 2.41 MiB
534ba8c 17.75 MiB 20.15 MiB 2.41 MiB
eb07ba3 17.75 MiB 20.15 MiB 2.41 MiB

@antonis antonis marked this pull request as ready for review August 14, 2025 11:16
Comment on lines +46 to 47
runs-on: macos-14
- platform: macos

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Potential bug: The `sample-application.yml` workflow relies on the default Xcode version of the `macos-14` runner, which could cause non-deterministic build failures if the default changes or lacks required iOS simulators.
  • Description: The sample-application.yml workflow is updated to use runs-on: macos-14 but, unlike other workflows in this change, it does not explicitly configure an Xcode version. The workflow hardcodes IOS_DEVICE: 'iPhone 16' and IOS_VERSION: '18.1', which require a specific Xcode version. Relying on the runner's default Xcode version creates a risk of non-deterministic build failures if the default does not support these specific iOS simulator requirements. This inconsistency could block development workflows if the environment expectations are not met.

  • Suggested fix: To ensure build stability and consistency, add an explicit Xcode version to the sample-application.yml workflow matrix, similar to the sample-application-expo.yml workflow. This involves adding xcode-version: '16.2' to the matrix and including a step to select it using sudo xcode-select.
    severity: 0.65, confidence: 0.9

Did we get this right? 👍 / 👎 to inform future reviews.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll leave this to be tackled properly in #5082

Copy link
Collaborator

@lucas-zimerman lucas-zimerman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@antonis antonis merged commit 934457a into main Aug 14, 2025
120 of 124 checks passed
@antonis antonis deleted the antonis/bump-ios-to-18.6 branch August 14, 2025 12:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants