[ric-oliv]

Part 4 of 6 for #5806, based on #5809. The device test jobs had the same chain as the build legs: each ran the device tests and then the integration tests. The integration tests build and run their own app and share only the simulator or emulator, so they now run in a second job at the same time, one commit per platform.

iOS. ios-integration-tests runs next to ios-tests. ios.Tests.ps1 skips every case unless a simulator is already booted, and xharness only boots one in ios-tests, so the new job boots its own, with a 10-minute timeout. In #5790 the iOS workflow took 18 minutes, against 38.7 the same night, and all 8 integration cases passed.

Android. android-integration-tests uses the same API level and framework matrix through YAML anchors. It starts with the workflow instead of waiting for the device test app builds.

• It runs on the same larger runner as the device tests here, and ci: run the Android emulator jobs on standard runners #5812 moves both.
• It drops "Select Java 21". iOS & Android integration tests #4559 added it as "Select Java 17", when Setup Environment ended on Java 11, and since chore: Setup Environment failing to install Java on Win ARM-64 #5060 Setup Environment installs only Java 21.

In #5800 the Android workflow took 19.8 minutes instead of 30.1.

On this PR's own CI

3 runs, including #5807 to #5809. iOS Device Tests took 22.1, 22.2 and 15.9 minutes against 39.0 on main, and all 8 integration cases passed each time. Android Device Tests took 21.1, 34.8 and 29.1, because here the emulator jobs still use the larger runner, and they waited up to 11.9, 25.6 and 20.5 minutes for one. #5812 moves them to standard runners, where Android took 17.9, 18.4 and 17.5. The whole stack's numbers are in #5806.

#skip-changelog

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 76.12%. Comparing base (1db0ebb) to head (3db1268).

Additional details and impacted files

@@                                 Coverage Diff                                  @@
##           ci/run-samples-and-integration-tests-in-own-jobs    #5810      +/-   ##
====================================================================================
- Coverage                                             76.13%   76.12%   -0.01%     
====================================================================================
  Files                                                   528      528              
  Lines                                                 19579    19579              
  Branches                                               3829     3829              
====================================================================================
- Hits                                                  14906    14905       -1     
  Misses                                                 3791     3791              
- Partials                                                882      883       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[jamescrosswell]

LGTM - just have to make sure it gets merged at the same time as #5812 since the the emulator jobs needing the larger 4-core runners go from 4 to 8, all starting at about the same time, until #5812 merges.