Skip to content

iOS simulator configuration missing on some CI runs #13228

@freakboy3742

Description

@freakboy3742

Description

We are testing an iOS application on macOS-15 ARM64 machines, using an Xcode XCUnit test suite.

We've had multiple CI runs in the last 24 hours that have failed with an error log that indicates that the CI machine doesn't have any iOS simulator images.

Platforms affected

  • Azure DevOps
  • GitHub Actions - Standard Runners
  • GitHub Actions - Larger Runners

Runner images affected

  • Ubuntu 22.04
  • Ubuntu 24.04
  • macOS 13
  • macOS 13 Arm64
  • macOS 14
  • macOS 14 Arm64
  • macOS 15
  • macOS 15 Arm64
  • macOS 26 Arm64
  • Windows Server 2019
  • Windows Server 2022
  • Windows Server 2025

Image version and build link

Current runner version: '2.328.0'
Runner Image Provisioner
  Hosted Compute Agent
  Version: 20251016.436
  Commit: 8ab8ac8bfd662a3739dab9fe09456aba92132568
  Build Date: 2025-10-15T20:44:12Z
Operating System
  macOS
  15.7.1
  24G231
Runner Image
  Image: macos-15-arm64
  Version: 20251021.0066
  Included Software: https://github.com/actions/runner-images/blob/macos-15-arm64/20251021.0066/images/macos/macos-15-arm64-Readme.md
  Image Release: https://github.com/actions/runner-images/releases/tag/macos-15-arm64%2F20251021.0066

Is it regression?

Unclear. This is a newly added CI workflow.

Expected behavior

An iPhone 16e simulator running iOS 18.5 should be available to start an Xcode project test suite.

Actual behavior

Builds fail with an error log that indicates that the iPhone 16e simulator running iOS 18.5 isn't available:

/opt/homebrew/opt/python@3.14/bin/python3.14 /Users/runner/work/cpython/cpython/cross-build/iOS-testbed.1761746479481 run --verbose --simulator 'iPhone 16e,OS=18.5' -- test --fast-ci --single-process --no-randomize --timeout=-1 --dont-add-python-opts
  Updating test plan... done.
  Running test on iPhone 16e,OS=18.5
  Building test project...
  Command line invocation:
      /Applications/Xcode_16.4.app/Contents/Developer/usr/bin/xcodebuild build-for-testing -project /Users/runner/work/cpython/cpython/cross-build/iOS-testbed.1761746479481/iOSTestbed.xcodeproj -scheme iOSTestbed -destination "platform=iOS Simulator,name=iPhone 16e,OS=18.5" -derivedDataPath /Users/runner/work/cpython/cpython/cross-build/iOS-testbed.1761746479481/DerivedData
  
  2025-10-29 14:02:24.170 xcodebuild[28440:77325] Writing error result bundle to /var/folders/xc/cl1fyykn2pj4ryhdw6r1mqtc0000gn/T/ResultBundle_2025-29-10_14-02-0024.xcresult
  xcodebuild: error: Unable to find a device matching the provided destination specifier:
  		{ platform:iOS Simulator, OS:18.5, name:iPhone 16e }
  
  	The requested device could not be found because no available devices matched the request.
  
  	Available destinations for the "iOSTestbed" scheme:
  		{ platform:macOS, arch:arm64, variant:Designed for [iPad,iPhone], id:a4d03d1902bd67af9d4ffa129a188d430f552ec1, name:My Mac }
  		{ platform:iOS, id:dvtdevice-DVTiPhonePlaceholder-iphoneos:placeholder, name:Any iOS Device }
  		{ platform:iOS Simulator, id:dvtdevice-DVTiOSDeviceSimulatorPlaceholder-iphonesimulator:placeholder, name:Any iOS Simulator Device }
  Traceback (most recent call last):

Some example runs:

Re-runs on these jobs passed, matching simulator id 7EDFF154-B6AB-44D3-BA15-EBE53F1F1878.

Repro steps

We don't have a reliable reproduction case; it's an intermittent failure.

We are invoking sudo xcode-select --switch /Applications/Xcode_16.4.app as part of the build to ensure that Xcode has been selected. The iPhone 16e,OS=18.5 image is being specifically selected because it is a pre-warmed simulator that isn't affected by #12777.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Area: XcodeOS: macOSbug reportinvestigateCollect additional information, like space on disk, other tool incompatibilities etc.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions