Annotations do not work consistently.

[RostyslavDzhohola]

https://screen.studio/share/7fLqoTTN

pnpm dlx serve-sim -p 3200 

System / Toolchain

macOS: 26.5 build 25F71
Architecture: arm64
Xcode: 26.1 build 17B55
Node: v22.14.0
pnpm: 10.25.0
Expo CLI reported: 54.0.21

Simulator

Device: iPhone 17 Pro Max
Runtime available: iOS 26.1 (23B86)
Also installed: iOS 17.4, 18.6, 26.2

App / React Native

Expo SDK package: 54.0.31
React Native: 0.81.5
React: 19.1.0
React DOM: 19.1.0
Expo Router: 6.0.21
Expo Dev Client: 6.0.20
TypeScript installed: 5.9.3
App name: It’s Her
App version: 1.2.6
Bundle ID: com.calendarflow.app
New Architecture: false
Generated native iOS dir exists: apps/mobile/ios

Relevant Repo Commands

pnpm -C apps/mobile ios:sim
# maps to:
expo run:ios --device 'iPhone 17 Pro Max'

pnpm -C apps/mobile start:devclient
# maps to:
expo start --dev-client --scheme calendarflow

pnpm -C apps/mobile web
# maps to:
expo start --web

[amzzzzzzz]

I am seeing a related overlay/annotation inconsistency on serve-sim@0.1.40 with a native SwiftUI app on iPhone Air / iOS 26.5.

When the accessibility overlay is working, it correctly draws boxes around SwiftUI elements and highlights/selects an element when clicked. However, clicking a highlighted overlay region sometimes appears to select the annotation only and does not forward/activate the underlying simulator element.

Example from my repro:

• $17,938.96 is exposed as a tappable SwiftUI accessibility element.
• Xcode UI automation can tap the element successfully by AX ref/identifier.
• In the serve-sim mirror with overlay enabled, clicking the highlighted box around the amount can select/highlight the annotation but not trigger the app's tap handler.
• The simulator pixels remain live throughout.

Environment:

serve-sim: 0.1.40 from npm latest
macOS: 26.5.1 build 25F80
Architecture: arm64
Xcode: 26.5 build 17F42
Node: v26.0.0
npm: 11.12.1
Simulator: iPhone Air, iOS 26.5 runtime 23F77
App: native SwiftUI app

Not sure if this is the same root cause as the annotation inconsistency here, but it feels adjacent: overlay visualization and element selection work, while input forwarding to the underlying simulator element is inconsistent.