e2e mobile repro evidence: unstable node ids, tap on disabled control

README.md

Evidence for tester-army/e2e mobile issues

Recordings and logs from @e2e-dev/mobile 0.9.2 / e2e 0.17.0 / agent-device 0.21.20 on an iOS 27.0 simulator (iPhone 17).

issue1-agent-number-pad.mp4

issue1-agent-turns.txt

turn 7: calls=['tap({"target":"n781"})']
   -> [tap] Tapped #n781. | The screen changed substantially since revision b14. Current screen (revision b16, path com.stringsaeed.moneym | ['Amount 70 USD']
turn 8: calls=['tap({"target":"n829"})']
   -> [tap] Tapped #n829. | The screen changed substantially since revision b16. Current screen (revision b18, path com.stringsaeed.moneym | ['Amount 7 USD']
turn 9: calls=['long_press({"target":"n877"})']
   -> [long_press] Long-pressed #n877. | The screen changed substantially since revision b18. Current screen (revision b20, path com.stringsaeed.moneym | ['Amount 0 USD']
turn 10: calls=['tap({"target":"n920"})']
   -> [tap] Tapped #n920. | The screen changed substantially since revision b20. Current screen (revision b22, path com.stringsaeed.moneym | ['Amount 7 USD']
turn 11: calls=['tap({"target":"n972"})']
   -> [tap] Tapped #n972. | The screen changed substantially since revision b22. Current screen (revision b24, path com.stringsaeed.moneym | ['Amount 70 USD']
turn 12: calls=['long_press({"target":"n1021"})']
   -> [long_press] Long-pressed #n1021. | The screen changed substantially since revision b24. Current screen (revision b26, path com.stringsaeed.moneym | ['Amount 0 USD']
turn 13: calls=['tap({"target":"n1064"})']
   -> [tap] Tapped #n1064. | The screen changed substantially since revision b26. Current screen (revision b28, path com.stringsaeed.moneym | ['Amount 7 USD']
turn 14: calls=['tap({"target":"n1117"})']
   -> [tap] Tapped #n1117. | The screen changed substantially since revision b28. Current screen (revision b30, path com.stringsaeed.moneym | ['Amount 0 USD']
turn 15: calls=['long_press({"target":"n1165"})']
   -> [long_press] Long-pressed #n1165. | The screen changed substantially since revision b30. Current screen (revision b35, path com.stringsaeed.moneym | ['Amount 0 USD']
turn 16: calls=['tap({"target":"n1280"})']
   -> [tap] Tapped #n1280. | The screen changed substantially since revision b35. Current screen (revision b37, path com.stringsaeed.moneym | ['Amount 7 USD']
turn 17: calls=['tap({"target":"n1337"})']
   -> [tap] Tapped #n1337. | The screen changed substantially since revision b37. Current screen (revision b39, path com.stringsaeed.moneym | ['Amount 0 USD']
turn 18: calls=['complete_step({"status":"failed","summary":"Opened the New transaction editor, but the amount remains 0 USD; the attempted number-pad sequence did not produce the requested 750, and nothing was saved.…[truncated]']
   -> [complete_step] Step concluded. |  | []
ENGINE ACTIONS: ['tap button "Create"', 'tap button "7"', 'tap button "0"', 'tap button "7"', 'tap button "Delete digit"', 'tap button "7"', 'tap button "Delete digit"', 'tap button "Delete digit"', 'long-press button "Delete digit"', 'tap button "7"', 'tap button "0"', 'long-press button "Delete digit"', 'tap button "7"', 'tap button "Delete digit"', 'long-press button "Delete digit"', 'tap button "7"', 'tap button "Delete digit"']
RESULT: Opened the New transaction editor, but the amount remains 0 USD; the attempted number-pad sequence did not produce the requested 750, and nothing was saved.

issue1-contact-sheet.png

issue1-failure-screen.txt

# Screen at failure
url: com.stringsaeed.moneymanagement.next
revision: b40
viewport: 402x874
nodes: 27

#root screen
 #n1390 application "Trove Next"
  #n1391 other "New transaction"
   #n1392 text "New transaction"
   #n1393 button "Close"
   #n1394 button "Save"
   #n1395 other "Account: Everyday"
    #n1396 scroll-view "Account: Everyday"
     #n1397 button "Account: Everyday"
     #n1398 button "Category: none"
     #n1399 button "Date: Today"
   #n1400 text "Amount 0 USD" testid="transaction-amount"
   #n1401 other "Note"
    #n1402 textbox "Note" testid="transaction-note-field"
   #n1403 other testid="transaction-num-pad"
   #n1404 button "1"
   #n1405 button "2"
   #n1406 button "3"
   #n1407 button "4"
   #n1408 button "5"
   #n1409 button "6"
   #n1410 button "7"
   #n1411 button "8"
   #n1412 button "9"
   #n1413 button "Decimal point"
   #n1414 button "0"
   #n1415 button "Delete digit"

issue1-id-mapping.txt

report keeps turns 7..18; engine actions total 17
turn | call       | id    | key at that id in the screen the agent was shown | key the engine pressed
   7 | tap        | n781  | (screen not kept in report)                      | tap button "Delete digit"
   8 | tap        | n829  | Delete digit                                     | tap button "Delete digit"
   9 | long_press | n877  | Delete digit                                     | long-press button "Delete digit"
  10 | tap        | n920  | 7                                                | tap button "7"
  11 | tap        | n972  | 0                                                | tap button "0"
  12 | long_press | n1021 | Delete digit                                     | long-press button "Delete digit"
  13 | tap        | n1064 | 7                                                | tap button "7"
  14 | tap        | n1117 | Delete digit                                     | tap button "Delete digit"
  15 | long_press | n1165 | Delete digit                                     | long-press button "Delete digit"
  16 | tap        | n1280 | 7                                                | tap button "7"
  17 | tap        | n1337 | ?                                                | tap button "Delete digit"

issue2-contact-sheet.png

issue2-disabled-tap.mp4

issue2-e2e.repro.config.ts

issue2-gesture-telemetry.json

issue2-repro-disabled-tap.e2e.ts