Guest User

OpenClaw A11y Snapshot vs Predicate Snapshot for LLM to reason

a guest
Feb 24th, 2026
623
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.21 KB | None | 0 0
  1. ======================================================================
  2. Running with A11Y approach
  3. ======================================================================
  4.  
  5. [2026-02-25 02:23:31] Step 1: Wait for login form hydration
  6. Waiting for form to hydrate using runtime.check().eventually()...
  7. Button initially disabled: false
  8. PASS (12060ms) | Found 19 elements
  9.  
  10. [2026-02-25 02:23:43] Step 2: Fill username field
  11. Snapshot: 45 elements, 1241 tokens
  12. LLM chose element 37: "Username"
  13. PASS (7613ms) | Typed "testuser"
  14. Tokens: prompt=1241 total=1251
  15.  
  16. [2026-02-25 02:23:51] Step 3: Fill password field
  17. LLM chose element 42: "Password"
  18. Waiting for login button to become enabled...
  19. PASS (13691ms) | Button enabled: true
  20. Tokens: prompt=1295 total=1305
  21.  
  22. [2026-02-25 02:24:04] Step 4: Click login button
  23. LLM chose element 47: "Sign in"
  24. PASS (7909ms) | Navigated to https://www.localllamaland.com/profile
  25. Tokens: prompt=1367 total=1377
  26.  
  27. [2026-02-25 02:24:12] Step 5: Navigate to profile page
  28. PASS (1ms) | Already on profile page
  29.  
  30. [2026-02-25 02:24:12] Step 6: Extract username from profile
  31. Waiting for profile card to load...
  32. Found username: [email protected]
  33. Found email: [email protected]
  34. PASS (10401ms) | [email protected]
  35. Tokens: prompt=1433 total=1433
  36.  
  37. ======================================================================
  38. Running with PREDICATE approach
  39. ======================================================================
  40.  
  41. [2026-02-25 02:24:23] Step 1: Wait for login form hydration
  42. Waiting for form to hydrate using runtime.check().eventually()...
  43. Button initially disabled: false
  44. PASS (10792ms) | Found 19 elements
  45.  
  46. [2026-02-25 02:24:34] Step 2: Fill username field
  47. Snapshot: 19 elements, 351 tokens
  48. LLM chose element 23: "username"
  49. PASS (12324ms) | Typed "testuser"
  50. Tokens: prompt=351 total=361
  51.  
  52. [2026-02-25 02:24:46] Step 3: Fill password field
  53. LLM chose element 25: "Password"
  54. Waiting for login button to become enabled...
  55. PASS (18410ms) | Button enabled: true
  56. Tokens: prompt=352 total=362
  57.  
  58. [2026-02-25 02:25:04] Step 4: Click login button
  59. LLM chose element 29: "Sign in"
  60. PASS (13233ms) | Navigated to https://www.localllamaland.com/profile
  61. Tokens: prompt=352 total=362
  62.  
  63. [2026-02-25 02:25:18] Step 5: Navigate to profile page
  64. PASS (0ms) | Already on profile page
  65.  
  66. [2026-02-25 02:25:18] Step 6: Extract username from profile
  67. Waiting for profile card to load...
  68. Found username: [email protected]
  69. Found email: Profile testuser [email protected]
  70. PASS (20796ms) | [email protected]
  71. Tokens: prompt=480 total=480
  72.  
  73. ======================================================================
  74. RESULTS SUMMARY
  75. ======================================================================
  76.  
  77. +-----------------------------------------------------------------------+
  78. | Metric | A11y Tree | Predicate | Delta |
  79. +-----------------------------------------------------------------------+
  80. | Total Tokens | 5366 | 1565 | -71% |
  81. | Total Latency (ms) | 51675 | 75555 | +46% |
  82. | Steps Passed | 6/6 | 6/6 | |
  83. +-----------------------------------------------------------------------+
  84.  
  85. Key Insight: Predicate snapshots use 71% fewer tokens
  86. for a multi-step login workflow with form filling.
  87.  
  88. Step-by-step breakdown:
  89. ----------------------------------------------------------------------
  90. Step 1: Wait for login form hydration
  91. A11y: 0 tokens, 12060ms, PASS
  92. Pred: 0 tokens, 10792ms, PASS (0% savings)
  93. Step 2: Fill username field
  94. A11y: 1251 tokens, 7613ms, PASS
  95. Pred: 361 tokens, 12324ms, PASS (71% savings)
  96. Step 3: Fill password field
  97. A11y: 1305 tokens, 13691ms, PASS
  98. Pred: 362 tokens, 18410ms, PASS (72% savings)
  99. Step 4: Click login button
  100. A11y: 1377 tokens, 7909ms, PASS
  101. Pred: 362 tokens, 13233ms, PASS (74% savings)
  102. Step 5: Navigate to profile page
  103. A11y: 0 tokens, 1ms, PASS
  104. Pred: 0 tokens, 0ms, PASS (0% savings)
  105. Step 6: Extract username from profile
  106. A11y: 1433 tokens, 10401ms, PASS
  107. Pred: 480 tokens, 20796ms, PASS (67% savings)
Advertisement
Add Comment
Please, Sign In to add comment