Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ======================================================================
- Running with A11Y approach
- ======================================================================
- [2026-02-25 02:23:31] Step 1: Wait for login form hydration
- Waiting for form to hydrate using runtime.check().eventually()...
- Button initially disabled: false
- PASS (12060ms) | Found 19 elements
- [2026-02-25 02:23:43] Step 2: Fill username field
- Snapshot: 45 elements, 1241 tokens
- LLM chose element 37: "Username"
- PASS (7613ms) | Typed "testuser"
- Tokens: prompt=1241 total=1251
- [2026-02-25 02:23:51] Step 3: Fill password field
- LLM chose element 42: "Password"
- Waiting for login button to become enabled...
- PASS (13691ms) | Button enabled: true
- Tokens: prompt=1295 total=1305
- [2026-02-25 02:24:04] Step 4: Click login button
- LLM chose element 47: "Sign in"
- PASS (7909ms) | Navigated to https://www.localllamaland.com/profile
- Tokens: prompt=1367 total=1377
- [2026-02-25 02:24:12] Step 5: Navigate to profile page
- PASS (1ms) | Already on profile page
- [2026-02-25 02:24:12] Step 6: Extract username from profile
- Waiting for profile card to load...
- Found username: [email protected]
- Found email: [email protected]
- PASS (10401ms) | [email protected]
- Tokens: prompt=1433 total=1433
- ======================================================================
- Running with PREDICATE approach
- ======================================================================
- [2026-02-25 02:24:23] Step 1: Wait for login form hydration
- Waiting for form to hydrate using runtime.check().eventually()...
- Button initially disabled: false
- PASS (10792ms) | Found 19 elements
- [2026-02-25 02:24:34] Step 2: Fill username field
- Snapshot: 19 elements, 351 tokens
- LLM chose element 23: "username"
- PASS (12324ms) | Typed "testuser"
- Tokens: prompt=351 total=361
- [2026-02-25 02:24:46] Step 3: Fill password field
- LLM chose element 25: "Password"
- Waiting for login button to become enabled...
- PASS (18410ms) | Button enabled: true
- Tokens: prompt=352 total=362
- [2026-02-25 02:25:04] Step 4: Click login button
- LLM chose element 29: "Sign in"
- PASS (13233ms) | Navigated to https://www.localllamaland.com/profile
- Tokens: prompt=352 total=362
- [2026-02-25 02:25:18] Step 5: Navigate to profile page
- PASS (0ms) | Already on profile page
- [2026-02-25 02:25:18] Step 6: Extract username from profile
- Waiting for profile card to load...
- Found username: [email protected]
- Found email: Profile testuser [email protected]
- PASS (20796ms) | [email protected]
- Tokens: prompt=480 total=480
- ======================================================================
- RESULTS SUMMARY
- ======================================================================
- +-----------------------------------------------------------------------+
- | Metric | A11y Tree | Predicate | Delta |
- +-----------------------------------------------------------------------+
- | Total Tokens | 5366 | 1565 | -71% |
- | Total Latency (ms) | 51675 | 75555 | +46% |
- | Steps Passed | 6/6 | 6/6 | |
- +-----------------------------------------------------------------------+
- Key Insight: Predicate snapshots use 71% fewer tokens
- for a multi-step login workflow with form filling.
- Step-by-step breakdown:
- ----------------------------------------------------------------------
- Step 1: Wait for login form hydration
- A11y: 0 tokens, 12060ms, PASS
- Pred: 0 tokens, 10792ms, PASS (0% savings)
- Step 2: Fill username field
- A11y: 1251 tokens, 7613ms, PASS
- Pred: 361 tokens, 12324ms, PASS (71% savings)
- Step 3: Fill password field
- A11y: 1305 tokens, 13691ms, PASS
- Pred: 362 tokens, 18410ms, PASS (72% savings)
- Step 4: Click login button
- A11y: 1377 tokens, 7909ms, PASS
- Pred: 362 tokens, 13233ms, PASS (74% savings)
- Step 5: Navigate to profile page
- A11y: 0 tokens, 1ms, PASS
- Pred: 0 tokens, 0ms, PASS (0% savings)
- Step 6: Extract username from profile
- A11y: 1433 tokens, 10401ms, PASS
- Pred: 480 tokens, 20796ms, PASS (67% savings)
Advertisement
Add Comment
Please, Sign In to add comment