API tools faq
paste
ak36

Plugin computer use logs

ak36
Mar 3rd, 2025
54
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.80 KB | Software | 0 0
raw download clone embed print report
  1. **Docker Logs**:
  2. ```bash
  3. [INFO] Starting noVNC on http://localhost:8080
  4. [INFO] noVNC started successfully
  5. [INFO] Starting Eliza server & client
  6. [INFO] Starting Eliza server on port 3000
  7.  
  8. > eliza@ start /home/computeruse/eliza
  9. > pnpm --filter "@elizaos/agent" start --isRoot
  10.  
  11.  
  12. > @elizaos/[email protected] start /home/computeruse/eliza/agent
  13. > node --loader ts-node/esm src/index.ts "--isRoot"
  14.  
  15. [INFO] Starting Eliza client on port 5173
  16. [INFO] Environment setup complete.
  17. [INFO] noVNC: http://localhost:8080/vnc.html
  18. [INFO] Eliza app: http://localhost:5173
  19. (node:294) ExperimentalWarning: `--experimental-loader` may be removed in the future; instead use `register()`:
  20. --import 'data:text/javascript,import { register } from "node:module"; import { pathToFileURL } from "node:url"; register("ts-node/esm", pathToFileURL("./"));'
  21. (Use `node --trace-warnings ...` to show where the warning was created)
  22. (node:294) [DEP0180] DeprecationWarning: fs.Stats constructor is deprecated.
  23. (Use `node --trace-deprecation ...` to show where the warning was created)`
  24.  
  25. > eliza@ start:client /home/computeruse/eliza
  26. > pnpm --dir client dev "--host=0.0.0.0"
  27.  
  28.  
  29. > client@ dev /home/computeruse/eliza/client
  30. > pnpm run extract-version && vite "--host=0.0.0.0"
  31.  
  32.  
  33. > client@ extract-version /home/computeruse/eliza/client
  34. > bash ./version.sh
  35.  
  36. info.json created with version: 0.25.8
  37. [2025-03-03 17:32:15] INFO: Loading embedding settings:
  38. USE_OPENAI_EMBEDDING: ""
  39. USE_OLLAMA_EMBEDDING: ""
  40. OLLAMA_EMBEDDING_MODEL: "mxbai-embed-large"
  41. (node:294) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
  42. [2025-03-03 17:32:15] INFO: Parsed settings:
  43. USE_OPENAI_EMBEDDING: ""
  44. USE_OPENAI_EMBEDDING_TYPE: "string"
  45. USE_OLLAMA_EMBEDDING: ""
  46. USE_OLLAMA_EMBEDDING_TYPE: "string"
  47. OLLAMA_EMBEDDING_MODEL: "mxbai-embed-large"
  48. [2025-03-03 17:32:17] INFO: Eliza(b850bc30-45f8-0041-a00a-83df46d8555d) - Initializing AgentRuntime with options:
  49. character: "Eliza"
  50. modelProvider: "anthropic"
  51. characterModelProvider: "anthropic"
  52. [2025-03-03 17:32:17] INFO: Eliza(b850bc30-45f8-0041-a00a-83df46d8555d) - Setting Model Provider:
  53. characterModelProvider: "anthropic"
  54. optsModelProvider: "anthropic"
  55. finalSelection: "anthropic"
  56. [2025-03-03 17:32:17] INFO: Eliza(b850bc30-45f8-0041-a00a-83df46d8555d) - Selected model provider: anthropic
  57. [2025-03-03 17:32:17] INFO: Eliza(b850bc30-45f8-0041-a00a-83df46d8555d) - Selected image model provider: anthropic
  58. [2025-03-03 17:32:17] INFO: Eliza(b850bc30-45f8-0041-a00a-83df46d8555d) - Selected image vision model provider: anthropic
  59. [2025-03-03 17:32:17] INFO: Initializing SQLite database at /home/computeruse/eliza/agent/data/db.sqlite...
  60. [2025-03-03 17:32:18] INFO: Using Database Cache...
  61. [2025-03-03 17:32:18] INFO: Run `pnpm start:client` to start the client and visit the outputted URL (http://localhost:5173) to chat with your agents. When running multiple agents, use client with different port `SERVER_PORT=3001 pnpm start:client`
  62.  
  63. VITE v6.1.1 ready in 9327 ms
  64.  
  65. ➜ Local: http://localhost:5173/
  66. ➜ Network: http://192.168.215.2:5173/
  67.  
  68. [2025-03-03 17:33:35] INFO: Generating text with options:
  69. modelProvider: "anthropic"
  70. model: "large"
  71. [2025-03-03 17:33:35] INFO: Selected model: claude-3-5-sonnet-20241022
  72. [2025-03-03 17:33:36] INFO: Anthropic model:
  73. specificationVersion: "v1"
  74. defaultObjectGenerationMode: "tool"
  75. supportsImageUrls: false
  76. modelId: "claude-3-5-sonnet-20241022"
  77. settings: {}
  78. config: {
  79. "provider": "anthropic.messages",
  80. "baseURL": "https://api.anthropic.com/v1"
  81. }
  82. [2025-03-03 17:33:39] INFO: Executing handler for action: NONE
  83. [2025-03-03 17:41:20] INFO: Generating text with options:
  84. modelProvider: "anthropic"
  85. model: "large"
  86. [2025-03-03 17:41:20] INFO: Selected model: claude-3-5-sonnet-20241022
  87. [2025-03-03 17:41:20] INFO: Anthropic model:
  88. specificationVersion: "v1"
  89. defaultObjectGenerationMode: "tool"
  90. supportsImageUrls: false
  91. modelId: "claude-3-5-sonnet-20241022"
  92. settings: {}
  93. config: {
  94. "provider": "anthropic.messages",
  95. "baseURL": "https://api.anthropic.com/v1"
  96. }
  97. [2025-03-03 17:41:24] INFO: Executing handler for action: ANTHROPIC_COMPUTER_USE
  98. [2025-03-03 17:41:24] INFO: [computerUseAction] Starting multi-turn computer use...
  99. [2025-03-03 17:41:24] INFO: [multiTurnComputerUse] New iteration...
  100. [2025-03-03 17:41:28] INFO: [multiTurnComputerUse] =>
  101. id: "msg_01GfMXMh9BNEPtfLPMaQp3xd"
  102. type: "message"
  103. role: "assistant"
  104. model: "claude-3-5-sonnet-20241022"
  105. content: [
  106. {
  107. "type": "text",
  108. "text": "I'll help you open Gmail using Firefox. Let me take a screenshot first to locate the Firefox icon on the desktop."
  109. },
  110. {
  111. "type": "tool_use",
  112. "id": "toolu_01Ar4ScS2vYNKTXRV3XFG3tB",
  113. "name": "computer",
  114. "input": {
  115. "action": "screenshot"
  116. }
  117. }
  118. ]
  119. stop_reason: "tool_use"
  120. stop_sequence: null
  121. usage: {
  122. "input_tokens": 2111,
  123. "cache_creation_input_tokens": 0,
  124. "cache_read_input_tokens": 0,
  125. "output_tokens": 76
  126. }
  127. [2025-03-03 17:41:28] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  128. action: "screenshot"
  129. [2025-03-03 17:41:29] INFO: [multiTurnComputerUse] New iteration...
  130. [2025-03-03 17:41:37] INFO: [multiTurnComputerUse] =>
  131. id: "msg_012CazkaMLFvtXkroKPaimzo"
  132. type: "message"
  133. role: "assistant"
  134. model: "claude-3-5-sonnet-20241022"
  135. content: [
  136. {
  137. "type": "text",
  138. "text": "I can see the Firefox icon. I'll click on it and then navigate to Gmail."
  139. },
  140. {
  141. "type": "tool_use",
  142. "id": "toolu_01KapvLpMFURTb7ALF2PExJb",
  143. "name": "computer",
  144. "input": {
  145. "action": "mouse_move",
  146. "coordinate": [
  147. 804,
  148. 736
  149. ]
  150. }
  151. }
  152. ]
  153. stop_reason: "tool_use"
  154. stop_sequence: null
  155. usage: {
  156. "input_tokens": 7,
  157. "cache_creation_input_tokens": 3241,
  158. "cache_read_input_tokens": 0,
  159. "output_tokens": 95
  160. }
  161. [2025-03-03 17:41:37] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  162. action: "mouse_move"
  163. coordinate: [
  164. 804,
  165. 736
  166. ]
  167. [2025-03-03 17:41:40] INFO: [multiTurnComputerUse] New iteration...
  168. [2025-03-03 17:41:43] INFO: [multiTurnComputerUse] =>
  169. id: "msg_01N5RSyyBBpHXSBh42fuLL1k"
  170. type: "message"
  171. role: "assistant"
  172. model: "claude-3-5-sonnet-20241022"
  173. content: [
  174. {
  175. "type": "tool_use",
  176. "id": "toolu_01Aumv88Wpg6PzyzdgCVYuDK",
  177. "name": "computer",
  178. "input": {
  179. "action": "left_click"
  180. }
  181. }
  182. ]
  183. stop_reason: "tool_use"
  184. stop_sequence: null
  185. usage: {
  186. "input_tokens": 7,
  187. "cache_creation_input_tokens": 1156,
  188. "cache_read_input_tokens": 3241,
  189. "output_tokens": 54
  190. }
  191. [2025-03-03 17:41:43] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  192. action: "left_click"
  193. [2025-03-03 17:41:46] INFO: [multiTurnComputerUse] New iteration...
  194. [GFX1-]: glxtest: libpci missing
  195. [2025-03-03 17:41:48] INFO: [multiTurnComputerUse] =>
  196. id: "msg_013V9bXkUrBFUUpRqZcjecSk"
  197. type: "message"
  198. role: "assistant"
  199. model: "claude-3-5-sonnet-20241022"
  200. content: [
  201. {
  202. "type": "text",
  203. "text": "Now that Firefox is starting up, I'll wait for it to load and then navigate to Gmail."
  204. },
  205. {
  206. "type": "tool_use",
  207. "id": "toolu_01HwprCayyjVfkRw17ykqwpC",
  208. "name": "computer",
  209. "input": {
  210. "action": "screenshot"
  211. }
  212. }
  213. ]
  214. stop_reason: "tool_use"
  215. stop_sequence: null
  216. usage: {
  217. "input_tokens": 7,
  218. "cache_creation_input_tokens": 4476,
  219. "cache_read_input_tokens": 0,
  220. "output_tokens": 73
  221. }
  222. [2025-03-03 17:45:07] INFO: Generating text with options:
  223. modelProvider: "anthropic"
  224. model: "large"
  225. [2025-03-03 17:45:07] INFO: Selected model: claude-3-5-sonnet-20241022
  226. [2025-03-03 17:45:08] INFO: Anthropic model:
  227. specificationVersion: "v1"
  228. defaultObjectGenerationMode: "tool"
  229. supportsImageUrls: false
  230. modelId: "claude-3-5-sonnet-20241022"
  231. settings: {}
  232. config: {
  233. "provider": "anthropic.messages",
  234. "baseURL": "https://api.anthropic.com/v1"
  235. }
  236. [2025-03-03 17:45:12] INFO: Executing handler for action: ANTHROPIC_COMPUTER_USE
  237. [2025-03-03 17:45:12] INFO: [computerUseAction] Starting multi-turn computer use...
  238. [2025-03-03 17:45:12] INFO: [multiTurnComputerUse] New iteration...
  239. [2025-03-03 17:45:15] INFO: [multiTurnComputerUse] =>
  240. id: "msg_01KEU3s6Pam4BVose8YRwGNN"
  241. type: "message"
  242. role: "assistant"
  243. model: "claude-3-5-sonnet-20241022"
  244. content: [
  245. {
  246. "type": "text",
  247. "text": "I'll continue helping you open Gmail. Let me wait for Firefox to fully load and then navigate to Gmail's website."
  248. },
  249. {
  250. "type": "tool_use",
  251. "id": "toolu_01MKn5Rtv9EZFZqFLcjwsBRB",
  252. "name": "computer",
  253. "input": {
  254. "action": "screenshot"
  255. }
  256. }
  257. ]
  258. stop_reason: "tool_use"
  259. stop_sequence: null
  260. usage: {
  261. "input_tokens": 15,
  262. "cache_creation_input_tokens": 0,
  263. "cache_read_input_tokens": 4574,
  264. "output_tokens": 76
  265. }
  266. [2025-03-03 17:45:15] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  267. action: "screenshot"
  268. [2025-03-03 17:45:16] INFO: [multiTurnComputerUse] New iteration...
  269. [2025-03-03 17:45:18] INFO: [multiTurnComputerUse] =>
  270. id: "msg_01X9Hv2QF2ZMCYVDhaTQfiuP"
  271. type: "message"
  272. role: "assistant"
  273. model: "claude-3-5-sonnet-20241022"
  274. content: [
  275. {
  276. "type": "text",
  277. "text": "Now I'll click in the address bar and type Gmail's URL."
  278. },
  279. {
  280. "type": "tool_use",
  281. "id": "toolu_017oamr6u3MtHByWDcg71q9K",
  282. "name": "computer",
  283. "input": {
  284. "action": "mouse_move",
  285. "coordinate": [
  286. 400,
  287. 100
  288. ]
  289. }
  290. }
  291. ]
  292. stop_reason: "tool_use"
  293. stop_sequence: null
  294. usage: {
  295. "input_tokens": 7,
  296. "cache_creation_input_tokens": 2358,
  297. "cache_read_input_tokens": 2325,
  298. "output_tokens": 91
  299. }
  300. [2025-03-03 17:45:18] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  301. action: "mouse_move"
  302. coordinate: [
  303. 400,
  304. 100
  305. ]
  306. [2025-03-03 17:45:21] INFO: [multiTurnComputerUse] New iteration...
  307. [2025-03-03 17:45:24] INFO: [multiTurnComputerUse] =>
  308. id: "msg_01EoG1xiE88gZaiHZNPLW6fP"
  309. type: "message"
  310. role: "assistant"
  311. model: "claude-3-5-sonnet-20241022"
  312. content: [
  313. {
  314. "type": "tool_use",
  315. "id": "toolu_01RiDpur9Zeavi3u2AqH5V39",
  316. "name": "computer",
  317. "input": {
  318. "action": "left_click"
  319. }
  320. }
  321. ]
  322. stop_reason: "tool_use"
  323. stop_sequence: null
  324. usage: {
  325. "input_tokens": 7,
  326. "cache_creation_input_tokens": 2395,
  327. "cache_read_input_tokens": 2404,
  328. "output_tokens": 54
  329. }
  330. [2025-03-03 17:45:24] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  331. action: "left_click"
  332. [2025-03-03 17:45:27] INFO: [multiTurnComputerUse] New iteration...
  333. [2025-03-03 17:45:30] INFO: [multiTurnComputerUse] =>
  334. id: "msg_015SWCcntkHaYFumkjTquixw"
  335. type: "message"
  336. role: "assistant"
  337. model: "claude-3-5-sonnet-20241022"
  338. content: [
  339. {
  340. "type": "tool_use",
  341. "id": "toolu_01ArJwkhnx8o3a4cC3nG2SHJ",
  342. "name": "computer",
  343. "input": {
  344. "action": "type",
  345. "text": "gmail.com"
  346. }
  347. }
  348. ]
  349. stop_reason: "tool_use"
  350. stop_sequence: null
  351. usage: {
  352. "input_tokens": 7,
  353. "cache_creation_input_tokens": 2376,
  354. "cache_read_input_tokens": 2502,
  355. "output_tokens": 71
  356. }
  357. [2025-03-03 17:45:30] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  358. action: "type"
  359. text: "gmail.com"
  360. [2025-03-03 17:45:30] INFO: [multiTurnComputerUse] New iteration...
  361. [2025-03-03 17:45:33] INFO: [multiTurnComputerUse] =>
  362. id: "msg_01NSpRQtcZmtUwnXgCEK2bzj"
  363. type: "message"
  364. role: "assistant"
  365. model: "claude-3-5-sonnet-20241022"
  366. content: [
  367. {
  368. "type": "tool_use",
  369. "id": "toolu_01BqQmBa4Trnaq8hUgxFYXuM",
  370. "name": "computer",
  371. "input": {
  372. "action": "key",
  373. "text": "Return"
  374. }
  375. }
  376. ]
  377. stop_reason: "tool_use"
  378. stop_sequence: null
  379. usage: {
  380. "input_tokens": 7,
  381. "cache_creation_input_tokens": 2363,
  382. "cache_read_input_tokens": 2611,
  383. "output_tokens": 69
  384. }
  385. [2025-03-03 17:45:33] INFO: [multiTurnComputerUse] Running tool 'computer' with input:
  386. action: "key"
  387. text: "Return"
  388. [2025-03-03 17:45:35] INFO: [multiTurnComputerUse] New iteration...
  389. [2025-03-03 17:45:38] INFO: [multiTurnComputerUse] =>
  390. id: "msg_01SCzqdN33U9uBGUux3KCECz"
  391. type: "message"
  392. role: "assistant"
  393. model: "claude-3-5-sonnet-20241022"
  394. content: [
  395. {
  396. "type": "text",
  397. "text": "I've navigated to Gmail. The page is now loading and will show the Gmail sign-in page. Since I'm not allowed to assist with account creation or signing in, I'll stop here. You can now proceed to sign in to your Gmail account if you have one. Let me know if you need anything else!"
  398. }
  399. ]
  400. stop_reason: "end_turn"
  401. stop_sequence: null
  402. usage: {
  403. "input_tokens": 7,
  404. "cache_creation_input_tokens": 2341,
  405. "cache_read_input_tokens": 2727,
  406. "output_tokens": 70
  407. }
  408. [2025-03-03 17:45:38] INFO: [multiTurnComputerUse] No more tool_use => done
  409.  
  410. ```
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!