Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2nd last:
- ```
- 04:33.74 I slot- 0 print_timi | task 1099 | n_decoded = 101, tg = 17.97 t/s, tg_3s = 17.97 t/s
- 04:36.77 I slot- 0 print_timi | task 1099 | n_decoded = 192, tg = 22.19 t/s, tg_3s = 30.01 t/s
- 04:39.86 I slot- 0 print_timi | task 1099 | n_decoded = 274, tg = 23.34 t/s, tg_3s = 26.57 t/s
- 04:42.98 I slot- 0 print_timi | task 1099 | n_decoded = 376, tg = 25.31 t/s, tg_3s = 32.72 t/s
- 04:45.98 I slot- 0 print_timi | task 1099 | n_decoded = 471, tg = 26.37 t/s, tg_3s = 31.57 t/s
- 04:49.04 I slot- 0 print_timi | task 1099 | n_decoded = 560, tg = 26.77 t/s, tg_3s = 29.15 t/s
- 04:52.04 I slot- 0 print_timi | task 1099 | n_decoded = 627, tg = 26.21 t/s, tg_3s = 22.32 t/s
- 04:55.08 I slot- 0 print_timi | task 1099 | n_decoded = 701, tg = 26.00 t/s, tg_3s = 24.35 t/s
- 04:58.12 I slot- 0 print_timi | task 1099 | n_decoded = 772, tg = 25.73 t/s, tg_3s = 23.30 t/s
- 05:01.18 I slot- 0 print_timi | task 1099 | n_decoded = 837, tg = 25.32 t/s, tg_3s = 21.29 t/s
- 05:04.27 I slot- 0 print_timi | task 1099 | n_decoded = 905, tg = 25.04 t/s, tg_3s = 22.01 t/s
- 05:07.37 I slot- 0 print_timi | task 1099 | n_decoded = 983, tg = 25.04 t/s, tg_3s = 25.10 t/s
- 05:10.43 I slot- 0 print_timi | task 1099 | n_decoded = 1054, tg = 24.91 t/s, tg_3s = 23.22 t/s
- 05:13.52 I slot- 0 print_timi | task 1099 | n_decoded = 1144, tg = 25.20 t/s, tg_3s = 29.12 t/s
- 05:16.64 I slot- 0 print_timi | task 1099 | n_decoded = 1229, tg = 25.33 t/s, tg_3s = 27.22 t/s
- 05:19.76 I slot- 0 print_timi | task 1099 | n_decoded = 1303, tg = 25.23 t/s, tg_3s = 23.79 t/s
- 05:22.88 I slot- 0 print_timi | task 1099 | n_decoded = 1413, tg = 25.80 t/s, tg_3s = 35.23 t/s
- 05:25.88 I slot- 0 print_timi | task 1099 | n_decoded = 1497, tg = 25.92 t/s, tg_3s = 27.94 t/s
- 05:28.99 I slot- 0 print_timi | task 1099 | n_decoded = 1595, tg = 26.20 t/s, tg_3s = 31.57 t/s
- 05:32.03 I slot- 0 print_timi | task 1099 | n_decoded = 1670, tg = 26.13 t/s, tg_3s = 24.67 t/s
- 05:35.07 I slot- 0 print_timi | task 1099 | n_decoded = 1774, tg = 26.50 t/s, tg_3s = 34.26 t/s
- 05:38.18 I slot- 0 print_timi | task 1099 | n_decoded = 1892, tg = 27.00 t/s, tg_3s = 37.82 t/s
- 05:41.26 I slot- 0 print_timi | task 1099 | n_decoded = 1966, tg = 26.88 t/s, tg_3s = 24.03 t/s
- 05:44.37 I slot- 0 print_timi | task 1099 | n_decoded = 2150, tg = 28.20 t/s, tg_3s = 59.27 t/s
- 05:47.41 I slot- 0 print_timi | task 1099 | n_decoded = 2348, tg = 29.61 t/s, tg_3s = 65.06 t/s
- 05:50.49 I slot- 0 print_timi | task 1099 | n_decoded = 2551, tg = 30.97 t/s, tg_3s = 65.90 t/s
- 05:50.64 I slot- 0 print_timi | task 1099 | prompt eval time = 1.3 s / 430 tok ( 3.0 ms/tok, 330.2 t/s)
- 05:50.64 I slot- 0 print_timi | task 1099 | eval time = 82.5 s / 2560 tok ( 32.2 ms/tok, 31.0 t/s)
- 05:50.64 I slot- 0 print_timi | task 1099 | total time = 83.8 s / 2990 tok
- 05:50.64 I slot- 0 print_timi | task 1099 | graphs reused = 1549
- 05:50.64 I slot- 0 print_timi | task 1099 | draft acceptance = 22.7% (1979 / 8700 accepted), mean len = 4.4
- 05:50.64 I slot- 0 release | task 1099 | stop processing: n_tokens = 57134, truncated = 0
- ```
- final response:
- ```
- 06:56.19 I slot- 0 print_timi | task 2016 | n_decoded = 102, tg = 20.99 t/s, tg_3s = 20.99 t/s
- 06:59.20 I slot- 0 print_timi | task 2016 | n_decoded = 165, tg = 20.96 t/s, tg_3s = 20.92 t/s
- 07:02.30 I slot- 0 print_timi | task 2016 | n_decoded = 272, tg = 24.80 t/s, tg_3s = 34.53 t/s
- 07:05.31 I slot- 0 print_timi | task 2016 | n_decoded = 339, tg = 24.25 t/s, tg_3s = 22.28 t/s
- 07:08.37 I slot- 0 print_timi | task 2016 | n_decoded = 410, tg = 24.07 t/s, tg_3s = 23.22 t/s
- 07:11.42 I slot- 0 print_timi | task 2016 | n_decoded = 480, tg = 23.90 t/s, tg_3s = 22.95 t/s
- 07:14.44 I slot- 0 print_timi | task 2016 | n_decoded = 620, tg = 26.84 t/s, tg_3s = 46.37 t/s
- 07:17.48 I slot- 0 print_timi | task 2016 | n_decoded = 715, tg = 27.35 t/s, tg_3s = 31.21 t/s
- 07:20.60 I slot- 0 print_timi | task 2016 | n_decoded = 805, tg = 27.50 t/s, tg_3s = 28.80 t/s
- 07:23.70 I slot- 0 print_timi | task 2016 | n_decoded = 898, tg = 27.74 t/s, tg_3s = 30.02 t/s
- 07:26.78 I slot- 0 print_timi | task 2016 | n_decoded = 1003, tg = 28.29 t/s, tg_3s = 34.10 t/s
- 07:29.81 I slot- 0 print_timi | task 2016 | n_decoded = 1057, tg = 27.47 t/s, tg_3s = 17.86 t/s
- 07:32.82 I slot- 0 print_timi | task 2016 | n_decoded = 1126, tg = 27.14 t/s, tg_3s = 22.90 t/s
- 07:35.88 I slot- 0 print_timi | task 2016 | n_decoded = 1253, tg = 28.13 t/s, tg_3s = 41.49 t/s
- 07:38.92 I slot- 0 print_timi | task 2016 | n_decoded = 1366, tg = 28.71 t/s, tg_3s = 37.21 t/s
- 07:41.97 I slot- 0 print_timi | task 2016 | n_decoded = 1501, tg = 29.64 t/s, tg_3s = 44.26 t/s
- 07:45.08 I slot- 0 print_timi | task 2016 | n_decoded = 1555, tg = 28.93 t/s, tg_3s = 17.35 t/s
- 07:48.16 I slot- 0 print_timi | task 2016 | n_decoded = 1610, tg = 28.33 t/s, tg_3s = 17.87 t/s
- 07:48.63 I slot- 0 print_timi | task 2016 | prompt eval time = 1.8 s / 1073 tok ( 1.7 ms/tok, 602.7 t/s)
- 07:48.63 I slot- 0 print_timi | task 2016 | eval time = 57.3 s / 1616 tok ( 35.5 ms/tok, 28.2 t/s)
- 07:48.63 I slot- 0 print_timi | task 2016 | total time = 59.1 s / 2689 tok
- 07:48.63 I slot- 0 print_timi | task 2016 | graphs reused = 2307
- 07:48.63 I slot- 0 print_timi | task 2016 | draft acceptance = 16.1% (1142 / 7110 accepted), mean len = 3.4
- 07:48.64 I slot- 0 release | task 2016 | stop processing: n_tokens = 42150, truncated = 0
- ```
Advertisement
Add Comment
Please, Sign In to add comment
