API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 23rd, 2024
22
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 27.14 KB | None | 0 0
raw download clone embed print report
  1. (base) jungle@macmini transcripts % ragbuilder
  2. [INFO] 2024-08-23 09:11:35 - common.py - USER_AGENT environment variable not set, consider setting it to identify your requests.
  3. [INFO] 2024-08-23 09:11:37 - common.py - USER_AGENT environment variable not set, consider setting it to identify your requests.
  4. [INFO] 2024-08-23 09:11:38 - ragbuilder.py - LOG_FILENAME = /Users/jungle/Documents/transcripts/logs/2024-08-23_09-11-35.log
  5. [INFO] 2024-08-23 09:11:38 - common.py - INFO: Started server process [72362]
  6. [INFO] 2024-08-23 09:11:38 - common.py - INFO: Waiting for application startup.
  7. [INFO] 2024-08-23 09:11:38 - common.py - INFO: Application startup complete.
  8. [INFO] 2024-08-23 09:11:38 - common.py - INFO: Uvicorn running on http://0.0.0.0:8005 (Press CTRL+C to quit)
  9. [INFO] 2024-08-23 09:11:40 - common.py - INFO: 127.0.0.1:53298 - "GET / HTTP/1.1" 200 OK
  10. [INFO] 2024-08-23 09:11:56 - common.py - INFO: 127.0.0.1:53303 - "POST /check_source_data HTTP/1.1" 200 OK
  11. [INFO] 2024-08-23 09:16:04 - common.py - INFO: 127.0.0.1:53309 - "POST /check_source_data HTTP/1.1" 200 OK
  12. [INFO] 2024-08-23 09:16:07 - loader.py - classify_path Invoked
  13. [INFO] 2024-08-23 09:16:07 - common.py - INFO: 127.0.0.1:53309 - "POST /check_test_data HTTP/1.1" 200 OK
  14. [INFO] 2024-08-23 09:18:25 - ragbuilder.py - enable_analytics = True
  15. [INFO] 2024-08-23 09:18:26 - ragbuilder.py - Initiating parsing config: {'description': 'Test5', 'sourceData': '/Users/jungle/tmp', 'compareTemplates': True, 'includeNonTemplated': True, 'chunkingStrategy': {'MarkdownHeaderTextSplitter': True, 'HTMLHeaderTextSplitter': True, 'SemanticChunker': True, 'RecursiveCharacterTextSplitter': True, 'CharacterTextSplitter': True}, 'chunkSize': {'min': 500, 'max': 2000}, 'embeddingModel': {'OpenAI:text-embedding-3-small': False, 'OpenAI:text-embedding-3-large': False, 'OpenAI:text-embedding-ada-002': False, 'HuggingFace': False, 'AzureOAI': False, 'GoogleVertexAI': False, 'Ollama': True}, 'huggingfaceEmbeddingModel': '', 'azureOAIEmbeddingModel': '', 'googleVertexAIEmbeddingModel': '', 'ollamaEmbeddingModel': 'Ollama:mistral-nemo', 'vectorDB': 'chromaDB', 'retriever': {'vectorSimilarity': True, 'vectorMMR': True, 'bm25Retriever': True, 'multiQuery': True, 'parentDocFullDoc': True, 'parentDocLargeChunk': True}, 'topK': {'search_k_5': True, 'search_k_10': False, 'search_k_20': False}, 'contextualCompression': True, 'llm': {'OpenAI:gpt-4o-mini': False, 'OpenAI:gpt-4o': False, 'OpenAI:gpt-3.5-turbo': False, 'OpenAI:gpt-4-turbo': False, 'HuggingFace': False, 'Groq': False, 'AzureOAI': False, 'GoogleVertexAI': False, 'Ollama': True}, 'huggingfaceLLMModel': '', 'groqLLMModel': '', 'azureOAILLMModel': '', 'googleVertexAILLMModel': '', 'ollamaLLMModel': 'Ollama:mistral-nemo', 'generateSyntheticData': True, 'optimization': 'bayesianOptimization', 'evalFramework': 'RAGAS', 'evalEmbedding': 'Ollama:mistral-nemo', 'evalLLM': 'Ollama:mistral-nemo', 'compressors': {'LongContextReorder': True, 'CrossEncoderReranker': True, 'EmbeddingsRedundantFilter': False, 'EmbeddingsClusteringFilter': False, 'LLMChainFilter': False}, 'syntheticDataGeneration': {'testSize': '20', 'criticLLM': 'Ollama:mistral-nemo', 'generatorLLM': 'Ollama:mistral-nemo', 'generatorEmbedding': 'Ollama:mistral-nemo'}, 'testDataPath': None, 'existingSynthDataPath': None, 'testSize': None, 'criticLLM': None, 'generatorLLM': None, 'generatorEmbedding': None, 'numRuns': '50'}
  16. [INFO] 2024-08-23 09:18:26 - ragbuilder.py - Disabled options: ['EmbeddingsRedundantFilter', 'EmbeddingsClusteringFilter', 'LLMChainFilter', 'OpenAI:gpt-4o-mini', 'OpenAI:gpt-4o', 'OpenAI:gpt-3.5-turbo', 'OpenAI:gpt-4-turbo', 'HuggingFace', 'Groq', 'AzureOAI', 'GoogleVertexAI', 'search_k_10', 'search_k_20', 'OpenAI:text-embedding-3-small', 'OpenAI:text-embedding-3-large', 'OpenAI:text-embedding-ada-002', 'HuggingFace', 'AzureOAI', 'GoogleVertexAI']
  17. [INFO] 2024-08-23 09:18:26 - llmConfig.py - LLM Invoked
  18. [INFO] 2024-08-23 09:18:26 - llmConfig.py - LLM Code Gen Invoked: Ollama:mistral-nemo
  19. [INFO] 2024-08-23 09:18:26 - llmConfig.py - LLM Invoked
  20. [INFO] 2024-08-23 09:18:26 - llmConfig.py - LLM Code Gen Invoked: Ollama:mistral-nemo
  21. [INFO] 2024-08-23 09:18:26 - embedding.py - getEmbedding Invoked
  22. [INFO] 2024-08-23 09:18:26 - embedding.py - Ollama Embedding Invoked: Ollama:mistral-nemo
  23. [INFO] 2024-08-23 09:18:26 - generate_data.py - Loading docs...
  24. [INFO] 2024-08-23 09:18:26 - loader.py - ragbuilder_loader Invoked:{'input_path': '/Users/jungle/tmp', 'return_code': False}
  25. [INFO] 2024-08-23 09:18:26 - loader.py - classify_path Invoked
  26. [INFO] 2024-08-23 09:18:26 - loader.py - Source type identified: directory
  27. [INFO] 2024-08-23 09:18:26 - loader.py - ragbuilder_directory_loader_exec Invoked
  28. [INFO] 2024-08-23 09:18:29 - generate_data.py - Completed loading docs
  29. [INFO] 2024-08-23 09:18:29 - generate_data.py - Initiating synthetic data generation...
  30. embedding nodes: 0%| | 0/156 [00:00<?, ?it/s]
  31. embedding nodes: 1%| | 1/156 [00:40<1:44:34, 40.48s/it]
  32. embedding nodes: 1%|1 | 2/156 [00:40<42:58, 16.74s/it]
  33. embedding nodes: 2%|1 | 3/156 [00:49<33:01, 12.95s/it]
  34. embedding nodes: 3%|2 | 4/156 [00:50<21:16, 8.40s/it]
  35. embedding nodes: 3%|3 | 5/156 [00:56<18:51, 7.49s/it]
  36. embedding nodes: 4%|3 | 6/156 [00:56<12:27, 4.99s/it]
  37. embedding nodes: 4%|4 | 7/156 [01:02<13:26, 5.41s/it]
  38. embedding nodes: 5%|5 | 8/156 [01:14<18:05, 7.34s/it]
  39. embedding nodes: 6%|5 | 9/156 [01:20<17:23, 7.10s/it]
  40. embedding nodes: 6%|6 | 10/156 [01:27<17:04, 7.02s/it]
  41. embedding nodes: 7%|7 | 11/156 [01:34<16:59, 7.03s/it]
  42. embedding nodes: 8%|8 | 13/156 [01:41<12:54, 5.42s/it]
  43. embedding nodes: 9%|8 | 14/156 [01:46<12:19, 5.21s/it]
  44. embedding nodes: 10%|9 | 15/156 [02:04<19:56, 8.49s/it]
  45. embedding nodes: 10%|# | 16/156 [02:11<19:01, 8.15s/it]
  46. embedding nodes: 11%|# | 17/156 [02:18<17:59, 7.76s/it]
  47. embedding nodes: 12%|#1 | 18/156 [02:18<12:54, 5.61s/it]
  48. embedding nodes: 12%|#2 | 19/156 [02:24<13:22, 5.86s/it]
  49. embedding nodes: 13%|#2 | 20/156 [02:32<14:15, 6.29s/it]
  50. embedding nodes: 13%|#3 | 21/156 [02:39<14:45, 6.56s/it]
  51. embedding nodes: 14%|#4 | 22/156 [02:59<23:39, 10.59s/it]
  52. embedding nodes: 15%|#4 | 23/156 [03:08<22:07, 9.98s/it]
  53. embedding nodes: 15%|#5 | 24/156 [03:15<20:33, 9.34s/it]
  54. embedding nodes: 16%|#6 | 25/156 [03:15<14:22, 6.58s/it]
  55. embedding nodes: 17%|#6 | 26/156 [03:18<11:19, 5.23s/it]
  56. embedding nodes: 17%|#7 | 27/156 [03:18<08:28, 3.94s/it]
  57. embedding nodes: 18%|#7 | 28/156 [03:33<14:56, 7.01s/it]
  58. embedding nodes: 19%|#8 | 29/156 [03:39<14:30, 6.85s/it]
  59. embedding nodes: 19%|#9 | 30/156 [03:43<12:38, 6.02s/it]
  60. embedding nodes: 20%|#9 | 31/156 [03:50<13:05, 6.28s/it]
  61. embedding nodes: 21%|## | 32/156 [03:56<12:31, 6.06s/it]
  62. embedding nodes: 21%|##1 | 33/156 [04:15<20:27, 9.98s/it]
  63. embedding nodes: 22%|##1 | 34/156 [04:15<14:22, 7.07s/it]
  64. embedding nodes: 22%|##2 | 35/156 [04:15<10:07, 5.02s/it]
  65. embedding nodes: 23%|##3 | 36/156 [04:44<23:58, 11.99s/it]
  66. embedding nodes: 24%|##3 | 37/156 [04:50<20:26, 10.31s/it]
  67. embedding nodes: 24%|##4 | 38/156 [04:57<18:06, 9.21s/it]
  68. embedding nodes: 25%|##5 | 39/156 [05:03<16:35, 8.51s/it]
  69. embedding nodes: 26%|##5 | 40/156 [05:15<18:27, 9.54s/it]
  70. embedding nodes: 26%|##6 | 41/156 [05:16<12:52, 6.72s/it]
  71. embedding nodes: 27%|##6 | 42/156 [05:22<12:54, 6.79s/it]
  72. embedding nodes: 28%|##7 | 43/156 [05:29<12:42, 6.74s/it]
  73. embedding nodes: 28%|##8 | 44/156 [05:46<18:16, 9.79s/it]
  74. embedding nodes: 29%|##8 | 45/156 [05:56<18:27, 9.98s/it]
  75. embedding nodes: 29%|##9 | 46/156 [05:57<12:52, 7.03s/it]
  76. embedding nodes: 30%|### | 47/156 [06:03<12:25, 6.84s/it]
  77. embedding nodes: 31%|### | 48/156 [06:10<12:30, 6.95s/it]
  78. embedding nodes: 31%|###1 | 49/156 [06:16<11:33, 6.49s/it]
  79. embedding nodes: 32%|###2 | 50/156 [06:18<09:07, 5.17s/it]
  80. embedding nodes: 33%|###2 | 51/156 [06:24<09:42, 5.55s/it]
  81. embedding nodes: 33%|###3 | 52/156 [06:43<16:27, 9.49s/it]
  82. embedding nodes: 34%|###3 | 53/156 [06:50<15:19, 8.93s/it]
  83. embedding nodes: 35%|###4 | 54/156 [07:01<15:52, 9.34s/it]
  84. embedding nodes: 36%|###5 | 56/156 [07:08<11:14, 6.74s/it]
  85. embedding nodes: 37%|###6 | 57/156 [07:16<11:24, 6.91s/it]
  86. embedding nodes: 37%|###7 | 58/156 [07:18<09:30, 5.82s/it]
  87. embedding nodes: 38%|###7 | 59/156 [07:26<10:02, 6.21s/it]
  88. embedding nodes: 38%|###8 | 60/156 [07:33<10:20, 6.47s/it]
  89. embedding nodes: 39%|###9 | 61/156 [07:42<11:20, 7.16s/it]
  90. embedding nodes: 40%|###9 | 62/156 [07:52<12:39, 8.08s/it]
  91. embedding nodes: 40%|#### | 63/156 [07:56<10:37, 6.86s/it]
  92. embedding nodes: 41%|####1 | 64/156 [08:05<11:35, 7.56s/it]
  93. embedding nodes: 42%|####1 | 65/156 [08:13<11:44, 7.74s/it]
  94. embedding nodes: 42%|####2 | 66/156 [08:20<11:09, 7.44s/it]
  95. embedding nodes: 43%|####2 | 67/156 [08:27<10:55, 7.36s/it]
  96. embedding nodes: 44%|####3 | 68/156 [08:27<07:39, 5.23s/it]
  97. embedding nodes: 44%|####4 | 69/156 [08:29<06:12, 4.29s/it]
  98. embedding nodes: 45%|####4 | 70/156 [08:36<07:12, 5.03s/it]
  99. embedding nodes: 46%|####5 | 71/156 [08:43<07:56, 5.60s/it]
  100. embedding nodes: 46%|####6 | 72/156 [09:03<13:50, 9.89s/it]
  101. embedding nodes: 47%|####6 | 73/156 [09:11<12:59, 9.40s/it]
  102. embedding nodes: 47%|####7 | 74/156 [09:15<10:19, 7.55s/it]
  103. embedding nodes: 48%|####8 | 75/156 [09:25<11:22, 8.43s/it]
  104. embedding nodes: 49%|####8 | 76/156 [09:27<08:32, 6.40s/it]
  105. embedding nodes: 49%|####9 | 77/156 [09:27<05:57, 4.53s/it]
  106. embedding nodes: 50%|##### | 78/156 [09:34<06:46, 5.21s/it]
  107. embedding nodes: 51%|##### | 79/156 [09:41<07:39, 5.97s/it]
  108. embedding nodes: 51%|#####1 | 80/156 [09:48<07:46, 6.14s/it]
  109. embedding nodes: 53%|#####2 | 82/156 [10:05<08:57, 7.26s/it]
  110. embedding nodes: 53%|#####3 | 83/156 [10:15<09:44, 8.01s/it]
  111. embedding nodes: 54%|#####3 | 84/156 [10:25<10:05, 8.41s/it]
  112. embedding nodes: 54%|#####4 | 85/156 [10:33<09:45, 8.24s/it]
  113. embedding nodes: 55%|#####5 | 86/156 [10:40<09:15, 7.93s/it]
  114. embedding nodes: 56%|#####5 | 87/156 [10:40<06:33, 5.70s/it]
  115. embedding nodes: 56%|#####6 | 88/156 [10:47<06:55, 6.11s/it]
  116. embedding nodes: 57%|#####7 | 89/156 [10:53<06:44, 6.03s/it]
  117. embedding nodes: 58%|#####7 | 90/156 [11:00<06:59, 6.36s/it]
  118. embedding nodes: 58%|#####8 | 91/156 [11:06<06:38, 6.13s/it]
  119. embedding nodes: 59%|#####8 | 92/156 [11:26<11:00, 10.32s/it]
  120. embedding nodes: 60%|#####9 | 93/156 [11:33<09:51, 9.39s/it]
  121. embedding nodes: 60%|###### | 94/156 [11:41<09:24, 9.10s/it]
  122. embedding nodes: 61%|###### | 95/156 [11:51<09:15, 9.10s/it]
  123. embedding nodes: 62%|######1 | 96/156 [11:58<08:34, 8.58s/it]
  124. embedding nodes: 62%|######2 | 97/156 [12:02<07:01, 7.14s/it]
  125. embedding nodes: 63%|######2 | 98/156 [12:09<06:58, 7.21s/it]
  126. embedding nodes: 64%|######4 | 100/156 [12:17<05:18, 5.69s/it]
  127. embedding nodes: 65%|######4 | 101/156 [12:20<04:34, 4.99s/it]
  128. embedding nodes: 65%|######5 | 102/156 [12:34<06:42, 7.46s/it]
  129. embedding nodes: 66%|######6 | 103/156 [12:42<06:39, 7.54s/it]
  130. embedding nodes: 67%|######6 | 104/156 [12:54<07:32, 8.71s/it]
  131. embedding nodes: 67%|######7 | 105/156 [12:58<06:19, 7.45s/it]
  132. embedding nodes: 68%|######7 | 106/156 [13:05<06:11, 7.43s/it]
  133. embedding nodes: 69%|######8 | 107/156 [13:06<04:21, 5.33s/it]
  134. embedding nodes: 69%|######9 | 108/156 [13:13<04:41, 5.86s/it]
  135. embedding nodes: 70%|######9 | 109/156 [13:20<04:51, 6.20s/it]
  136. embedding nodes: 71%|####### | 110/156 [13:26<04:51, 6.35s/it]
  137. embedding nodes: 71%|#######1 | 111/156 [13:46<07:46, 10.37s/it]
  138. embedding nodes: 72%|#######1 | 112/156 [13:56<07:26, 10.15s/it]
  139. embedding nodes: 72%|#######2 | 113/156 [14:03<06:37, 9.25s/it]
  140. embedding nodes: 73%|#######3 | 114/156 [14:10<06:01, 8.62s/it]
  141. embedding nodes: 74%|#######3 | 115/156 [14:18<05:42, 8.36s/it]
  142. embedding nodes: 74%|#######4 | 116/156 [14:22<04:37, 6.94s/it]
  143. embedding nodes: 75%|#######5 | 117/156 [14:29<04:37, 7.11s/it]
  144. embedding nodes: 76%|#######5 | 118/156 [14:29<03:12, 5.06s/it]
  145. embedding nodes: 76%|#######6 | 119/156 [14:46<05:20, 8.66s/it]
  146. embedding nodes: 77%|#######6 | 120/156 [14:51<04:32, 7.56s/it]
  147. embedding nodes: 78%|#######7 | 121/156 [15:03<05:08, 8.82s/it]
  148. embedding nodes: 78%|#######8 | 122/156 [15:07<04:11, 7.40s/it]
  149. embedding nodes: 79%|#######9 | 124/156 [15:15<03:04, 5.75s/it]
  150. embedding nodes: 80%|######## | 125/156 [15:22<03:07, 6.06s/it]
  151. embedding nodes: 81%|######## | 126/156 [15:34<03:53, 7.77s/it]
  152. embedding nodes: 81%|########1 | 127/156 [15:44<03:59, 8.25s/it]
  153. embedding nodes: 82%|########2 | 128/156 [15:54<04:05, 8.78s/it]
  154. embedding nodes: 83%|########2 | 129/156 [16:04<04:01, 8.94s/it]
  155. embedding nodes: 83%|########3 | 130/156 [16:11<03:43, 8.60s/it]
  156. embedding nodes: 84%|########3 | 131/156 [16:11<02:33, 6.12s/it]
  157. embedding nodes: 85%|########4 | 132/156 [16:19<02:38, 6.61s/it]
  158. embedding nodes: 85%|########5 | 133/156 [16:26<02:34, 6.70s/it]
  159. embedding nodes: 86%|########5 | 134/156 [16:29<02:00, 5.48s/it]
  160. embedding nodes: 87%|########6 | 135/156 [16:47<03:17, 9.41s/it]
  161. embedding nodes: 87%|########7 | 136/156 [16:50<02:26, 7.34s/it]
  162. embedding nodes: 88%|########7 | 137/156 [16:51<01:43, 5.44s/it]
  163. embedding nodes: 88%|########8 | 138/156 [16:52<01:14, 4.15s/it]
  164. embedding nodes: 89%|########9 | 139/156 [17:10<02:18, 8.17s/it]
  165. embedding nodes: 90%|########9 | 140/156 [17:16<02:00, 7.52s/it]
  166. embedding nodes: 90%|######### | 141/156 [17:22<01:48, 7.21s/it]
  167. embedding nodes: 91%|#########1| 142/156 [17:24<01:18, 5.61s/it]
  168. embedding nodes: 92%|#########1| 143/156 [17:26<00:58, 4.52s/it]
  169. embedding nodes: 92%|#########2| 144/156 [18:01<02:45, 13.78s/it]
  170. embedding nodes: 93%|#########2| 145/156 [18:08<02:08, 11.66s/it]
  171. embedding nodes: 94%|#########3| 146/156 [18:11<01:31, 9.11s/it]
  172. embedding nodes: 96%|#########5| 149/156 [18:18<00:36, 5.27s/it]
  173. embedding nodes: 96%|#########6| 150/156 [18:25<00:33, 5.66s/it]
  174. embedding nodes: 97%|#########6| 151/156 [18:26<00:22, 4.55s/it]
  175. embedding nodes: 97%|#########7| 152/156 [18:58<00:45, 11.29s/it]
  176. embedding nodes: 99%|#########8| 154/156 [19:04<00:15, 7.96s/it]
  177. embedding nodes: 100%|##########| 156/156 [19:05<00:00, 5.13s/it]
  178. Generating: 0%| | 0/20 [00:00<?, ?it/s]
  179. Generating: 5%|5 | 1/20 [08:58<2:50:38, 538.85s/it]
  180. Generating: 10%|# | 2/20 [17:30<2:36:52, 522.92s/it]
  181. Generating: 15%|#5 | 3/20 [36:01<3:44:12, 791.31s/it]
  182. Generating: 20%|## | 4/20 [40:54<2:38:33, 594.61s/it]
  183. Generating: 25%|##5 | 5/20 [54:00<2:45:54, 663.62s/it]
  184. Generating: 30%|### | 6/20 [1:01:04<2:15:49, 582.14s/it]
  185. Generating: 35%|###5 | 7/20 [1:18:43<2:39:56, 738.22s/it]
  186. Generating: 40%|#### | 8/20 [1:24:09<2:01:23, 606.96s/it]
  187. Generating: 40%|#### | 8/20 [1:24:52<2:07:18, 636.54s/it]
  188. [INFO] 2024-08-23 11:02:27 - common.py - Exception in thread Thread-4:
  189. [INFO] 2024-08-23 11:02:27 - common.py - Traceback (most recent call last):
  190. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
  191. [INFO] 2024-08-23 11:02:27 - common.py - self.run()
  192. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/executor.py", line 96, in run
  193. [INFO] 2024-08-23 11:02:27 - common.py - results = self.loop.run_until_complete(self._aresults())
  194. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  195. [INFO] 2024-08-23 11:02:27 - common.py - File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
  196. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/executor.py", line 84, in _aresults
  197. [INFO] 2024-08-23 11:02:27 - common.py - raise e
  198. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/executor.py", line 79, in _aresults
  199. [INFO] 2024-08-23 11:02:27 - common.py - r = await future
  200. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^
  201. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/asyncio/tasks.py", line 605, in _wait_for_one
  202. [INFO] 2024-08-23 11:02:27 - common.py - return f.result() # May raise f.exception().
  203. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^
  204. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/executor.py", line 38, in sema_coro
  205. [INFO] 2024-08-23 11:02:27 - common.py - return await coro
  206. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^
  207. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/executor.py", line 112, in wrapped_callable_async
  208. [INFO] 2024-08-23 11:02:27 - common.py - return counter, await callable(*args, **kwargs)
  209. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  210. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/evolutions.py", line 142, in evolve
  211. [INFO] 2024-08-23 11:02:27 - common.py - ) = await self._aevolve(current_tries, current_nodes)
  212. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  213. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/evolutions.py", line 460, in _aevolve
  214. [INFO] 2024-08-23 11:02:27 - common.py - simple_question, current_nodes, _ = await self.se._aevolve(
  215. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^
  216. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/evolutions.py", line 290, in _aevolve
  217. [INFO] 2024-08-23 11:02:27 - common.py - passed = await self.node_filter.filter(merged_node)
  218. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  219. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/filters.py", line 60, in filter
  220. [INFO] 2024-08-23 11:02:27 - common.py - output["score"] = sum(output.values()) / len(output.values())
  221. [INFO] 2024-08-23 11:02:27 - common.py - ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~
  222. [INFO] 2024-08-23 11:02:27 - common.py - ZeroDivisionError: division by zero
  223. [ERROR] 2024-08-23 11:02:27 - ragbuilder.py - Synthetic test data generation failed: The runner thread which was running the jobs raised an exeception. Read the traceback above to debug it. You can also pass `raise_exceptions=False` incase you want to show only a warning message instead.
  224. [INFO] 2024-08-23 11:02:27 - common.py - INFO: 127.0.0.1:53310 - "POST /rbuilder HTTP/1.1" 500 Internal Server Error
  225. [INFO] 2024-08-23 11:02:27 - common.py - ERROR: Exception in ASGI application
  226. [INFO] 2024-08-23 11:02:27 - common.py - Traceback (most recent call last):
  227. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi
  228. [INFO] 2024-08-23 11:02:27 - common.py - result = await app( # type: ignore[func-returns-value]
  229. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  230. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
  231. [INFO] 2024-08-23 11:02:27 - common.py - return await self.app(scope, receive, send)
  232. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  233. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
  234. [INFO] 2024-08-23 11:02:27 - common.py - await super().__call__(scope, receive, send)
  235. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__
  236. [INFO] 2024-08-23 11:02:27 - common.py - await self.middleware_stack(scope, receive, send)
  237. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__
  238. [INFO] 2024-08-23 11:02:27 - common.py - raise exc
  239. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__
  240. [INFO] 2024-08-23 11:02:27 - common.py - await self.app(scope, receive, _send)
  241. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in __call__
  242. [INFO] 2024-08-23 11:02:27 - common.py - await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  243. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  244. [INFO] 2024-08-23 11:02:27 - common.py - raise exc
  245. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  246. [INFO] 2024-08-23 11:02:27 - common.py - await app(scope, receive, sender)
  247. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/routing.py", line 756, in __call__
  248. [INFO] 2024-08-23 11:02:27 - common.py - await self.middleware_stack(scope, receive, send)
  249. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
  250. [INFO] 2024-08-23 11:02:27 - common.py - await route.handle(scope, receive, send)
  251. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle
  252. [INFO] 2024-08-23 11:02:27 - common.py - await self.app(scope, receive, send)
  253. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
  254. [INFO] 2024-08-23 11:02:27 - common.py - await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  255. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  256. [INFO] 2024-08-23 11:02:27 - common.py - raise exc
  257. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  258. [INFO] 2024-08-23 11:02:27 - common.py - await app(scope, receive, sender)
  259. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/routing.py", line 72, in app
  260. [INFO] 2024-08-23 11:02:27 - common.py - response = await func(request)
  261. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^
  262. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
  263. [INFO] 2024-08-23 11:02:27 - common.py - raw_response = await run_endpoint_function(
  264. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  265. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
  266. [INFO] 2024-08-23 11:02:27 - common.py - return await run_in_threadpool(dependant.call, **values)
  267. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  268. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
  269. [INFO] 2024-08-23 11:02:27 - common.py - return await anyio.to_thread.run_sync(func, *args)
  270. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  271. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
  272. [INFO] 2024-08-23 11:02:27 - common.py - return await get_async_backend().run_sync_in_worker_thread(
  273. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  274. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
  275. [INFO] 2024-08-23 11:02:27 - common.py - return await future
  276. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^
  277. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 851, in run
  278. [INFO] 2024-08-23 11:02:27 - common.py - result = context.run(func, *args)
  279. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^
  280. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragbuilder/ragbuilder.py", line 314, in rbuilder_route
  281. [INFO] 2024-08-23 11:02:27 - common.py - result = parse_config(project_data.model_dump(), db)
  282. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  283. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragbuilder/ragbuilder.py", line 420, in parse_config
  284. [INFO] 2024-08-23 11:02:27 - common.py - f_name=generate_data.generate_data(
  285. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  286. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragbuilder/generate_data.py", line 94, in generate_data
  287. [INFO] 2024-08-23 11:02:27 - common.py - testset = generator.generate_with_langchain_docs(
  288. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  289. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/generator.py", line 179, in generate_with_langchain_docs
  290. [INFO] 2024-08-23 11:02:27 - common.py - return self.generate(
  291. [INFO] 2024-08-23 11:02:27 - common.py - ^^^^^^^^^^^^^^
  292. [INFO] 2024-08-23 11:02:27 - common.py - File "/Users/jungle/miniconda3/lib/python3.11/site-packages/ragas/testset/generator.py", line 274, in generate
  293. [INFO] 2024-08-23 11:02:27 - common.py - raise ExceptionInRunner()
  294. [INFO] 2024-08-23 11:02:27 - common.py - ragas.exceptions.ExceptionInRunner: The runner thread which was running the jobs raised an exeception. Read the traceback above to debug it. You can also pass `raise_exceptions=False` incase you want to show only a warning message instead.
  295.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!