API tools faq
paste
Guest User

Untitled

a guest
Dec 6th, 2023
127
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 27.30 KB | None | 0 0
raw download clone embed print report
  1. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [WARNING] speculate_subgraph: while introspecting the user-defined autograd.Function, we were unable to trace function `trampoline_autograd_bwd` into a single graph. This means that Dynamo was unable to prove safety for this API and will fall back to eager-mode PyTorch, which could lead to a slowdown.
  2. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] Illegal getattr invocation stride in strict mode
  3. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] Traceback (most recent call last):
  4. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/higher_order_ops.py", line 240, in speculate_subgraph
  5. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] output = f.call_function(tx, args, sub_kwargs)
  6. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 248, in call_function
  7. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return super().call_function(tx, args, kwargs)
  8. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 81, in call_function
  9. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_user_function_return(
  10. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 688, in inline_user_function_return
  11. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)
  12. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  13. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  14. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  15. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  16. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  17. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  18. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  19. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  20. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 470, in wrapper
  21. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return inner_fn(self, inst)
  22. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1252, in CALL_FUNCTION_EX
  23. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.call_function(fn, argsvars.items, kwargsvars.items)
  24. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 652, in call_function
  25. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.push(fn.call_function(self, args, kwargs))
  26. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/misc.py", line 643, in call_function
  27. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return self.obj.call_method(tx, self.name, args, kwargs)
  28. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/misc.py", line 488, in call_method
  29. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_call(tx, backward, args, kwargs)
  30. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  31. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  32. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  33. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  34. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  35. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  36. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  37. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  38. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 470, in wrapper
  39. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return inner_fn(self, inst)
  40. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1213, in CALL_FUNCTION
  41. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.call_function(fn, args, {})
  42. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 652, in call_function
  43. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.push(fn.call_function(self, args, kwargs))
  44. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 248, in call_function
  45. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return super().call_function(tx, args, kwargs)
  46. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 81, in call_function
  47. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_user_function_return(
  48. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 688, in inline_user_function_return
  49. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)
  50. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  51. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  52. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  53. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  54. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  55. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  56. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  57. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  58. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1303, in LOAD_ATTR
  59. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] result = BuiltinVariable(getattr).call_function(
  60. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/builtin.py", line 636, in call_function
  61. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] result = handler(tx, *args, **kwargs)
  62. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/builtin.py", line 1167, in call_getattr
  63. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] return obj.var_getattr(tx, name).clone(source=source)
  64. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/tensor.py", line 218, in var_getattr
  65. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] unimplemented(f"Illegal getattr invocation {name} in strict mode")
  66. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/exc.py", line 193, in unimplemented
  67. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] raise Unsupported(msg)
  68. [2023-12-06 08:23:54,736] [0/0] torch._dynamo.variables.higher_order_ops: [ERROR] torch._dynamo.exc.Unsupported: Illegal getattr invocation stride in strict mode
  69. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [WARNING] speculate_subgraph: while introspecting the user-defined autograd.Function, we were unable to trace function `trampoline_autograd_bwd` into a single graph. This means that Dynamo was unable to prove safety for this API and will fall back to eager-mode PyTorch, which could lead to a slowdown.
  70. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] Illegal getattr invocation stride in strict mode
  71. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] Traceback (most recent call last):
  72. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/higher_order_ops.py", line 240, in speculate_subgraph
  73. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] output = f.call_function(tx, args, sub_kwargs)
  74. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 248, in call_function
  75. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return super().call_function(tx, args, kwargs)
  76. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 81, in call_function
  77. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_user_function_return(
  78. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 688, in inline_user_function_return
  79. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)
  80. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  81. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  82. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  83. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  84. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  85. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  86. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  87. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  88. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 470, in wrapper
  89. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return inner_fn(self, inst)
  90. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1252, in CALL_FUNCTION_EX
  91. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.call_function(fn, argsvars.items, kwargsvars.items)
  92. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 652, in call_function
  93. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.push(fn.call_function(self, args, kwargs))
  94. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/misc.py", line 643, in call_function
  95. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return self.obj.call_method(tx, self.name, args, kwargs)
  96. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/misc.py", line 488, in call_method
  97. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_call(tx, backward, args, kwargs)
  98. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  99. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  100. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  101. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  102. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  103. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  104. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  105. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  106. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 470, in wrapper
  107. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return inner_fn(self, inst)
  108. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1213, in CALL_FUNCTION
  109. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.call_function(fn, args, {})
  110. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 652, in call_function
  111. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] self.push(fn.call_function(self, args, kwargs))
  112. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 248, in call_function
  113. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return super().call_function(tx, args, kwargs)
  114. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py", line 81, in call_function
  115. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return tx.inline_user_function_return(
  116. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 688, in inline_user_function_return
  117. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)
  118. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2256, in inline_call
  119. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return cls.inline_call_(parent, func, args, kwargs)
  120. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 2371, in inline_call_
  121. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] tracer.run()
  122. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 818, in run
  123. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] and self.step()
  124. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 781, in step
  125. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] getattr(self, inst.opname)(inst)
  126. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/symbolic_convert.py", line 1303, in LOAD_ATTR
  127. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] result = BuiltinVariable(getattr).call_function(
  128. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/builtin.py", line 636, in call_function
  129. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] result = handler(tx, *args, **kwargs)
  130. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/builtin.py", line 1167, in call_getattr
  131. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] return obj.var_getattr(tx, name).clone(source=source)
  132. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/variables/tensor.py", line 218, in var_getattr
  133. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] unimplemented(f"Illegal getattr invocation {name} in strict mode")
  134. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/exc.py", line 193, in unimplemented
  135. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] raise Unsupported(msg)
  136. [2023-12-06 08:23:54,794] [1/0] torch._dynamo.variables.higher_order_ops: [ERROR] torch._dynamo.exc.Unsupported: Illegal getattr invocation stride in strict mode
  137. Traceback (most recent call last):
  138. File "/home/robert/rnn_generalization_test/compile_test3.py", line 214, in <module>
  139. print(model(testvec, sel, keys).shape)
  140. File "/home/robert/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
  141. return self._call_impl(*args, **kwargs)
  142. File "/home/robert/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
  143. return forward_call(*args, **kwargs)
  144. File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 489, in _fn
  145. return fn(*args, **kwargs)
  146. File "/home/robert/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
  147. return self._call_impl(*args, **kwargs)
  148. File "/home/robert/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
  149. return forward_call(*args, **kwargs)
  150. File "/home/robert/rnn_generalization_test/compile_test3.py", line 193, in forward
  151. return cvmm(x, sel, w)
  152. File "/home/robert/rnn_generalization_test/compile_test3.py", line 183, in cvmm
  153. return CVMM.apply(x, sel.sel_index, sel.sel, keys, sel.out_index)
  154. File "/home/robert/.local/lib/python3.10/site-packages/torch/autograd/function.py", line 553, in apply
  155. return super().apply(*args, **kwargs) # type: ignore[misc]
  156. File "/home/robert/rnn_generalization_test/compile_test3.py", line 151, in forward
  157. @staticmethod
  158. File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 489, in _fn
  159. return fn(*args, **kwargs)
  160. File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/external_utils.py", line 17, in inner
  161. return fn(*args, **kwargs)
  162. File "/home/robert/.local/lib/python3.10/site-packages/torch/_functorch/aot_autograd.py", line 899, in forward
  163. return compiled_fn(full_args)
  164. File "/home/robert/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/utils.py", line 81, in g
  165. return f(*args)
  166. File "/home/robert/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/runtime_wrappers.py", line 94, in runtime_wrapper
  167. all_outs = call_func_at_runtime_with_args(
  168. File "/home/robert/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/utils.py", line 105, in call_func_at_runtime_with_args
  169. out = normalize_as_list(f(args))
  170. File "/home/robert/.local/lib/python3.10/site-packages/torch/_functorch/_aot_autograd/jit_compile_runtime_wrappers.py", line 118, in rng_functionalization_wrapper
  171. return compiled_fw(args)
  172. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 861, in __call__
  173. return self.get_current_callable()(inputs)
  174. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 611, in run
  175. return model(new_inputs)
  176. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/codecache.py", line 889, in _run_from_cache
  177. return compiled_graph.compiled_artifact(inputs)
  178. File "/tmp/torchinductor_robert/tn/ctnyupo3vtzn2b2r76fgv7nfuc33k6il254ljp3fusnjnu35icz7.py", line 128, in call
  179. cvmm_kernel_0.run(a_ptr=arg0_1, b_ptr=arg1_1, c_ptr=buf0, index_ptr=arg3_1, sel_ptr=arg2_1, out_index_ptr=None, M=64, N=64, K=64, stride_am=64, stride_ak=1, stride_bo=4096, stride_bk=1, stride_bn=64, stride_cm=64, stride_cn=1, stride_index=1, stride_sel=1, stride_out_index=0, float32=False, allow_tf32=False, grid=grid_wrapper_for_cvmm_kernel_0, stream=stream0)
  180. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 533, in run
  181. self.autotune_to_one_config(*args, grid=grid, **kwargs)
  182. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 437, in autotune_to_one_config
  183. timings = self.benchmark_all_configs(*args, **kwargs)
  184. File "/home/robert/.local/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 244, in time_wrapper
  185. r = func(*args, **kwargs)
  186. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 413, in benchmark_all_configs
  187. timings = {
  188. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 414, in <dictcomp>
  189. launcher: self.bench(launcher, *args, **kwargs)
  190. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 385, in bench
  191. return do_bench(kernel_call, rep=40, fast_flush=True)
  192. File "/home/robert/.local/lib/python3.10/site-packages/torch/_inductor/utils.py", line 167, in do_bench
  193. return triton_do_bench(*args, **kwargs)[0]
  194. File "/home/robert/.local/lib/python3.10/site-packages/triton/testing.py", line 105, in do_bench
  195. torch.cuda.synchronize()
  196. File "/home/robert/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 801, in synchronize
  197. return torch._C._cuda_synchronize()
  198. RuntimeError: CUDA error: an illegal memory access was encountered
  199. CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
  200. For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
  201. Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!