SCC error

Traceback (most recent call last):
  File "all_frame_prediction_fold0.py", line 253, in <module>
    model_ft = model_ft.to(device)
  File "/share/pkg.7/pytorch/1.0/install/3.6/lib/python3.6/site-packages/torch/nn/modules/module.py", line 381, in to
    return self._apply(convert)
  File "/share/pkg.7/pytorch/1.0/install/3.6/lib/python3.6/site-packages/torch/nn/modules/module.py", line 187, in _apply
    module._apply(fn)
  File "/share/pkg.7/pytorch/1.0/install/3.6/lib/python3.6/site-packages/torch/nn/modules/module.py", line 193, in _apply
    param.data = fn(param.data)
  File "/share/pkg.7/pytorch/1.0/install/3.6/lib/python3.6/site-packages/torch/nn/modules/module.py", line 379, in convert
    return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
RuntimeError: CUDA error: all CUDA-capable devices are busy or unavailable