Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- (diffusers) luongngo91@DESKTOP-7MQOI52:~/github/diffusers/examples/dreambooth$ ./launch.sh
- The following values were not passed to `accelerate launch` and had defaults used instead:
- `--num_cpu_threads_per_process` was set to `8` to improve out-of-box performance
- To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
- Fetching 16 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:00<00:00, 5697.81it/s]
- Generating class images: 0%| | 0/3 [00:23<?, ?it/s]
- Traceback (most recent call last):
- File "/home/luongngo91/github/diffusers/examples/dreambooth/train_dreambooth.py", line 637, in <module>
- main()
- File "/home/luongngo91/github/diffusers/examples/dreambooth/train_dreambooth.py", line 380, in main
- images = pipeline(example["prompt"]).images
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
- return func(*args, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py", line 303, in __call__
- noise_pred = self.unet(latent_model_input, t, encoder_hidden_states=text_embeddings).sample
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
- return forward_call(*input, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/unet_2d_condition.py", line 309, in forward
- sample = upsample_block(
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
- return forward_call(*input, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/unet_blocks.py", line 1151, in forward
- hidden_states = attn(hidden_states, context=encoder_hidden_states)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
- return forward_call(*input, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/attention.py", line 154, in forward
- hidden_states = block(hidden_states, context=context)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
- return forward_call(*input, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/attention.py", line 203, in forward
- hidden_states = self.attn1(self.norm1(hidden_states)) + hidden_states
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
- return forward_call(*input, **kwargs)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/attention.py", line 278, in forward
- hidden_states = self._attention(query, key, value)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/diffusers/models/attention.py", line 287, in _attention
- attention_probs = attention_scores.softmax(dim=-1)
- RuntimeError: CUDA out of memory. Tried to allocate 4.00 GiB (GPU 0; 12.00 GiB total capacity; 4.25 GiB already allocated; 1.38 GiB free; 8.24 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
- Traceback (most recent call last):
- File "/home/luongngo91/anaconda3/envs/diffusers/bin/accelerate", line 8, in <module>
- sys.exit(main())
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/accelerate/commands/accelerate_cli.py", line 43, in main
- args.func(args)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/accelerate/commands/launch.py", line 837, in launch_command
- simple_launcher(args)
- File "/home/luongngo91/anaconda3/envs/diffusers/lib/python3.9/site-packages/accelerate/commands/launch.py", line 354, in simple_launcher
- raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
- subprocess.CalledProcessError: Command '['/home/luongngo91/anaconda3/envs/diffusers/bin/python', 'train_dreambooth.py', '--pretrained_model_name_or_path=CompVis/stable-diffusion-v1-4', '--instance_data_dir=training', '--class_data_dir=classes', '--output_dir=model', '--with_prior_preservation', '--prior_loss_weight=1.0', '--instance_prompt=a photo of sks cat', '--class_prompt=a photo of cat', '--seed=1337', '--resolution=512', '--center_crop', '--train_batch_size=1', '--mixed_precision=fp16', '--use_8bit_adam', '--gradient_accumulation_steps=1', '--learning_rate=5e-6', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--num_class_images=12', '--sample_batch_size=4', '--max_train_steps=900', '--gradient_checkpointing']' returned non-zero exit status 1.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement