Advertisement
Guest User

Untitled

a guest
Dec 16th, 2023
46
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.72 KB | None | 0 0
  1. bash-5.1$ ./start_linux.sh --model ./models/llava-v1.5-7b-Q4_K.gguf --multimodal-pipeline llava-v1.5-7b --load-in-4bit --loader Transformers
  2. 2023-12-16 14:35:56 INFO:Loading llava-v1.5-7b-Q4_K.gguf...
  3. Traceback (most recent call last):
  4. File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 729, in _get_config_dict
  5. config_dict = cls._dict_from_json_file(resolved_config_file)
  6. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  7. File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 827, in _dict_from_json_file
  8. text = reader.read()
  9. ^^^^^^^^^^^^^
  10. File "<frozen codecs>", line 322, in decode
  11. UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 295: invalid start byte
  12.  
  13. During handling of the above exception, another exception occurred:
  14.  
  15. Traceback (most recent call last):
  16. File "/home/reg/git_projects/text-generation-webui/server.py", line 234, in <module>
  17. shared.model, shared.tokenizer = load_model(model_name)
  18. ^^^^^^^^^^^^^^^^^^^^^^
  19. File "/home/reg/git_projects/text-generation-webui/modules/models.py", line 89, in load_model
  20. output = load_func_map[loader](model_name)
  21. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  22. File "/home/reg/git_projects/text-generation-webui/modules/models.py", line 147, in huggingface_loader
  23. config = AutoConfig.from_pretrained(path_to_model, trust_remote_code=params['trust_remote_code'])
  24. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  25. File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1082, in from_pretrained
  26. config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
  27. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  28. File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 644, in get_config_dict
  29. config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
  30. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  31. File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 732, in _get_config_dict
  32. raise EnvironmentError(
  33. OSError: It looks like the config file at 'models/llava-v1.5-7b-Q4_K.gguf' is not a valid JSON file.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement