Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- bash-5.1$ ./start_linux.sh --model ./models/llava-v1.5-7b-Q4_K.gguf --multimodal-pipeline llava-v1.5-7b --load-in-4bit --loader Transformers
- 2023-12-16 14:35:56 INFO:Loading llava-v1.5-7b-Q4_K.gguf...
- Traceback (most recent call last):
- File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 729, in _get_config_dict
- config_dict = cls._dict_from_json_file(resolved_config_file)
- ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 827, in _dict_from_json_file
- text = reader.read()
- ^^^^^^^^^^^^^
- File "<frozen codecs>", line 322, in decode
- UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 295: invalid start byte
- During handling of the above exception, another exception occurred:
- Traceback (most recent call last):
- File "/home/reg/git_projects/text-generation-webui/server.py", line 234, in <module>
- shared.model, shared.tokenizer = load_model(model_name)
- ^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/modules/models.py", line 89, in load_model
- output = load_func_map[loader](model_name)
- ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/modules/models.py", line 147, in huggingface_loader
- config = AutoConfig.from_pretrained(path_to_model, trust_remote_code=params['trust_remote_code'])
- ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1082, in from_pretrained
- config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
- ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 644, in get_config_dict
- config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
- ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- File "/home/reg/git_projects/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/configuration_utils.py", line 732, in _get_config_dict
- raise EnvironmentError(
- OSError: It looks like the config file at 'models/llava-v1.5-7b-Q4_K.gguf' is not a valid JSON file.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement