ERROR with loading the Mistral-7B-Instruct

[vickyiii]

When installing the Mistral-7B-Instruct, the following error comes out, do you know how to resolve it?

[2025-03-25 18:51:16] | ERROR | gaia.interface.util.display | util.py:75 | Error: server.py:79 | launch_llm_server | [WinError 1314] A required privilege is not held by the client: '..\..\blobs\74d6e55c57258bf42fa1eaac75dba280f0b8d7ab' -> 'C:\Users\sonya\.cache\huggingface\hub\models--amd--Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid\snapshots\81af4c309d299525436e906c23e4461ed1c87434\genai_config.json'
2025-03-25 18:51:16,214 gaia.interface.util [WARNING] - Icon file not found at C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\gaia\interface\img\gaia.ico

[vickyiii]

Hi All,

The only model I can load and start the chatbot successfully is the Llama-3.2 3B and Llama-3.2 1B.

The other models can be successfully load and enter into the chat window but still failed with the following error when I throw the first quay to it.

[2025-03-27 11:12:23] | DEBUG | gaia.agents.agent.print_ui | agent.py:192 | Welcome to Chaty! This AI assistant provides clear and technically-sound responses. The system maintains a history of the last 4 conversation turns for contextual awareness. Feel free to reference previous messages in your questions.

What would you like to chat about?
[2025-03-27 11:12:25] | INFO | aiohttp.access.log | web_log.py:214 | 127.0.0.1 [27/Mar/2025:11:12:23 +0800] "POST /welcome HTTP/1.1" 200 112 "-" "Python/3.10 aiohttp/3.11.14"
[2025-03-27 11:12:25] | INFO | gaia.agents.agent.chat_restarted | app.py:58 | Client requested chat to restart
[2025-03-27 11:12:25] | INFO | aiohttp.access.log | web_log.py:214 | 127.0.0.1 [27/Mar/2025:11:12:25 +0800] "POST /restart HTTP/1.1" 200 112 "-" "Python/3.10 aiohttp/3.11.14"
[2025-03-27 11:12:25] | DEBUG | gaia.interface.widget.do_work | widget.py:201 | SetupLLM do_work finished
[2025-03-27 11:12:33] | DEBUG | gaia.agents.Chaty.prompts._match_model_name | prompts.py:234 | Matching model name: amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
[2025-03-27 11:12:33] | ERROR | aiohttp.server.log_exception | web_protocol.py:451 | Error handling request from 127.0.0.1
Traceback (most recent call last):
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\aiohttp\web_protocol.py", line 480, in _handle_request
resp = await request_handler(request)
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\aiohttp\web_app.py", line 569, in _handle
return await handler(request)
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\gaia\agents\agent.py", line 204, in _on_prompt_received
response = self.prompt_received(data["prompt"])
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\gaia\agents\Chaty\app.py", line 41, in prompt_received
response = self.prompt_llm(prompt)
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\gaia\agents\Chaty\app.py", line 31, in prompt_llm
prompt = Prompts.get_system_prompt(
File "C:\Users\sonya\AppData\Local\GAIA\gaia_env\lib\site-packages\gaia\agents\Chaty\prompts.py", line 264, in get_system_prompt
system_message = cls.system_messages[model_type]
KeyError: 'mistral'
[2025-03-27 11:12:33] | INFO | aiohttp.access.log | web_log.py:214 | 127.0.0.1 [27/Mar/2025:11:12:33 +0800] "POST /prompt HTTP/1.1" 500 247 "-" "Python/3.10 aiohttp/3.11.14"

[kovtcharov]

Hi @vickyiii, this should be fixed in the following PR. I tested the latest build and I did not see the issue you are describing:

You can get the latest build with the fix from here (direct link to exe here). Please let me know if it worked for you so I can close the issue.