Tried all afternoon to get this working.
Stuck here. When I launch the main.py I get this. Any ideas ?
Starting Note Taker
Traceback (most recent call last):
File "C:\Program Files\LocaalNoteTaker\note-taker\src\main.py", line 15, in <module>
LanguageModel() # Warm up the LLM
^^^^^^^^^^^^^^^
File "C:\Program Files\LocaalNoteTaker\note-taker\src\llm\model.py", line 31, in __init__
self.set_model(None)
File "C:\Program Files\LocaalNoteTaker\note-taker\src\llm\model.py", line 39, in set_model
self.llm = Llama.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\JdotCarver\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llama.py", line 2353, in from_pretrained
return cls(
^^^^
File "C:\Users\JdotCarver\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llama.py", line 369, in __init__
internals.LlamaModel(
File "C:\Users\JdotCarver\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\_internals.py", line 51, in __init__
model = llama_cpp.llama_load_model_from_file(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: exception: access violation reading 0x0000000000000078
Tried all afternoon to get this working.
Stuck here. When I launch the main.py I get this. Any ideas ?