Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LM Studio can't fetch models or extensions anymore after a while, only system restart helps (macOS) #115

Open
newsve opened this issue Sep 8, 2024 · 47 comments

Comments

@newsve
Copy link

newsve commented Sep 8, 2024

Not sure where to post else, feel free to move this to the right loc.

After a while, I am not sure how long this needs, and if the system sleeping might cause this issue but it happened a few times. LM Studio won't fetch anything anymore, no search results in models or extension and hence no download of aforementioned.

I tried to rm .cache/ and/or to restart the app. I need to restart entire macOS. This is super annooying.

One thing I've noted: When I start LM Studio in such a state, it takes forever to launch and a fraction of a second some error appears on the loading logo with a red button but then disappears again and LM Studio launches.

@yagil yagil transferred this issue from lmstudio-ai/lmstudio.js Sep 8, 2024
@yagil
Copy link
Member

yagil commented Sep 8, 2024

Hi @newsve thanks for the bug report. To allow us to understand the issue better please share the following:

  1. Which version of LM Studio?
  2. Which version of macOS?
  3. Can you please attach screenshots from when this issue happens?

Generally you should probably avoid deleting the whole .cache/ folder because other things on your system might be using it. You can delete .cache/lm-studio but know this will delete your downloaded LLMs, any conversations, and any configurations you have saved

@newsve
Copy link
Author

newsve commented Sep 16, 2024

macOS 14.6.1, lm studio 0.3.2, here happens all the time or always when lm studio has been running for quite some time, so when the MacBook has been sleeping here and there. Re deleting .cache/lmstudo, not a big fan of either b/c all the things you mentioned and did it only once or twice to test if it impact anything which it doesn't. you need to reboot macos at the end to get lm studio working, this is really a dealbreaker

if you need more info pls let me know

edit: fwiw, i use that macbook exclusively for llms, so it's pretty pristine in terms of installed stuff, maybe there's chrome, vs code, text-generationl-webui and xcode but nothing else is installed, i do usually work on other machines, so it's prob not my macbook

here the screenshots as demanded:

first you see this for some seconds
Screenshot 2024-09-16 at 08 39 15

then this:
Screenshot 2024-09-16 at 08 36 24

@neolee
Copy link

neolee commented Sep 20, 2024

Same problem here.

@gorexlv
Copy link

gorexlv commented Oct 19, 2024

Same problem... is there any progress?

@gzheleza
Copy link

gzheleza commented Oct 24, 2024

+1 Ver. 0.3.5 Build 2 OS Win 11
image

@yagil
Copy link
Member

yagil commented Oct 24, 2024

For folks commenting, please include a screenshot of your app showing what you see

@garyohanlon76
Copy link

Same here but in windows version I'm on 0.3.4, but this has been happening for a few months on previous builds. after a fresh boot I can do a few searches/downloads, I come back to it later and can no longer search, circa 12 seconds after attempt gives the error shown on the screenshot. otherwise the application functions as normal.

I have stopped everything can on startup, checked windows defender settings, but not gone much further with diagnosis. I just work around it.

There is one thing that is odd, I use anythingllm and I have found that if I can't search on LMStudio then I can't use the Gemini API's in anythingllm (other apis work fine). This has been tested a few times, and I don't often have these applications open together. I't may be entirely coincidence. so I'll do a few more tests.

image

@yagil
Copy link
Member

yagil commented Oct 26, 2024

Hi @garyohanlon76 can you please give it a try with our latest beta? 0.3.5 Build 3, available here https://lmstudio.ai/beta-releases

@garyohanlon76
Copy link

@yagil installed beta and able to search, will monitor.

@SpiesInOrbit
Copy link

@yagil Trying 0.3.5 Build 4, and still getting empty model search.

@b0nce
Copy link

b0nce commented Dec 2, 2024

@yagil trying 0.3.5 Build 8, same result
grafik

@Javyr007
Copy link

Javyr007 commented Dec 4, 2024

I have this same error on version 0.3.5 . Has there been any update?
Screenshot 2024-12-03 170946

@OliviaXu0715
Copy link

@yagil mac M series 0.3.5 same fetch failed
Screenshot 2024-12-04 at 3 39 06 PM

@OliviaXu0715
Copy link

@yagil mac M series 0.3.5 same fetch failed Screenshot 2024-12-04 at 3 39 06 PM

For me, it's because of work laptop Netskope banned, reach out to Netskope support issue has been solved.

@neocybereth
Copy link

Screenshot 2025-01-08 at 12 22 53 PM

Same.

MacOS version 0.3.6

@yagil
Copy link
Member

yagil commented Jan 7, 2025

@neolee you're actually running into a different issue.

We think this happens when you run the app from the .dmg window and not from /Applications the first time you run it.

Here's how to solve it (Mac only):

  1. close LM Studio, make sure it's not running from the tray either
  2. remove it from /Applications on your Mac (i.e. uninstall it)
  3. run one of the following commands in your Terminal

If this is the first time you installed LM Studio

rm -rf ~/.lmstudio/extensions

If you've updated LM Studio

rm -rf ~/.cache/lm-studio/extensions
  1. Reinstall the app from the installer you downloaded by dragging it into the /Applications folder
  2. Open it from the /Applications folder <------ very important

@neocybereth
Copy link

woohoo! that worked for me, thank you @yagil!

@santakd
Copy link

santakd commented Jan 14, 2025

LM Studio: 0.3.6
MacOS: 15.2 (24C101)
CPU: M2 Pro

Got the error: Model details error: Fetch failed

Tried the steps in #115 (comment)

Still getting the error: Model details error: Fetch failed

@stevillis
Copy link

stevillis commented Jan 21, 2025

LM Studio 0.3.7
Windows 11 24H2 26100.2894
CPU: Intel(R) Core(TM) i7-10750H

It doesn't matter what I search, I always get 0 results in the Model Search.

I tried to delete the .lm-studio folder and every folder related to Lm Studio in AppData, but the problem is still occurring after reinstall.

@yagil
Copy link
Member

yagil commented Jan 21, 2025

LM Studio 0.3.7 Windows 11 24H2 26100.2894 CPU: Intel(R) Core(TM) i7-10750H

It doesn't matter what I search, I always get 0 results in the Model Search.

I tried to delete the .lm-studio folder and every folder related to Lm Studio in AppData, but the problem is still occurring after reinstall.

Can you please try to download and install 0.3.8 from lmstudio.ai? We just published it and think it'll fix it

@stevillis
Copy link

LM Studio 0.3.7 Windows 11 24H2 26100.2894 CPU: Intel(R) Core(TM) i7-10750H
It doesn't matter what I search, I always get 0 results in the Model Search.
I tried to delete the .lm-studio folder and every folder related to Lm Studio in AppData, but the problem is still occurring after reinstall.

Can you please try to download and install 0.3.8 from lmstudio.ai? We just published it and think it'll fix it

I installed version 0.3.8 and it worked. Thanks @yagil!

@guiiids
Copy link

guiiids commented Jan 22, 2025

I updated it to 0.3.8 and still cannot search for models. I am using a Windows 11 Pro [OS Name Microsoft Windows 11 Pro for Workstations}

Image

One unusual issue I've noticed is that in the Hardware section, no GPU is detected. However, the System Information tool does detect the GPU correctly. I also used NVIDIA's application, and the GPU is recognized there as well.

Image

Image

Image

I've attached an image for reference to help illustrate the problem.

@santakd
Copy link

santakd commented Jan 22, 2025

Updated form 0.3.6 to 0.3.8 still cannot search and download the models
On Mac, M2 Pro, Sequoia 15.2

@xiayu87
Copy link

xiayu87 commented Jan 23, 2025

For MacOS, open terminal and enter following:

cd /Applications/LM\ Studio.app/Contents

Then search for files with records of huggingface.co as following:

grep -r -i -l "huggingface.co" *

Replace huggingface.co with hf-mirror.com in each of following files:

Resources/app/.webpack/renderer/main_window.js Resources/app/.webpack/renderer/main_window.js.map Resources/app/.webpack/lms Resources/app/.webpack/main/index.js

@santakd
Copy link

santakd commented Jan 23, 2025

Thank you xiayu87
Is there a command I can use to replace the string from the terminal window for these four files?

@MarslMarcello
Copy link

@santakd I had the same issue and have solved it with the following way.

  1. remove the old app version
  2. copy 0.38 to /Applications
  3. open terminal
  4. move to /Applications
  5. open -n ./"LM Studio.app"

After that, I got back all functions and were able to search and load models too.

When I tried to open the new version just via Finder in the Applications folder to open it by clicking, I still ended up with the issue as you described. The only extra step I did, to be sure, I deleted the ".cache" folder for LMStudio as well, but not sure if this is/was really necessary.
I hope it helps somehow.

@maheshrijal
Copy link

Alright! This fixed it for me. I can search and download models now.

#115 (comment)

@guiiids
Copy link

guiiids commented Jan 28, 2025

Running 15.2 (24C101)
None of the suggestions here worked, so I uninstalled it from my machine, then went to LM Studio site, downloaded a fresh copy and it worked.

Ps: when i did the same as above but tried to reinstall it using the previously downloaded install, it did not work.

@tojustme
Copy link

Running: MacOS 15.2 Sequoia
Upon upgrading LM Studio 0.3.8, I am no longer able to fetch models

There was an error fetching results from Hugging Face, please try again in a little bit

Any idea if there is a fix?

Image

@CoCoMilkyWay
Copy link

sadly, version 0.3.9 beta, still not working
Image

@yagil
Copy link
Member

yagil commented Jan 29, 2025

@tojustme @CoCoMilkyWay can you please try these instructions? #256 (comment)

@CoCoMilkyWay
Copy link

after turn on the proxy setting in LM studio, it works now.
LM has some truble supporting the proxy environment initially.

for whatever reason, it may be justified. But it also cost me1 hour just to debug

maybe give user a hint when message like this(fetch failed) is shown

@Bahramks
Copy link

Bahramks commented Jan 30, 2025

on Version 0.3.9-beta (0.3.9-beta), getting both "Model details error: fetch failed" but also get "Failed to check for update" (quick flash in red) when i trigger this manually. On Apple M1 Pro macOS 15.3.
Proxy box is checked.
Have tried suggestion from both [MarslMarcello] & [xiayu87] in the thread.

Image

Image

@tojustme
Copy link

Upgraded to the latest version -- I am closer to downloading data.

Image

@bigleka
Copy link

bigleka commented Feb 2, 2025

I´m running on Windows 11 and on the App received the same error of the other guys.
On command line the error is:

Image

@yagil
Copy link
Member

yagil commented Feb 2, 2025

@bigleka what happens if you open the GUI and try to search there, does it work or also no?
Also: did you try to turn on Hugging Face Proxy in settings?

@bigleka
Copy link

bigleka commented Feb 2, 2025

@bigleka what happens if you open the GUI and try to search there, does it work or also no? Also: did you try to turn on Hugging Face Proxy in settings?

Hi @yagil the same error reported for another´s.
Model details error: fetch failed

Turning the Proxy on or off I got the same error.

Would be nice if the could down the models manually and move to the LM folder.

@yagil
Copy link
Member

yagil commented Feb 2, 2025

@bigleka you can indeed do this, please see this docs article: https://lmstudio.ai/docs/basics/import-model

@stephenzhang0529
Copy link

On Version 0.3.9 ,windows 11, getting "Model details error: fetch failed"
After triggering the proxy set,it works now

@Thesaurus0
Copy link

on Version 0.3.9-beta (0.3.9-beta), getting both "Model details error: fetch failed" but also get "Failed to check for update" (quick flash in red) when i trigger this manually. On Apple M1 Pro macOS 15.3. Proxy box is checked. Have tried suggestion from both [MarslMarcello] & [xiayu87] in the thread.

Image

Image

Thanks this works for me. just turn on the proxy

@argueddd
Copy link

argueddd commented Feb 7, 2025

on Version 0.3.9-beta (0.3.9-beta), getting both "Model details error: fetch failed" but also get "Failed to check for update" (quick flash in red) when i trigger this manually. On Apple M1 Pro macOS 15.3. Proxy box is checked. Have tried suggestion from both [MarslMarcello] & [xiayu87] in the thread.

Image

Image

Thanks! save my whole day!

@liuzy88
Copy link

liuzy88 commented Feb 11, 2025

看这里!看这里!看这里!
正确操作:把 huggingface.co 替换为 hf-mirror.com
亲测有效!!!

MacOS命令行:

进入安装目录
cd '/Applications/LM Studio.app/Contents/Resources/app/.webpack'

搜索包含huggingface.co的JS文件
grep -rl --include="*.js" "huggingface.co" .

得到以下结果
./renderer/main_window.js
./main/index.js

替换域名
sed -i '' 's/huggingface.co/hf-mirror.com/g' ./renderer/main_window.js
sed -i '' 's/huggingface.co/hf-mirror.com/g' ./main/index.js

重新打开应用

成功!

@liuzy88
Copy link

liuzy88 commented Feb 11, 2025

同理,Windows系统的文件在:C:\Users\你的用户名\AppData\Local\LM-Studio

@RCG-RCorrales
Copy link

Same here. Running 0.3.9 in MacOS Sequoia 15.3, tried proxy on and off - nothing.

Image

@ardamaks
Copy link

Image
Same issue on 0.3.9 Build 6 - Linux Mint

@stephenzhang0529
Copy link

On version 0.3.9, Ubuntu 20.04, turning on the proxy and then restarting LM works. Based on the photo you shared, it seems the search method you're using is for models loaded on your computer. However, if you want to fetch models from huggingface, click the search icon at the bottom of the left sidebar and search there. Hope this helps

Image Same issue on 0.3.9 Build 6 - Linux Mint

@heyarny
Copy link

heyarny commented Feb 18, 2025

Same here. We do have a proxy thou, but the proxy setting inside LM Studio is no help.

Image

Via CLI:

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests