Lm Studio

rawr

Hello,
can someone help me with setup up LM Studio as local LLM?
I started the server and when i press play, my lm studio gets an api request:
Received request: GET to /v1/models

and returns the model list, but in the app i get the popup:

The backend cannot be accessed, check out if it started correctly and its API URL

KairosJS

Hello,
Below is a screen from LM Studio running a model:

And below eudaimonia set up:

Some model uses text completion, other chat completion (especially recent models).
Make sure to give enough context size when loading the model (the system prompt is big, you probably need at least 12K context size.

EDIT:

Well the screens are too small to see anything.
On the Developer tab of LM Studio:

Check the URL of the server (mine is http://127.0.0.1:1234).
Paste it in Eudaimonia, and make sure to remove any trailing "/".
Load the model you want to play with in LM Studio, and set a context size large enough for your needs.
Check the console in LM Studio to see if there is an error.

Welwa

Also make sure that Enable CORS and Serve on local Network are switchted on in Local Server Section

rawr

thanks alot, i had cors disabled, that fixed it for me! 🙂