OpenAILike error api key

[fadhel1597]

I am curently running llama.cpp on local to test few tools, when the api called directly with openai library, the model can answer without any problem, but when i use llamaindex openai like, its always return api key format error

from llama_index.llms.openai_like import OpenAILike

import os
os.environ["OPENAI_API_KEY"] = 'YOU_API_KEY'

llm = OpenAILike(
    model="model",
    base_url="http://127.0.0.1:8000/v1",
    api_key=os.getenv("OPENAI_API_KEY")
)

response = llm.complete("who are you?")
print(response)

AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: YOU_API_KEY. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}

[dosubot[bot]]

Hey there, @fadhel1597! I'm here to help you with any bugs, questions, or contributions you might have. Let's tackle this together!

I found a similar closed issue where the suggested solution was to ensure that the OPENAI_API_KEY environment variable is set correctly before using the OpenAILike class. The error message you're encountering indicates that the API key is not being recognized as valid. Make sure that you replace 'YOU_API_KEY' with your actual OpenAI API key.

Here's a quick checklist to resolve the issue:

1. Verify that the API key is correctly set in your environment variable:

   os.environ["OPENAI_API_KEY"] = 'your-actual-api-key'

2. Ensure that the API key is correctly passed to the OpenAILike class:

   llm = OpenAILike(
       model="model",
       base_url="http://127.0.0.1:8000/v1",
       api_key=os.getenv("OPENAI_API_KEY")
   )

3. Double-check that the API key is valid and active by testing it directly with the OpenAI library, as you mentioned it works there.

If the issue persists, consider checking the format of the API key and ensure there are no extra spaces or characters ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[fadhel1597]

i mean what kind of api key i need to provide since i locally host this model

[dosubot[bot]]

When hosting the model locally with llama.cpp and using the OpenAILike class, you can set the API key to any value. For example, if you're using LocalAI, a self-hosted OpenAI alternative, you can set the api_key to "localai_fake" as per the default settings in the LocalAI configuration. LocalAI does not require a real API key for local deployments ^[1][2].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[fadhel1597]

i filled the api key parameter witha nything yet the llamaindex still return api key error