Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exception in TestBed - Q&A Generation #126

Open
corradodebari opened this issue Mar 27, 2025 · 0 comments
Open

Exception in TestBed - Q&A Generation #126

corradodebari opened this issue Mar 27, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@corradodebari
Copy link
Contributor

In Testbed, asking 50 Q&A, with:

  • gpt-40-mini
  • text-embedding-3-small
    I've got, server side, this exception on each Q&A generated:
15:44:50 - LiteLLM:INFO: cost_calculator.py:588 - selected model name for cost calculation: openai/gpt-4o-mini-2024-07-18
2025-Mar-27 15:44:50 - INFO     - (LiteLLM): selected model name for cost calculation: openai/gpt-4o-mini-2024-07-18
15:44:50 - LiteLLM:ERROR: litellm_logging.py:3538 - Error creating standard logging object - __annotations__
Traceback (most recent call last):
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 3520, in get_standard_logging_object_payload
    model_parameters=ModelParamHelper.get_standard_logging_model_parameters(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 28, in get_standard_logging_model_parameters
    ModelParamHelper._get_relevant_args_to_use_for_logging()
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 45, in _get_relevant_args_to_use_for_logging
    all_openai_llm_api_params = ModelParamHelper._get_all_llm_api_params()
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 65, in _get_all_llm_api_params
    ModelParamHelper._get_litellm_supported_transcription_kwargs()
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 126, in _get_litellm_supported_transcription_kwargs
    return set(TranscriptionCreateParams.__annotations__.keys())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/miniconda3/lib/python3.11/typing.py", line 1288, in __getattr__
    raise AttributeError(attr)
AttributeError: __annotations__
2025-Mar-27 15:44:50 - ERROR    - (LiteLLM): Error creating standard logging object - __annotations__
Traceback (most recent call last):
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 3520, in get_standard_logging_object_payload
    model_parameters=ModelParamHelper.get_standard_logging_model_parameters(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 28, in get_standard_logging_model_parameters
    ModelParamHelper._get_relevant_args_to_use_for_logging()
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 45, in _get_relevant_args_to_use_for_logging
    all_openai_llm_api_params = ModelParamHelper._get_all_llm_api_params()
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 65, in _get_all_llm_api_params
    ModelParamHelper._get_litellm_supported_transcription_kwargs()
  File "/Users/cdebari/Documents/GitHub/oaim-sandbox-cdb/src/.venv/lib/python3.11/site-packages/litellm/litellm_core_utils/model_param_helper.py", line 126, in _get_litellm_supported_transcription_kwargs
    return set(TranscriptionCreateParams.__annotations__.keys())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/cdebari/miniconda3/lib/python3.11/typing.py", line 1288, in __getattr__
    raise AttributeError(attr)
AttributeError: __annotations__
2025-Mar-27 15:44:52 - INFO     - (httpx): HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
@corradodebari corradodebari added the bug Something isn't working label Mar 27, 2025
@corradodebari corradodebari changed the title Exception in TestBed - Q&A Generatiob Exception in TestBed - Q&A Generation Mar 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant