.Net: Bug: SK can't call AzureOpenAI o1 model

[rwjdk]

Describe the bug
When doing an agent.InvokeAsync call against the o1 model (version:2024-12-17) in Azure Open AI service you get error:

"HTTP 400 (BadRequest)\r\n\r\nModel o1 is enabled only for api versions 2024-12-01-preview and later"

To Reproduce
Steps to reproduce the behavior:

1. Make a kernel chat completion service that target o1 as deployment model
2. Make an agent (with instructions, temperature and structured output)
3. Call agent.InvokeAsync

Expected behavior
A normal LLM respose (in this case json due to structured output)

Platform

• OS: Windows
• IDE: Visual Studio
• Language: C#
• Source: NuGet package version 1.33.0

Additional context
Issue is properly the transative use of the azure.ai.openai beta2 package. I tried manually bumping this to latest, but it gave an feature not implemented exception

[rwjdk]

Relate to Azure/azure-sdk-for-net#47809

[moonbox3]

Hi @rwjdk, can you please make sure you are indeed sending the 2024-12-01-preview Azure OpenAI API version. Based on this error message, your Azure api version looks to be older than 2024-12-01-preview. The o1 model (2024-12-17) is the model release date and is not the same as the api version.

[rwjdk]

@moonbox3: As I'm using AzureOpenAI services I'm not sending a version at any point in the call (just the deployment name which in my case is "o1") I've checked the raw request to make sure and no version is mentioned in there

In Azure AI Studio the version is 2024-12-17 (the only option)

But taking above image I saw something odd - The target URI that you do not choose yourself (and never use in SK says api-version=2024-12-01-preview so it could be an Azure bug [I'm in swedenCentral Azure Region])

Can one in SK alter the target URI version?

[rwjdk]

Did a quick test with the Azure.AI.OpenAI (v2.1.0) nuget package directly and it gives the same error so I guess SK Team depends on having this dependency supporting/working first :-/

[moonbox3]

Yes, you can use a different Azure API version. Tagging @SergeyMenshykh for a specific example on how to in .Net.

[rwjdk]

@moonbox3 I tried that but as the underlying platform do not yet support the version it still fails with a not implemented exception :-/

Assume this is what you mean:
kernelBuilder.AddAzureOpenAIChatCompletion(deploymentModel, Endpoint, key, apiVersion: "some-version here");

[SergeyMenshykh]

It's not supported by the Azure.AI.OpenAI SDK yet - https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/openai/Azure.AI.OpenAI/src/Custom/AzureOpenAIClientOptions.cs
cc: @RogerBarreto