The ability to use pr-agent on Azure Devops using azure open ai

[vino-architect]

I want to use PR Agent for my python code review using Azure Open AI.
I am not finding the right document for it. On below yaml, I am getting error as "2025-03-27 08:03:10.452 | WARNING | pr_agent.algo.ai_handlers.litellm_ai_handler:chat_completion:319 - Error during LLM inference: litellm.AuthenticationError: AuthenticationError: OpenAIException - Error code: 401 - {'error': {'message': 'Incorrect API key provided: c9690741********************6f09. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}"

trigger: none

pr:
branches:
include:
- 'explore/test-ai-code-review-appraise'
autoCancel: true
drafts: false

stages:

• stage: pr_agent
  displayName: 'PR Agent Stage'
  jobs:
  • job: pr_agent_job
    displayName: 'PR Agent Job'
    pool:
    vmImage: 'ubuntu-latest'
    container:
    image: codiumai/pr-agent:latest
    options: --entrypoint ""
    variables:

    • group: pr_agent # Reference the variable group
      steps:

    • script: |
      echo "Running PR Agent action step"

      Print environment variables for debugging

      echo "SYSTEM_COLLECTIONURI=${SYSTEM_COLLECTIONURI}"
      echo "SYSTEM_TEAMPROJECT=${SYSTEM_TEAMPROJECT}"
      echo "BUILD_REPOSITORY_NAME=${BUILD_REPOSITORY_NAME}"
      echo "SYSTEM_PULLREQUEST_PULLREQUESTID=${SYSTEM_PULLREQUEST_PULLREQUESTID}"
      echo "API Key: ${openai_api_key}" # Print API key for debugging
      echo "API Key Source: ${api_key_source}"

      Check if SYSTEM_PULLREQUEST_PULLREQUESTID is empty

      if [ -z "${SYSTEM_PULLREQUEST_PULLREQUESTID}" ]; then
      echo "Error: SYSTEM_PULLREQUEST_PULLREQUESTID is not set."
      exit 1
      fi

      Construct PR_URL

      PR_URL="${SYSTEM_COLLECTIONURI}${SYSTEM_TEAMPROJECT}/_git/${BUILD_REPOSITORY_NAME}/pullrequest/${SYSTEM_PULLREQUEST_PULLREQUESTID}"
      echo "PR_URL=$PR_URL"

      Extract organization URL from System.CollectionUri

      ORG_URL=$(echo "${SYSTEM_COLLECTIONURI}" | sed 's//$//') # Remove trailing slash if present
      echo "Organization URL: $ORG_URL"

      export azure_devops__org="$ORG_URL"
      export config__git_provider="azure"

      Verify the endpoint and API key

      echo "Using OpenAI endpoint: $openai__endpoint"
      echo "Using OpenAI API key: $openai_api_key"
      echo "Using Azure OpenAI Endpoint: $azureopenai_endpoint"

      Run PR Agent commands with additional debugging

      pr-agent --pr_url="$PR_URL" describe || { echo "Describe command failed"; exit 1; }
      pr-agent --pr_url="$PR_URL" review || { echo "Review command failed"; exit 1; }
      pr-agent --pr_url="$PR_URL" improve || { echo "Improve command failed"; exit 1; }

      Run AI Code Review

      python -m pip install requests
      python code_review.py
      env:
      azure_devops__pat: $(azure_devops_pat)
      openai_api_key: $(openai_api_key) # Use the variable from the variable group
      api_key_source: $(openai_key_source)
      openai__endpoint: $(azureopenai_endpoint)
      displayName: 'Run PR Agent and AI Code Review'

[mrT23]

thoroughly review
https://qodo-merge-docs.qodo.ai/usage-guide/changing_a_model/#azure

i dont see you gave all the needed keys.

and if this doesn't work, make sure, with plain litellm, you are able to access your model.

[IsmaelMartinez]

The two halves of this are unrelated: Azure DevOps is the git provider, Azure OpenAI is the model, and PR-Agent supports both together with no special integration. Your provider settings are right. The failure is purely model configuration: you exported openai__endpoint, which is not a recognised setting, so nothing set the Azure base URL and litellm fell back to the public OpenAI API, hence the platform.openai.com 401. Set OPENAI__API_TYPE=azure, OPENAI__API_BASE=https://<resource>.openai.azure.com, OPENAI__API_VERSION=<version>, OPENAI__DEPLOYMENT_ID=<deployment name> and OPENAI__KEY=<azure key>, then set config.model to the model you deployed. The Azure section of the model guide has the full list, and azure_ad is there if you would rather use Entra ID. Closing as answered; please reopen if it still fails with those keys set.