Skip to content

Force Azure OpenAI API style to fix Invalid LLM output format error when using Azure models#830

Open
dan-sec-ops wants to merge 1 commit intovoideditor:mainfrom
dan-sec-ops:fix/azure-openai-api-format-error
Open

Force Azure OpenAI API style to fix Invalid LLM output format error when using Azure models#830
dan-sec-ops wants to merge 1 commit intovoideditor:mainfrom
dan-sec-ops:fix/azure-openai-api-format-error

Conversation

@dan-sec-ops
Copy link

@dan-sec-ops dan-sec-ops commented Jul 17, 2025

Problem with Azure OpenAI gpt-4.1 :
image

Root cause:

  • Azure OpenAI models are getting XML format instead of openai-style enforced json schema.

Solution:

  • Fix Invalid LLM output format error by ensuring proper API compatibility by updating Azure model configurations to use consistent OpenAI-style formatting
  • Add comprehensive microsoftAzureModelOptions

Result:
image

- Fix Invalid LLM output format error by ensuring proper API compatibility by updating Azure model configurations to use consistent OpenAI-style formatting
- Add comprehensive microsoftAzureModelOptions
@dan-sec-ops dan-sec-ops marked this pull request as draft July 17, 2025 17:25
@dan-sec-ops dan-sec-ops marked this pull request as ready for review July 17, 2025 17:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant