Skip to content
GitLab

[api] Support temp=0. Return errors as json.

Merged Administrator requested to merge temp0 into main

Created by: stephenroller

Patch Description

  • Makes the API return error messages as JSON objects consistent with the OpenAI api
  • More robust to hangs derived from a bad user supplied arg
  • Adds support for setting temperature=0 to get greedy.

Testing steps Deployed and using it with various test cases.