Skip to content
GitLab

[api] Small robustness improvements.

Merged Administrator requested to merge apirobust into main

Created by: stephenroller

Patch Description

  • Have a maximum beam size to avoid OOM
  • Propagate CUDA crashes to be hard crashes, rather than reported to the user.

Testing steps Not yet tested.