Skip to content
GitLab

[api] Cut off user's prompt

Merged Administrator requested to merge promptcutoff into main

Created by: stephenroller

Patch Description This patch shortens a user's prompt to meet the number of generated tokens they request.

Testing steps Deployed API