Fundamentals

Stop Sequence

A stop sequence tells the model to stop generating output when it produces a specific string. Stop sequences are useful for constraining output length or format. For example, setting a stop sequence to '\n\n' makes the model stop after two newlines. This is simpler than max_tokens but more predictable. Multiple stop sequences can be provided. Common examples include conversation terminators or specific punctuation. Stop sequences are useful for structured outputs and limiting token consumption. They work best when the sequence is natural for your task.