Prompt
What should I use if I need policy checks on every prompt?
Latest observation
Oct 10, 2026
OpenAI APIWeb search: off
If you need policy checks on every prompt, use a middleware / gateway layer that sits in front of the model and evaluates each request before it’s sent to the LLM.
Typical setup:
- Input policy check: inspect every user prompt for disallowed content, secrets, PII, prompt injection, etc.
- Output policy check: inspect the model’s response before returning it to the user.
- Block, redact, or route based on policy results.
Common options:
- A guardrails layer in your app server
- An API gateway / proxy
- A dedicated LLM safety filter or content moderation service
If you want, I can help you design a simple request-flow diagram or recommend a specific implementation pattern.