46.4 Production checklist (logging, monitoring, rollbacks)

Production Checklist

## Production Checklist

### Logging
- [ ] Request ID logged for tracing?
- [ ] Prompts logged (redacted)?
- [ ] Responses logged (redacted)?
- [ ] Latency tracked?
- [ ] Token usage tracked?
- [ ] Error rates tracked?

### Monitoring
- [ ] Alerts for error rate spikes?
- [ ] Alerts for latency degradation?
- [ ] Alerts for cost anomalies?
- [ ] Dashboard for key metrics?
- [ ] Eval suite running on sample traffic?

### Rollbacks
- [ ] Can disable AI feature instantly?
- [ ] Fallback behavior defined?
- [ ] Previous prompt version available?
- [ ] Rollback tested recently?

### Incident Response
- [ ] Runbook documented?
- [ ] On-call knows about AI features?
- [ ] Escalation path clear?
- [ ] Post-mortem template ready?

### Compliance
- [ ] User consent obtained?
- [ ] AI disclosure visible?
- [ ] Data retention policies followed?
- [ ] Logs meet compliance requirements?

Where to go next

• 46.5 Security checklist