Discussion about this post

User's avatar
Arpit's avatar

Swapping the model with nothing to switch on is the hard part to get right, since users only ever notice regressions. That kind of quiet rollout depends on strong evals before launch. Disclosure, I built allthingspm.app, and its evals chapter is about exactly this sort of silent model swap.

Ready for more?