The Release That Almost Broke Everything

We deployed the new feature to staging on Tuesday.

It looked good in our tests.

But when we did the rollout to production, things went wrong.

Users saw errors on the signup page.

We had to roll it back immediately.

The rollback took less than five minutes.

Then we found the bug in staging.

It was a simple database query mistake.

We fixed it and deployed a hotfix.

Now that feature is behind a feature flag.

Only internal users can see it.

We will flip the flag next week after more tests.