1.)                 2.)

design review       QA
UX


Engineering         Side by side test,
                    100s of operators,
                    human evaluation, requires abtestid



3.) AB gatekeeping

4.) (containers/buckets) *only for searching tests
                                            containers allow users to have mutually exclusive traffic 4-5.  use side by side test to test for exclusive traffic (make sure it's ok)  14 days, but try to get 7 days for significance (MDE)

5.) launch review (within search and discover) .  could hurt company overwide goals.  code merge could break.  3 approvals (jane and xiaowei)
- deny
- approve
- conditionally approva
- approve (jidoka) review again in one month

6.) run tests

see whether next feature or wording changes: MDE
AA test: do it when you're testing integration