I've worked the engineering end of several startups. Most startups try to do "some A/B" testing", but doing it properly is really hard. I think everyone embraces the theory, but the only one place did a comprehensive job (and it was very well funded). I wish we had this for my other startup stints.