Tales of Design & User Experience (ToDUX) #16 ⁂ Dear readers & friends, Studies have shown over and over that even professional researchers (including statisticians!) can’t correctly interpret a confidence interval or a p-value most of the time. Then, how could you expect the...
Tales of Design & User Experience (ToDUX) #15 ⁂ Dear readers & friends, So, you might have noticed by now that “research done wrong in industry” is kind of my pet peeve, and I’m sorry you have to endure that. However, I’m not quite done with the topic yet. My new article in The UX...
In this post, we explore a situation typical of a website, where a user is allowed to view the page multiple times and may click on a button of interest on any visit. We would like to perform an A/B test on the non-user level metric, the click-through rate (CTR), defined via total clicks divided...
In the original CUPED paper, the authors mention that it is straightforward to generalize the method to multiple covariates. However, without understanding exactly the mathematical technique to find the CUPED estimate, it may be confusing to attempt the multiple covariates case. In this post, we...
In the past decade, there have been many advancements to enable A/B testing at (sometimes even small!) scale. Thankfully, many A/B testing practitioners have come forward and written books and papers on the finer details. Even with the deluge blog posts on the subject– there’s one topic that does...
My intent is to give recommendations that will be of use to other programmers who are trying to quickly turn a side project into a professional product that they can sell. Assuming you already have a working side project or product (no small feat in itself, but not difficult for a coder to put...