论文标题
隐私意识到没有饼干的实验
Privacy Aware Experiments without Cookies
论文作者
论文摘要
考虑两个想要通过A/B测试共同测试客户的替代网络体验的品牌。今天使用\ textit {第三方cookies}启用了此类协作测试，每个品牌都有有关访问者身份的信息。随着迫在眉睫的第三方饼干，这种A/B测试将变得站不住脚。我们提出了一个两阶段的实验设计，其中两个品牌只需要就实验的高级聚合参数达成共识，即可测试替代体验。我们的设计尊重客户的隐私。我们提出了平均治疗效果（ATE）的估算值，表明它是公正的，理论上计算其方差。我们的演示描述了品牌营销人员如何设计这样的实验并分析结果。在实际和模拟的数据上，我们表明该方法提供了差异较低的有效估计，并且对跨品牌重叠的访问者比例有稳定。
Consider two brands that want to jointly test alternate web experiences for their customers with an A/B test. Such collaborative tests are today enabled using \textit{third-party cookies}, where each brand has information on the identity of visitors to another website. With the imminent elimination of third-party cookies, such A/B tests will become untenable. We propose a two-stage experimental design, where the two brands only need to agree on high-level aggregate parameters of the experiment to test the alternate experiences. Our design respects the privacy of customers. We propose an estimater of the Average Treatment Effect (ATE), show that it is unbiased and theoretically compute its variance. Our demonstration describes how a marketer for a brand can design such an experiment and analyze the results. On real and simulated data, we show that the approach provides valid estimate of the ATE with low variance and is robust to the proportion of visitors overlapping across the brands.
