Category Archives: Testing and Data Science

AB Testing: When Tests Collide

Normally, when we talk about AB Tests (standard or Bandit style), we tend to focus on things like the different test options, the reporting, the significance levels, etc.  However, once we start implementing tests, especially at scale, it becomes clear that we need a way to manage how we assign users to each test.  There […]

Also posted in Analytics, Reporting | | Leave a comment


The World’s Top 7 Data Scientists before there was Data Science

I am often a bit late to the party and only recently saw Tim O’Reilly’s “The Worlds’ 7 most powerful Data Scientists”. As data science has become a big deal, there have been a several top data science lists that have been floating around. So for fun, I thought I would put together my own […]

Also posted in Uncategorized | | 10 Comments


Intelligent Agents: AB Testing, User Targeting, and Predictive Analytics

Whether you are in marketing, web analytics, data science, or even building a Lean Startup, you probably are on board with the importance of analytical decision-making.  Go to any related conference, blog, meet up and you will hear at least one of the following terms: Optimization, AB & Multivariate Testing, Behavioral Targeting, Attribution, Predictive Analytics, […]

Also posted in Analytics | | Tagged , | Leave a comment


List of Machine Learning and Data Science Resources – Part 2

This is a follow up to a post to the list of Machine Learning and Data Sciences resources I put up a little while ago. This post contains some links to resources on clustering and Reinforcement Learning that I didn’t get to in the first post. Like the first one, it’s a bit haphazard, and […]

| 1 Comment


A List of Data Science and Machine Learning Resources

Every now and then I get asked for some help or for some pointers on a machine learning/data science topic.  I tend respond with links to resources by folks that I consider to be experts in the topic area.   Over time my list has gotten a little larger so I decided to put it all […]

Also posted in Analytics, Uncategorized | | 6 Comments


Decision Attribution for Multi-Touch Optimization

Right now online advertisers and marketers have a lot of interest in attribution analysis.  Marketers are struggling to determine the impact of each individual campaign, across various channels, that make up their online marketing efforts.  While they can discern the aggregate effects, it is much more difficult to disentangle the individual effectiveness from any given […]

Also posted in Analytics, Uncategorized | | Tagged , , , , | Leave a comment


Conductrics’ Confidence and Lift Report – The Basics

While enabling Conductrics’ adaptive testing is a powerful way to auto-optimize your app, there are times when you might want to run  non-adaptive tests. Maybe you want to test something that you will apply in other media, or perhaps you want to do online research on your customers, to give you additional insights into their […]

Also posted in Analytics, Conductrics API, Reporting, Uncategorized | | Tagged | Leave a comment


Bandit Optimization and Emetrics

This past week, I had the pleasure of getting to speak at Emetrics Stockholm. For those not aware, Emetrics is one of the largest digital analytics conferences, with local events in several locations throughout the year. It was my first time in Stockholm. It is an absolutely gorgeous city. Plus, if you like Scotch, you […]

Also posted in Analytics, Travel | | Tagged , , | Leave a comment


Balancing Earning with Learning: Bandits and Adaptive Optimization

While AB Testing is currently the default method for optimizing online conversions, there are frameworks other than AB testing for selecting between competing optimization options.  One of the main alternative approaches is known as the Multi-Armed Bandits problem.  Solutions to the so called bandit problems have several nice features that often make them a good […]

| Tagged , | 1 Comment


Try Conductrics and get your account in seconds!

Get Access