Pages

▼
Showing posts with label testing. Show all posts
Showing posts with label testing. Show all posts
Sunday, 24 November 2024

Testing versus Implementing - why not just switch it on?

›
"Why can't we just make a change and see what happens? Why do we have to build an A/B test - it takes too long!  We have a roadmap,...
Monday, 18 November 2024

Designing Personas for Design Prototypes

›
Part of my job is validating (i.e. testing and confirming) new designs for the website I work on.  We A/B test the current page against a n...
Wednesday, 10 July 2024

How not to Segment Test Data

›
 Segmenting Test Data Intelligently Sometimes, a simple 'did it win?' will provide your testing stakeholders with the answer they ne...
Friday, 17 May 2024

Multi-Armed Bandit Testing

›
 I have worked in A/B testing for over 12 years, and blogged about it extensively.  I've covered how to set up a hypothesis , how to tes...
Wednesday, 10 January 2024

Statistics: Type 1 and Type 2 Errors

›
 In statistics (and by extension, in testing), a Type I error is a false positive conclusion (we think a test recipe won when it didn't)...
Monday, 14 November 2022

How many of your tests win?

›
 As November heads towards December, and the end of the calendar year approaches, we start the season of Annual Reviews.  It's time to i...
Thursday, 25 August 2022

Testing Towards The Future State

›
Once or twice in the past, I've talked about how your testing program needs to align with various departments in your company if it...
Thursday, 24 June 2021

How long should I run my test for?

›
 A question I've been facing more frequently recently is "How long can you run this test for?", and its close neighbour "...
Tuesday, 8 December 2020

A/B testing without a 50-50 split

›
Whenever people ask me what I do for a living, I [try not to] launch off into a little speech about how I improve website design and experie...
Monday, 18 November 2019

Web Analytics: Requirements Gathering

›
Everybody knows why your company has a website, and everybody tracks the site's KPIs. Except that this a modern retelling of the stor...
Wednesday, 28 November 2018

The Hierarchy of A/B Testing

›
As any A/B testing program matures, it becomes important to work out not only what you should test (and why), but also to start identifying...
1 comment:
Monday, 25 June 2018

Data in Context (England 6 - Panama 1)

›
There's no denying it, England have made a remarkable and unprecedented start to their World Cup campaign.  6-1 is their best ever scor...
Tuesday, 19 June 2018

When Should You Switch A Test Off? (Tunisia 1 - England 2)

›
Another day yields another interesting and data-rich football game from the World Cup.  In this post, I'd like to look at answering the...
Monday, 14 May 2018

Online Optimisation: Testing Sequences

›
As your online optimisation program grows and develops, it's likely that you'll progress from changing copy or images or co lours...