Skip to content

Roll variant headlines out to 100% of users #16675

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Fweddi wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Roll variant headlines out to 100% of users #16675

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
2d7aedb
Expand name of test to future-proof us when we test articles using sa…
Fweddi Sep 2, 2026
d40387b
Roll variant headline out to 5% of users
Fweddi Aug 27, 2026
09fd055
Amend to 25/100 (ie 25%) rollout
Fweddi Sep 1, 2026
658935b
Reserve last alphabetical audience space
Fweddi Sep 1, 2026
7fa91e2
Roll variant headline out to 50% of users
Fweddi Aug 27, 2026
07d4a71
Roll out variant headlines to all users
Fweddi Sep 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions ab-testing/config/abTests.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -196,16 +196,17 @@ const ABTests: ABTest[] = [
shouldForceMetricsCollection: false,
},
{
name: "fronts-and-curation-editorial-headline-test",
description: "Allow editorial headline A/B tests to run on web",
name: "fronts-and-curation-editorial-test",
description: "Allow editorial A/B tests to run on web",
owners: [
"fronts.and.curation@guardian.co.uk",
"ab.test.mission@guardian.co.uk",
],
status: "ON",
expirationDate: "2036-08-12",
type: "server",
audienceSize: 0 / 100,
audienceSize: 100 / 100,
audienceSpace: "E",
groups: ["a", "b"],
shouldForceMetricsCollection: false,
},
Expand Down
18 changes: 9 additions & 9 deletions dotcom-rendering/src/model/enhanceCards.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -678,7 +678,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithNoEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'test-front',
Expand All @@ -691,7 +691,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'invalid-test-front',
Expand All @@ -704,7 +704,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
false,
'test-front',
Expand All @@ -717,7 +717,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'test-front',
Expand All @@ -730,7 +730,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'b',
'fronts-and-curation-editorial-test': 'b',
},
true,
'test-front',
Expand All @@ -743,7 +743,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'c',
'fronts-and-curation-editorial-test': 'c',
},
true,
'test-front',
Expand All @@ -756,7 +756,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithEditorialTestWithUndefinedVariantMeta,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'test-front',
Expand All @@ -769,7 +769,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithExpiredEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'test-front',
Expand All @@ -782,7 +782,7 @@ describe('Enhance Cards', () => {
decideHeadline(
cardWithManuallyEndedEditorialTest,
{
'fronts-and-curation-editorial-headline-test': 'a',
'fronts-and-curation-editorial-test': 'a',
},
true,
'test-front',
Expand Down
3 changes: 1 addition & 2 deletions dotcom-rendering/src/model/enhanceCards.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -216,8 +216,7 @@ export const decideHeadline = (
): string => {
const defaultHeadline = faciaCard.header.headline;

const testBucket =
serverSideABTests['fronts-and-curation-editorial-headline-test'];
const testBucket = serverSideABTests['fronts-and-curation-editorial-test'];

const activeEditorialTest = findActiveEditorialTest(
faciaCard.properties.tests,
Expand Down
Loading