{"id":13650,"date":"2026-04-04T11:17:30","date_gmt":"2026-04-04T10:17:30","guid":{"rendered":"https:\/\/siite.dk\/?p=13650"},"modified":"2026-04-04T11:17:30","modified_gmt":"2026-04-04T10:17:30","slug":"incrementality-testing","status":"publish","type":"post","link":"https:\/\/siite.dk\/en\/marketingordbog\/incrementality-testing\/","title":{"rendered":"Incrementality testing"},"content":{"rendered":"<h2 class=\"wp-block-heading\">What is incrementality testing?<\/h2>\n\n\n\n<p>Incrementality testing is a method used to measure the real impact of a marketing effort.<br>The aim is to find out what actually creates extra results and what would have happened anyway.<\/p>\n\n\n\n<p>When companies advertise across channels such as Google, Meta, email or affiliate, a key question often arises:<br>How much of the sales are directly attributable to marketing and how much would have happened without the campaign?<\/p>\n\n\n\n<p>This is where incrementality testing becomes important.<br>The method helps isolate the additional value an activity creates to make better decisions about budget, channel selection and strategy.<\/p>\n\n\n\n<p>In Danish, the term can be translated to something like <em>Measuring incremental effect<\/em> or <em>testing the powerlift<\/em>.<br>In practice, however, the term is often used in marketing, analytics and performance work.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Why is incrementality testing important?<\/h2>\n\n\n\n<p>Many marketing metrics show correlation, but not necessarily cause and effect.<br>For example, an advert can get credit for a sale even if the customer had already decided to buy.<\/p>\n\n\n\n<p>This means that classic reporting metrics such as clicks, impressions, conversions and <a href=\"https:\/\/siite.dk\/en\/marketingordbog\/roas-return-on-ad-spend\/\">ROAS<\/a> can give a skewed picture.<br>They often show what has been recorded, but not always what has actually moved the business.<\/p>\n\n\n\n<p>Incrementality testing attempts to answer a more precise question:<br>What is the additional impact of this activity compared to a scenario where the activity did not take place?<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Reduce waste in your marketing budget<\/li><li>Identify channels that actually generate additional revenue<\/li><li>Reveal overrated campaigns and tactics<\/li><li>Support more accurate budget allocation<\/li><li>Improve collaboration between marketing, management and finance<\/li><\/ul>\n\n\n\n<p>In an era of limited tracking, stricter privacy regulations and less reliable attribution, incrementality testing has become even more relevant.<br>It provides a more robust basis for decision-making than many traditional measurement methods.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">How the method works in practice<\/h2>\n\n\n\n<p>At the heart of incrementality testing is comparison.<br>It compares a group that is exposed to a marketing effort with a group that is not.<\/p>\n\n\n\n<p>If the two groups are similar enough, the difference in results can be used as an estimate of the incremental effect.<br>That is, the value that the campaign has actually created on top of what would have happened otherwise.<\/p>\n\n\n\n<p>In many ways, it resembles a classic experiment.<br>The better the test is designed, the more credible the result will be.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Test group and control group<\/h3>\n\n\n\n<p>A test group is exposed to the activity you want to measure.<br>It could be an ad campaign, a discount code, an email series or a branding effort.<\/p>\n\n\n\n<p>However, the control group is not exposed to the same activity.<br>If the control group is otherwise similar to the test group, the difference between the groups may point to the actual effect of the campaign.<\/p>\n\n\n\n<p>For example, a company may show adverts in one region but not in another comparable region.<br>If sales increase significantly more in the test region, the increase may be a sign of incremental effect.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">The holdout method<\/h3>\n\n\n\n<p>One of the most commonly used forms of incrementality testing is a holdout test.<br>Here, the campaign is deliberately withheld from part of the target audience to create a basis for comparison.<\/p>\n\n\n\n<p>It may feel counterintuitive not to market to everyone, but this retention makes it possible to measure the added promise.<br>Without a control group, it's much harder to determine what the campaign actually contributed.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Time period and statistical certainty<\/h3>\n\n\n\n<p>A good test typically requires an appropriate duration and enough data.<br>If the test is too short or the target group too small, the results can be uncertain or misleading.<\/p>\n\n\n\n<p>That's why you often work with statistical significance, confidence levels and clear definition of success criteria.<br>The more disciplined the setup, the greater the value of the test in practice.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">What do you typically measure with incrementality testing?<\/h2>\n\n\n\n<p>Incrementality testing can be used for much more than just measuring sales.<br>The choice of metric depends on your organisation's goals, channel and customer journey.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Turnover<\/li><li>Number of purchases<\/li><li><a href=\"https:\/\/siite.dk\/en\/marketingordbog\/leads\/\">Leads<\/a><\/li><li>Subscription sign-ups<\/li><li>App installations<\/li><li>Visit on website<\/li><li>Repurchase and customer loyalty<\/li><li>Fire lift and awareness<\/li><\/ul>\n\n\n\n<p>Performance marketing often focuses on conversions and revenue.<br>In longer-term efforts, you can also test the effect on demand, search behaviour or branded search.<\/p>\n\n\n\n<p>The most important thing is that the goal is clearly defined from the start.<br>If you don't know exactly what you want to prove or disprove, the test can easily become too imprecise.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Difference between incrementality testing and attribution<\/h2>\n\n\n\n<p>Incrementality testing is often mentioned alongside attribution, but the two are not the same thing.<br>Attribution is about distributing credit for a conversion between touchpoints in the customer journey.<\/p>\n\n\n\n<p>For example, an attribution tool can show that a Facebook advert received credit for a purchase because the customer clicked on the advert shortly before the conversion.<br>But that doesn't necessarily tell you if the advert was instrumental in making the purchase.<\/p>\n\n\n\n<p>Incrementality testing goes one step further.<br>This examines whether the activity created an additional result that would not otherwise have occurred.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Attribution:<\/strong> Who gets credit for the conversion?<\/li><li><strong>Incrementality testing:<\/strong> Did the effort create an extra conversion at all?<\/li><\/ul>\n\n\n\n<p>Both methods can be useful.<br>But if the goal is to understand real business impact, incrementality testing is often more valuable for decision making.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">When does incrementality testing make sense?<\/h2>\n\n\n\n<p>The method is especially relevant when a company wants to find out if a channel or campaign is actually generating growth.<br>This applies to both digital marketing and broader media efforts.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>When multiple channels affect the same conversion<\/li><li>When the last click gives a misleading image<\/li><li>When branded search seems to take too much credit<\/li><li>When remarketing is powerful, but may only capture ready-to-buy users<\/li><li>When you want to test the effect of increased or reduced budget<\/li><li>When privacy restrictions make tracking less accurate<\/li><\/ul>\n\n\n\n<p>Incrementality testing is also relevant in situations where management wants evidence of marketing's business value.<br>Here the test can create a more reliable link between activity and result.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Examples of incrementality testing in marketing<\/h2>\n\n\n\n<p>The concept may seem technical, but the application is very concrete.<br>Below are some typical situations where incrementality testing is used in practice.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Paid search on brand name<\/h3>\n\n\n\n<p>Many companies advertise their own brand name in search engines.<br>The question is whether the ads generate additional sales or whether customers would have clicked on the organic result anyway.<\/p>\n\n\n\n<p>By switching off branded search for selected periods or areas, you can test the real added effect.<br>The result is often surprising because some of the traffic comes naturally without ad impact.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Remarketing<\/h3>\n\n\n\n<p><a href=\"https:\/\/siite.dk\/en\/marketingordbog\/remarketing\/\">Remarketing<\/a> is often measured as a strong channel because it reaches users close to purchase.<br>But that's why it can look better in attribution models than its actual lift warrants.<\/p>\n\n\n\n<p>A holdout test can show if remarketing actually moves sales or if it mostly converts people who were already on their way to buy.<br>This can have a big impact on budget allocation.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Email marketing<\/h3>\n\n\n\n<p>Email campaigns can be tested by not sending to a small, representative portion of recipients.<br>If the recipient group performs significantly better than the holdout group, it indicates a real incremental effect.<\/p>\n\n\n\n<p>This is especially useful when you want to find out how much extra revenue an automated flow series, newsletter or promotional offer actually generates.<br>Not just how many sales were registered after a click.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Social media and display<\/h3>\n\n\n\n<p>On channels like Meta, YouTube or display networks, incrementality testing can be used to measure whether campaigns create demand beyond existing levels.<br>This is especially relevant for the upper and middle parts of the funnel, where the effect is not always visible in the last click.<\/p>\n\n\n\n<p>Geotests, exposure control or the platform's own lift studies can be relevant methods here.<br>The choice depends on budget, data and the complexity of the media mix.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Benefits of working with incrementality testing<\/h2>\n\n\n\n<p>There are several good reasons why more marketing teams are prioritising incrementality testing more than ever before.<br>The method provides a more realistic picture of what drives growth.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Better understanding of cause and effect<\/li><li>More efficient use of marketing budgets<\/li><li>Stronger arguments to management and stakeholders<\/li><li>Less reliance on uncertain tracking data<\/li><li>Possibility to trim or stop inefficient activities<\/li><li>Better foundation for scaling what works<\/li><\/ul>\n\n\n\n<p>When companies know the real contribution of channels, it becomes easier to invest wisely.<br>This creates both higher efficiency and greater confidence in marketing efforts.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Challenges and limitations<\/h2>\n\n\n\n<p>While incrementality testing is powerful, it is not without its challenges.<br>A poor test setup can lead to conclusions that seem accurate but in practice are uncertain.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>It can be difficult to create fully comparable groups<\/li><li>Small amounts of data lead to uncertain results<\/li><li>External factors can affect the outcome<\/li><li>Testing can cost short-term revenue in the holdout group<\/li><li>The organisation may lack the skills to interpret the results correctly<\/li><\/ul>\n\n\n\n<p>Seasonality, price changes, competitor activity and inventory issues can all disrupt a test.<br>Therefore, results should always be assessed in context and not stand alone.<\/p>\n\n\n\n<p>It's also important to remember that one test doesn't necessarily provide an eternal answer.<br>Markets change, audiences evolve, and channel impact can vary over time.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">How to get started with incrementality testing<\/h2>\n\n\n\n<p>If a company wants to work more systematically with incrementality testing, it's beneficial to start simple.<br>The key is not to test everything at once, but to choose the areas where the uncertainty is greatest and the potential is high.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Define a clear business question<\/li><li>Choose one channel or campaign to test<\/li><li>Designate test group and control group<\/li><li>Set KPIs and test period in advance<\/li><li>Ensure sufficient data volume<\/li><li>Analyse the result soberly and in context<\/li><li>Use the learning for the next test and budget decision<\/li><\/ul>\n\n\n\n<p>A good first step might be to test branded search, remarketing or email campaigns.<br>These are areas where the measured performance often looks strong, but the incremental impact may be lower than expected.<\/p>\n\n\n\n<p>Over time, the organisation can build a testing culture where decisions are based on experimentation rather than assumptions.<br>It enhances learning, efficiency and strategic maturity.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Incrementality testing in a modern marketing strategy<\/h2>\n\n\n\n<p>In modern marketing, the customer journey is rarely linear.<br>A customer can be influenced by search, social media, email, organic traffic, reviews and word-of-mouth before a purchase is made.<\/p>\n\n\n\n<p>This makes it difficult to understand which efforts are actually making a difference.<br>Incrementality testing is an important complement to dashboards, ad platforms and classic analytics tools.<\/p>\n\n\n\n<p>For Danish companies that want better control over their marketing impact, incrementality testing is more than a technical buzzword.<br>It's a way to get closer to the truth about what creates real growth.<\/p>\n\n\n\n<p>When you get serious about incremental impact, marketing is measured not just by activity, but by actual incremental contribution.<br>It's often the difference between optimising reports and optimising business.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>Incrementality testing is basically about measuring whether marketing creates something extra.<br>Not just what can be tracked, but what actually moves results.<\/p>\n\n\n\n<p>It is particularly valuable in a digital reality where attribution is often incomplete and many channels compete for credit for the same conversion.<br>By comparing test and control groups, organisations can get a more credible picture of impact.<\/p>\n\n\n\n<p>For businesses, marketers and analysts, incrementality testing is therefore an essential tool.<br>This leads to better decisions, sharper prioritisation and greater certainty that the budget is spent where it makes a real difference.<\/p>","protected":false},"excerpt":{"rendered":"<p><!-- wp:paragraph --><\/p>\n<p>Incrementality testing helps companies find out what additional value their marketing actually creates. Instead of just looking at clicks and conversions, it measures whether an effort actually moves results. <\/p>\n<p><!-- \/wp:paragraph --><\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_seopress_robots_primary_cat":"","_seopress_titles_title":"Hvad er incrementality testing i marketing?","_seopress_titles_desc":"L\u00e6r hvad incrementality testing er, og hvordan metoden m\u00e5ler den reelle effekt af marketing og afsl\u00f8rer, hvad der faktisk skaber meroms\u00e6tning.","_seopress_robots_index":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-13650","post","type-post","status-publish","format-standard","hentry","category-marketingordbog"],"acf":[],"_links":{"self":[{"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/posts\/13650","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/comments?post=13650"}],"version-history":[{"count":1,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/posts\/13650\/revisions"}],"predecessor-version":[{"id":13773,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/posts\/13650\/revisions\/13773"}],"wp:attachment":[{"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/media?parent=13650"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/categories?post=13650"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/siite.dk\/en\/wp-json\/wp\/v2\/tags?post=13650"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}