Understanding the true impact of your marketing efforts is crucial for any business looking to grow. At AISearch Marketing, we know that simply tracking conversions isn’t enough; you need to know which of those conversions were caused by your marketing, and which would have happened anyway. That’s where Incrementality Testing comes in.
What is Incrementality Testing?
Incrementality Testing is a sophisticated marketing measurement methodology designed to uncover the true causal impact of a marketing campaign or channel. Instead of just showing you correlations (what happened after your campaign), it isolates the net new effect – the “incremental lift” – that your marketing activity generated above and beyond organic or baseline activity.
Think of it this way: if a customer would have bought your product regardless of seeing your ad, that conversion isn’t truly incremental to your marketing efforts. Incrementality Testing helps you identify and quantify only those conversions that your marketing genuinely caused. This is a critical distinction, especially in today’s complex digital landscape where platforms like Google and Meta advocate for these rigorous measurement practices.
At AISearch Marketing, our approach to performance measurement is built on this principle. We move beyond simplistic attribution models to help our clients understand the real value of their marketing spend. For instance, in our Done-for-you Lead Gen retainer, we embed server-side tracking and robust measurement frameworks, like those used for clients such as CapEx and Gerrard’s, to ensure we’re not just reporting on activity, but on genuine incremental growth. This means you’re seeing the leads that wouldn’t have landed in your CRM without our intervention.
Why Incrementality Testing Matters
Incrementality Testing matters because it provides the most accurate understanding of your marketing campaign’s true value. Without it, businesses risk misattributing success, overestimating campaign effectiveness, and ultimately making inefficient budget allocation decisions. A 2023 study by Nielsen, for example, highlighted that brands often overspend by 15-30% on campaigns that appear effective but lack true incremental lift.
For our clients – sales-led, growth-motivated NZ specialist firms like mortgage brokers and tax advisers – this isn’t just an academic exercise. It directly impacts their ROI and ability to scale. In a market where every lead counts, and where buyers increasingly research and ask AI before they call, knowing which marketing activities genuinely drive new conversions is paramount. Our core differentiator is providing “AI-native lead-generation systems the client owns — operator-proven, pre-qualified, and honestly tracked.” This honest tracking is only possible through incrementality.
By identifying which marketing activities genuinely drive new conversions, our clients can optimize their strategies, reallocate budgets to higher-performing channels, and achieve a superior Return on Investment. This rigorous approach ensures every marketing dollar contributes to measurable growth rather than simply capturing existing demand. For a mortgage broker, for instance, knowing that a specific campaign generated an extra 1-2 settlements per month (which can cover our retainer at the low end) is the difference between guessing and truly scaling their business.
Common Misconceptions About Incrementality Testing
There are a few common misunderstandings about Incrementality Testing:
- Misconception: Incrementality testing is the same as A/B testing.
- Reality: While both involve control and test groups, A/B testing typically compares two variations of a marketing element (e.g., two ad creatives) to see which performs better. Incrementality Testing, however, measures the net new impact of a marketing activity that would not have occurred otherwise. It’s about whether the activity itself drives new outcomes, not just which version of the activity performs best.
- Misconception: Incrementality testing is too complex and expensive for most businesses.
- Reality: While sophisticated methods exist, simpler approaches like geo-testing (comparing performance in exposed vs. unexposed geographic regions) or holdout groups (a segment of your audience intentionally not exposed to a campaign) can be implemented by many businesses. At AISearch Marketing, we integrate these practical, actionable testing methodologies into our Done-for-you Lead Gen retainers. We leverage tools and techniques that are accessible and provide valuable insights without requiring enterprise-level budgets, ensuring our clients can gain clarity on their marketing spend.
- Misconception: High ROAS (Return on Ad Spend) always means high incrementality.
- Reality: A high ROAS can sometimes be inflated by capturing existing demand or conversions that would have happened organically. For example, a campaign might show a great ROAS because it’s reaching people who were already going to convert. Incrementality Testing reveals the true additional value, ensuring you’re not just paying for conversions you would have received for free. This is why we focus on delivering “exclusive, pre-qualified pipeline on your own channels and data” – we want to prove that the pipeline we deliver is genuinely new.
Incrementality Testing in Practice
Let’s look at a practical example, similar to how we might advise a client like a mortgage broker.
Imagine ‘BrokerCo,’ a New Zealand mortgage brokerage, launches a new campaign to generate leads for first-home buyers. Instead of simply measuring the leads attributed to the campaign via Last-Touch Attribution, BrokerCo implements an incrementality test using a geo-holdout strategy.
They identify 10 geographically distinct regions in NZ with similar demographics and historical first-home buyer activity. Five regions are designated as the test group, exposed to the new campaign, while the other five serve as the control group, receiving no exposure to this specific campaign.
Over a four-week period, the test group shows 1,500 new first-home buyer enquiries, while the control group shows 1,000 enquiries. The incremental lift is calculated as 500 enquiries (1,500 - 1,000). If the campaign cost $5,000 and the average profit per settled mortgage is, say, $4,000, and 10% of those incremental enquiries convert, that’s 50 new settlements. That results in $200,000 in incremental profit (50 * $4,000), demonstrating a clear incremental ROI of 3900% (($200,000 - $5,000) / $5,000).
This rigorous approach, which we apply to our clients like Wilsons (FHB campaign) and CapEx, allows BrokerCo to confidently scale the campaign, knowing it genuinely generated 500 new enquiries that led to 50 new settlements, rather than just influencing existing demand. This data-driven clarity is precisely what our Done-for-you Lead Gen service provides, ensuring every marketing dollar directly contributes to your firm’s measurable growth.
- 01What is Incrementality Testing?
- 02Why Incrementality Testing Matters
- 03Common Misconceptions About Incrementality Testing
- 04Incrementality Testing in Practice
- 05Related Terms