Observational DiD Case Study · Single European Store

Case Study “Project D”: +26.6% Conversion Value & +16.5% ROAS in Google Shopping

47-day seasonally adjusted Difference-in-Differences study of Karsa.ai predictive segmentation vs. a concurrent Performance Max baseline in Europe.

Direct Answer · Key Summary

In a 47-day production study (“Project D”) on a European online store catalog, Karsa.ai managed Google Standard Shopping across 4 predictive cluster campaigns while a concurrent Performance Max campaign on the same catalog served as the baseline. Adjusted for both the concurrent PMax baseline and the identical prior-year calendar-window differential, Karsa.ai delivered +26.6% conversion value, +18.2% conversions, +16.5% ROAS, and +36.4% indicative profit after ad spend (at 40% margin).

+26.6%
Conversion Value
Net DiD lift vs. concurrent PMax control group, adjusted for prior-year seasonality.
+18.2%
Conversions
More completed orders from fewer clicks (−17.8% clicks vs. control).
+16.5%
ROAS
Higher conversion value relative to cost (+8.6% ad spend).
+36.4%
Profit After Ad Spend
Indicative profit after ad spend calculated at a 40% product margin.
Difference-in-Differences (DiD) Evaluation · Project D (47 Days) Control Group: Concurrent PMax · Deseasonalized

47-day Difference-in-Differences results: 4 Karsa.ai Shopping clusters vs. concurrent PMax control, adjusted for prior-year seasonality.

47-day production Difference-in-Differences comparison. Google Standard Shopping managed in 4 Karsa.ai clusters is compared with a concurrent Performance Max campaign on the same European online store catalog. Results are deseasonalized against the identical calendar days of the prior year.
Metric Shopping
with Karsa.ai vs. pre
PMax Control
same catalog
Active Diff
Shopping vs. PMax
Prior-Year Season
same days, no Karsa.ai
Karsa.ai DiD Lift
deseasonalized
Impressions +8.2% +1.1% +7.0% +11.1% −3.7%
Clicks +1.4% +33.7% −24.2% −7.8% −17.8%
CTR −6.3% +32.3% −29.1% −17.0% −14.6%
Ad Spend (Cost) +20.6% +20.1% +0.4% −7.6% +8.6%
Conversions +17.5% −15.9% +39.8% +18.2% +18.2%
Conversion Value +21.3% −2.6% +24.6% −1.6% +26.6%
ROAS +0.6% −18.9% +24.1% +6.5% +16.5%
Profit After Ad Spend (indicative at 40% margin) +21.9% −14.6% +42.7% +4.6% +36.4%
Weekly Shopping Conversion Value Index Active Season vs. Prior-Year Same Week
Active Shopping Prior-Year Same Week Karsa.ai Active (47 days)
Project D Weekly Google Shopping Conversion Value Index (Active Season vs. Prior-Year Baseline) During all six full weeks managed by Karsa.ai (W13 through W18), weekly Google Shopping conversion value index exceeded the identical calendar weeks of the prior year: W13 (134 vs 68), W14 (109 vs 74), W15 (80 vs 42), W16 (212 vs 92), W17 (177 vs 104), and W18 (189 vs 164); the 47-day window concludes with a 5-day partial week W19 (147 vs 314 full prior-year promo week). KARSA.AI ACTIVE (47 DAYS) W1W4W7W10W13W16W19W22
Active W1Karsa: 134Prior yr: 68
Active W2Karsa: 109Prior yr: 74
Active W3Karsa: 80Prior yr: 42
Active W4Karsa: 212Prior yr: 92
Active W5Karsa: 177Prior yr: 104
Active W6Karsa: 189Prior yr: 164
Active W7 (5d)Karsa: 147Prior yr (full wk): 314
Across all six full active weeks, Shopping conversion value exceeded the identical prior-year weeks (+26.6% full 47-day DiD lift).
View weekly conversion value index data table (47-day evaluation window)
Evaluation Week Active Shopping Index (Karsa.ai) Prior-Year Same Week Index
Active Week 1 (W13)13468
Active Week 2 (W14)10974
Active Week 3 (W15)8042
Active Week 4 (W16)21292
Active Week 5 (W17)177104
Active Week 6 (W18)189164
Active Week 7 (W19, 5-day partial)147314 (full prior-year promo week)

Why naive "Before vs. After" PPC case studies mislead marketers

In retail Google Ads, comparing a post-launch window against a preceding baseline without a concurrent control mixes three forces together:

  1. Macro demand & auction shifts (competitor bidding, consumer demand, CPC inflation).
  2. Store-specific calendar seasonality (category demand shifting across consecutive weeks).
  3. The campaign intervention (predictive product segmentation).

To measure the production effect of Karsa.ai on Google Shopping revenue, Project D used a seasonally adjusted Difference-in-Differences (triple-difference) design on live Google Ads spend on a single European multi-thousand-SKU online store.

Experimental design of Project D

Study Parameter Specification
Store Profile Mid-to-large European online store with multi-thousand-SKU Merchant Center catalog
Treatment Arm Google Standard Shopping split into 4 dynamic Karsa.ai cluster campaigns via supplemental XML custom_label
Concurrent Baseline Arm Google Performance Max campaign running concurrently on the same catalog without Karsa.ai
Active Treatment Window 47 days of active cluster management (covering 6 full active weeks plus a 5-day partial Week 7)
Pre-Period Baseline Preceding baseline window directly prior to cluster activation
Prior-Year Seasonal Control Identical pre-period and 47-day calendar windows in the prior year (zero Karsa.ai involvement)

Multiplicative seasonally adjusted Difference-in-Differences calculation

For each metric (Impressions, Clicks, CTR, Cost, Conversions, Conversion Value, ROAS, and Indicative Profit at a 40% product margin), let R_Shop_Study denote the post-vs-pre ratio of Google Shopping with Karsa.ai during the study period, and R_PMax_Study denote the post-vs-pre ratio of the concurrent PMax baseline:

  1. Active-Period Relative Differential (Shopping vs. Concurrent PMax): Diff_Study = (R_Shop_Study / R_PMax_Study) − 1 For Conversion Value: 1.213 / 0.974 − 1 = +24.6%.
  2. Prior-Year Seasonal Differential (Same Calendar Window, No Karsa.ai): Diff_PriorYear = (R_Shop_PriorYear / R_PMax_PriorYear) − 1 For Conversion Value: −1.6%.
  3. Net Seasonally Adjusted DiD Estimate: DiD_Karsa = ((1 + Diff_Study) / (1 + Diff_PriorYear)) − 1 For Conversion Value: 1.246 / 0.984 − 1 = +26.6%.

Mechanism breakdown: higher CPC in better auctions, higher conversion value

Inspecting cost, clicks, and conversions together clarifies the economic mechanism:

  • Clicks fell (−17.8% DiD) and CTR fell (−14.6% DiD) relative to the unsegmented PMax campaign, which expanded into +33.7% more low-converting clicks (−15.9% fewer conversions).
  • Ad spend rose +8.6% DiD across −17.8% fewer clicks (implying roughly +32% higher average CPC): isolating weak SKUs stopped cheap, zero-return clicks and concentrated budget on competitive product auctions with stronger purchase intent.
  • Completed orders rose +18.2% and conversion value rose +26.6%, more than paying for the higher CPC and lifting DiD-adjusted ROAS by +16.5%.
  • In all 6 full active weeks of Karsa.ai management (Weeks 1–6), weekly Shopping conversion value exceeded the identical calendar week of the prior year (134 vs 68, 109 vs 74, 80 vs 42, 212 vs 92, 177 vs 104, 189 vs 164). The 47-day DiD summary (+26.6%) includes the entire 47-day evaluation window, including the final 5-day partial Week 7 (147 vs 314 during a prior-year promotional spike, which the concurrent PMax + prior-year DiD control accounts for directly).

Scope conditions and methodological limitations

  1. Single-store observational DiD: Project D reports live production data from one store rather than a multi-merchant randomized trial. That is why every Karsa.ai onboarding lets you inspect your store’s clusters in the Portal first (with zero account changes until you map the supplemental feed) and evaluate live performance during a 30-day free trial.
  2. Cross-campaign auction interaction & campaign format: Because segmented Standard Shopping and unsegmented Performance Max ran concurrently inside the same Google Ads account on the same catalog, auction spillover between the two campaigns cannot be fully separated without a geographic holdout split, and the active-period contrast reflects segmented Standard Shopping versus unsegmented PMax (controlled against the prior-year Shopping-vs-PMax baseline). Notice that even in raw post-vs-pre terms before subtracting PMax, Shopping conversion value grew +21.3% (+17.5% conversions).
  3. Indicative profit row (+36.4%): Calculated at a standardized 40% gross product margin (0.40 × Conversion Value − Ad Spend) to show net contribution sensitivity; store-level profit depends on each store’s actual gross margin.
  4. Minimum conversion volume: Multi-cluster segmentation requires at least ~30 conversions per 30 days in each active cluster (~100+ monthly conversions for a 3-cluster setup, with 600+ monthly orders / 20+ daily orders recommended for 4–8 clusters); stores below ~100 monthly Google Ads conversions should remain in one consolidated campaign.

Frequently asked questions

Why did Project D combine a concurrent PMax baseline with a prior-year calendar-window comparison?

Simple before-and-after e-commerce case studies confuse seasonal demand shifts with software lift. Subtracting both the concurrent PMax change and the prior-year Shopping-vs-PMax differential over the identical calendar window (a seasonally adjusted DiD / triple-difference estimator) removes store-wide demand swings and recurring seasonal differences between campaign types.

Why did clicks decrease by 17.8% while spend rose by 8.6% and conversion value rose by 26.6%?

Suppressing low-intent SKUs in C0/C1 cut non-converting clicks, while shifting daily budget to top predicted clusters allowed Smart Bidding to win higher-intent product auctions at a roughly 32% higher average CPC — raising conversion rate and average order value enough to increase net ROAS by 16.5%.

Start a 30-day free trial of Karsa.ai with your own product feed.

Connect your product XML feed and read-only Google Ads access, review your clusters in the Karsa.ai Portal, and run live for 30 days.

Try for free Book a demo
30-day free trial · Merchant Center supplemental feed (custom_label) · 0% commission on ad spend