Google Ads

Pre-Post Analysis

Also called before and after analysis, pre/post comparison, before-and-after test

Comparing performance in a period before a change with a period after it, to judge whether the change made a difference.

Quick facts: Pre-Post Analysis

Category
Google Ads
Also called
before and after analysis, pre/post comparison, before-and-after test
Level
Intermediate
Affects
How changes are judged, budget and bid decisions, reporting accuracy
Where to see it
Google Ads compare date ranges, change history, Auction Insights, GA4 date comparison
In this article4
  1. How pre-post analysis works
  2. Why it matters
  3. Common mistakes
  4. How to act on it

A pre-post analysis compares performance in a period before a change with a period after it, to judge whether the change made a difference. In Google Ads it is the most common way people evaluate a new bid strategy, a landing page, a match type switch or a budget increase.

How pre-post analysis works

You pick the date the change went live, choose a window of equal length on each side, and compare the metrics that matter: conversions, cost per conversion, conversion value, click-through rate. Google Ads makes this easy with its compare date ranges option, and the change history shows exactly when each edit was made.

A fair comparison needs a few rules:

  • Equal and whole weeks. Compare 28 days with 28 days, starting on the same weekday, because most businesses behave differently at weekends.
  • Skip the settling period. Bid strategies and new campaigns go through a learning phase; leave the first week or two out of the “after” window.
  • Allow for conversion lag. If people take a week to enquire after clicking, the most recent days under-report. Wait until the lag has passed before reading the “after” period.
  • Change one thing. If you changed bids, ads and the landing page in the same week, the analysis cannot tell you which one mattered.

Why it matters

Most small accounts cannot run formal tests on every decision, so before-and-after comparisons are often the only evidence available. Used carefully, they catch obvious failures quickly. Used carelessly, they credit or blame a change for something that would have happened anyway.

The biggest trap in the UK is the calendar. Seasonality moves demand constantly: bank holidays, Easter on a different date each year, school holidays, the January sales, Black Friday, payday at the end of the month and, for some sectors, the end of the tax year. A change made in late November will look brilliant for a retailer and poor for a wedding venue, regardless of what the change did.

Tracking changes cause the same problem. If a new conversion action was added, consent settings changed or a tag broke during either window, the comparison measures the tracking rather than the campaign. Check the conversion setup was identical across both periods before trusting the numbers.

Common mistakes

  • Comparing windows of different lengths, or a period containing a bank holiday with one that does not.
  • Reading results during the learning period and reversing the change too early.
  • Ignoring wider market shifts. A competitor leaving the auction, or a news story, can move results more than your change did.
  • Making several changes at once and attributing the result to the one you hoped would work.
  • Treating a small difference on a handful of conversions as proof. Ten conversions against twelve is noise.

How to act on it

Strengthen the comparison with a control. If you changed some campaigns and not others, compare how both groups moved over the same dates; if the untouched campaigns rose by a similar amount, the market moved, not your change. Check the same weeks last year for seasonal patterns, and look at Auction Insights for changes in competition.

For decisions that matter, use a proper test instead. A campaign experiment splits traffic between the old and new versions at the same time, and a geo experiment compares matched regions, which gets closer to true incrementality. Keep a dated log of every change so later analysis has something to work from. Building that discipline into the account is part of my PPC management service.

Do and do not

Do

  • Compare equal whole weeks
  • Exclude the learning period and allow for conversion lag
  • Use untouched campaigns as a control

Do not

  • Compare periods with different bank holidays
  • Make several changes at once
  • Treat small differences as proof

Questions people ask about this

How long should the before and after periods be?

Long enough to include several full weeks and enough conversions to see a real difference, which for many small accounts means four weeks each side or more. Shorter windows are fine for high-volume accounts. Always use whole weeks and leave out the learning period after the change.

Is a pre-post analysis as good as an A/B test?

No. A test runs both versions at the same time, so seasonality and market changes affect both equally. A before-and-after comparison cannot rule those out, only reduce them with care. Use it for quick checks and use an experiment for decisions that carry real cost. See A/B testing for how a controlled test is set up.

What should I compare if my conversions are very low?

Look at earlier signals as well as conversions: click-through rate, cost per click, the quality of search terms and the share of enquiries that are genuine. Extend the windows until there are enough conversions to compare, and avoid drawing firm conclusions from a difference of one or two. Year-on-year checks help show whether the movement is seasonal.

Related terms

Found this useful?

Share it, or ask an AI to summarise it

Back to the glossary

Knowing the term is the easy part

Applying it to your own site and budget is the work. Book a call and I will tell you what actually applies to you.