Search visibility is usually lost quietly. A developer ships an update that adds a noindex tag to a template, a plugin rewrites the robots.txt file, or the sitemap stops refreshing, and nobody notices until enquiries fall a few weeks later. SEO automation is how I close that gap: scheduled crawls, Search Console exports and rank tracking that run on their own and tell the right person when something changes.
This page covers monitoring and data handling, not producing content or fixing the site. If the problems on your site still need finding and fixing, my technical SEO service is the place to start, and the monitoring can follow once the site is in a state worth protecting.
What changes when the checks run themselves
Checking SEO by hand normally means logging into Google Search Console, exporting a table, pasting it into a spreadsheet and comparing it with last month. It happens when someone remembers, and it stops when that person is busy or leaves.
After the setup, the same checks run on a timetable. Results land somewhere your team already looks, such as a Google Sheet, a dashboard, email or Slack. Alerts fire only when an agreed threshold is crossed, so a message means something needs a decision rather than being one more report to skim.
The gain is how quickly you find out. A section blocked by mistake and spotted the same day costs a developer an hour. Spotted a month later, Google may already have dropped those pages, and how fast they come back depends on when it next crawls them.
Who it suits, and who it does not
- In-house marketers at UK businesses who spend part of every week pulling Search Console and ranking data by hand.
- Owners of sites that change often, such as shops adding and removing products, or sites edited by several people, a developer and an agency.
- Businesses that have just moved or rebuilt their site and want early warning while Google settles, usually alongside website migration SEO support.
- Teams that already pay for a crawler or rank tracker but never read what it produces.
It does not suit a small brochure site that changes twice a year. A monthly look at Search Console is enough there, and I will say so on the call. It is also the wrong first step for a site with known, unfixed problems: alerts about issues everyone already knows about are noise.
What I set up
Scheduled crawls with change alerts
A crawler such as Screaming Frog runs on a schedule and each crawl is compared with the one before. You hear about what changed: pages newly marked noindex, canonical tags pointing somewhere new, pages that started returning errors, new redirect chains, missing or duplicated titles, and internal links to pages that no longer exist.
Search Console exports
The Search Console interface shows a maximum of 1,000 rows per table and keeps 16 months of performance data. Through its API, I export queries and pages on a schedule into Google Sheets or BigQuery, so you keep history beyond 16 months and can group results by page type, such as product pages against blog posts. The API does not export the page indexing report, so I add a daily URL Inspection API check on your most important pages, which flags any that Google says are not indexed before the fall shows up in traffic.
Rank tracking for the terms that matter
A rank tracker checks a fixed list of search terms from a set UK location, which for a local business can be a town or postcode rather than the whole country. I keep the list short and map each term to the page meant to rank for it, which also shows when two of your own pages start swapping places for the same term. Search Console’s average position blends every location and device, while a tracker gives a fixed viewpoint. You need both, and neither tells the whole story alone.
Watching the files that can switch a site off
Light checks every few hours on the handful of things that can remove a site from search in one edit: the robots.txt file, the XML sitemap, and the status code and robots tag on the homepage and your most important templates. If any of them changes, the alert shows the before and after.
One place to read it
Results go into a Looker Studio report or a shared Sheet, with alerts sent by email or Slack. A combined marketing dashboard that also pulls in ads, GA4 and CRM data is a separate piece of reporting automation work.
What I will not automate
Some SEO jobs look easy to automate and should still be done by a person.
- Pages generated at scale. I do not build systems that turn out hundreds of near-identical pages from a template or an AI model to catch keyword variations, such as one page per town for the same service. Google’s spam policies treat scaled content made mainly to rank as abuse, and these pages rarely help the person who lands on them.
- Titles and meta descriptions published unread. A tool can suggest them. Someone who knows the business should read them before they go live.
- Automatic internal links and redirects. Rules that add links or change redirects without review tend to create the loops and chains the monitoring is meant to catch.
- Bulk indexing requests. Google’s Indexing API is meant for job posting and livestream pages only. For everything else, a clean sitemap and good internal links do the job.
The rule I work to is simple: automation finds and reports, and a person decides what changes on the site.
How I run the work
- A short call. What you check now, how often, who acts on it and what has gone wrong before.
- Agree the checks. Which pages and templates matter most, what counts as an alert and who receives each one.
- Access. You add me as a user in Search Console and any other tool, with the lowest permission that does the job. I never need your password.
- Build and baseline. The first crawl and export become the baseline. I then adjust the thresholds as the first runs come in, so alerts stay rare and real.
- Handover. A walkthrough with whoever will receive the alerts, plus written notes on what each alert means and what to do about it.
Paid tools sit in your business’s name, not mine, so everything keeps running if we stop working together.
Common problems on UK sites
- A setting from the staging site carried over to the live one, such as WordPress’s “Discourage search engines” box left ticked, or a noindex tag left on after launch.
- Plugin or theme updates that quietly change canonical tags or strip out structured data.
- Sitemaps listing redirected, deleted or noindexed URLs, common on shops with a lot of discontinued products.
- Rank trackers checking hundreds of terms nobody acts on, often set to a national view when the business only serves one area.
- Search Console verified for only one version of the domain, so the data covers part of the site. A domain property covers every version at once.
If your site has already dropped out of search, my article on why a website is not showing on Google walks through the usual causes before any monitoring is worth setting up.
What you receive
- Scheduled crawls, exports and rank checks running in accounts you own.
- A baseline crawl and a record of what changed at each run.
- Search Console data stored outside Search Console, from the day of setup plus whatever history the API still holds.
- A short tracked keyword list, each term mapped to one page.
- A report or Sheet your team can read without me.
- An alert guide: what each alert means, how urgent it is and who should act.
Cost
Cost depends on how many checks, sites and tools are involved. Each quote is written after a free SEO audit or first call, in GBP, and agreed in writing before work starts. Any third-party tools, such as a crawler licence or a rank tracking subscription, are paid by you directly to the supplier. I tell you which ones you need before you buy anything, and where a free option is good enough.
Next step
Book a free 30-minute call and bring a list of the SEO checks you currently do by hand. I will tell you which are worth automating and which are not. If you would rather check the site yourself first, my SEO audit checklist covers the same ground the crawls watch, and you can also request a free SEO audit to see what needs fixing before anything is monitored.