How Top SEO Agencies Research Topics That Rank: A Behind-the-Scenes Look

By SoloAgent · 12 min read

Every B2B founder knows they need SEO content to generate leads. But the difference between content that ranks on page one and content that languishes on page five is decided before a single word is written. It is decided during topic research — the systematic process by which top agencies identify which subjects to cover, which angles to take, and which keywords to target.

Most businesses skip this step. They pick a topic based on a hunch, hand it to a writer, and hope Google rewards them. Meanwhile, agencies that consistently rank content follow a repeatable research methodology that removes guesswork. This post explains exactly how they do it — covering SERP analysis, keyword clustering, content gap analysis, topic modeling, and entity optimisation.

Whether you run an agency, manage content for a SaaS company, or evaluate how agencies research SEO topics to decide whether to outsource, the frameworks below will change how you think about topic selection.

The Topic Research Stack: What Agencies Use

Before diving into methodology, it helps to understand the tooling. Top SEO agencies do not rely on a single keyword tool. They build a research stack that covers four layers:

The specific tools vary by agency, but the stack covers these four functions. An agency that skips any of these layers produces topic research that is incomplete — and the resulting content will underperform as a result. Understanding how agencies research SEO topics means understanding how these four layers work together.

Layer 1: SERP Analysis — Reading What Google Already Ranks

The single most important skill in topic research is the ability to read a search engine results page like a diagnostic report. Every SERP tells you exactly what Google believes a searcher wants. Top agencies do not guess; they reverse-engineer the SERP.

Identifying Search Intent

Before evaluating any keyword, an experienced researcher classifies the dominant search intent for that query. The four intent categories are:

Agencies determine intent by scanning the top 10 results. If the SERP shows blog posts, listicles, and guides, the intent is informational. If it shows product pages and comparison tables, the intent is commercial. Attempting to rank a transactional page for an informational query is one of the most common — and most expensive — mistakes businesses make.

SERP Feature Analysis

Top agencies also analyse which SERP features appear for a given query:

A thorough SERP analysis usually takes 30 to 60 minutes per target keyword. That might seem like a lot of time before writing begins, but it is the difference between creating content that competes and content that disappears. This is a core reason how agencies research SEO topics differs from how most companies do it — agencies invest the time upfront.

Every SERP is a blueprint. Agencies that read it carefully can build content that matches exactly what Google and searchers want. Agencies that skip this step are building blind.

Layer 2: Keyword Clustering — Moving Beyond Single Keywords

Beginner-level SEO picks one keyword per article. Agency-level SEO builds topic clusters that group dozens of related keywords into a single piece of comprehensive content.

Why Clustering Works

Google's ranking algorithm has moved from keyword matching to semantic understanding. The Hummingbird update (2013), RankBrain (2015), and BERT (2019) all pushed Google toward understanding the meaning behind a query rather than matching exact words. As a result, a single well-optimised article can rank for hundreds of related long-tail queries if it covers a topic comprehensively.

Keyword clustering is the practice of grouping semantically related keywords and mapping them to a single piece of content. For example, an article targeting "how agencies research SEO topics" would also target:

Each of these becomes an H2 or H3 section within the same article. The article ranks for the primary keyword because of topical authority, and it captures long-tail traffic because of comprehensive coverage.

How Agencies Build Clusters

The process looks roughly like this:

  1. Seed keyword collection — Start with 3 to 5 seed topics relevant to your domain.
  2. Keyword expansion — Use Ahrefs or Semrush to extract all keywords where those seed terms appear. Filter by relevance and search volume.
  3. Grouping — Cluster keywords by theme using a tool like Keyword Insights or a manual spreadsheet. Keywords in the same cluster should share a common search intent.
  4. Priority scoring — Score each cluster by a combination of search volume, competition difficulty (KD), and business relevance. The cluster with the highest score becomes the next article topic.
  5. Brief creation — Map every keyword in the chosen cluster to a specific heading or paragraph in the article outline. This ensures the article targets the full cluster, not just the primary term.

This approach turns topic research from a one-dimensional keyword lookup into a strategic content planning exercise. It also explains how agencies research SEO topics at scale — they are not researching one topic at a time; they are building entire content libraries organised around clusters.

Layer 3: Content Gap Analysis — Finding What Competitors Miss

SERP analysis tells you what exists. Content gap analysis tells you what does not exist but should. This is where the most experienced agencies find their biggest opportunities.

The Gap Analysis Framework

Content gap analysis compares your existing content library (or your planned topic list) against what your competitors rank for. The gaps — keywords competitors rank for that you do not — represent opportunities. But the most sophisticated agencies go a step further.

Instead of just looking at missing keywords, they analyse the quality of competitor coverage for each topic. A gap exists not only when a keyword is absent but also when the existing coverage is shallow, outdated, or incomplete. This is the approach SoloAgent uses, and it is one of the key differentiators in how agencies research SEO topics for maximum impact.

The Three Types of Gaps

A mature gap analysis identifies three distinct opportunity types:

How to Run a Gap Analysis

The practical workflow used by top agencies is:

  1. Identify your top 5 to 10 competitors. These should be businesses that compete for the same search audience, even if they are not direct product competitors.
  2. Export their top-ranking content. Use Ahrefs or Semrush to pull the pages that drive the most organic traffic for each competitor.
  3. Categorise each page by topic cluster. Group competitor content into the same cluster taxonomy you use for your own content.
  4. Cross-reference against your content library. Mark which clusters you cover and which you do not. The uncovered clusters are your coverage gaps.
  5. Read the top-ranking articles in each uncovered cluster. Assess depth and angle. If all articles are shallow or take the same approach, you have identified a depth or angle gap worth pursuing.
  6. Validate with search volume. Confirm that the gap topics have sufficient search volume to justify the investment.

Agencies that perform this analysis before drafting every article consistently outperform those that pick topics based on intuition. This is the step most in-house teams skip — which is exactly why understanding how agencies research SEO topics gives you a competitive edge.

Layer 4: Topic Modeling — Structuring Content for Topical Authority

Once an agency has identified a topic cluster and confirmed the gap, the next step is topic modeling. This is the process of determining the ideal structure and coverage for a piece of content before writing begins.

What Topic Modeling Looks Like in Practice

Topic modeling uses NLP tools to analyse the top-ranking articles for a target keyword and identify the concepts, entities, and subtopics they all cover. The output is a list of "must-cover" topics that any comprehensive article on the subject should include. Think of it as the minimum viable coverage for a page-one ranking attempt.

For example, a topic model for "how agencies research SEO topics" would reveal that the top-ranking articles consistently cover:

If your article omits any of these subtopics, it is structurally incomplete relative to the competition. Topic modeling ensures your content covers everything Google expects — and then gives you a framework for adding unique value beyond the baseline.

Topic Modeling vs. Keyword Stuffing

It is important to distinguish topic modeling from the outdated practice of keyword stuffing. Topic modeling is about covering concepts and entities, not repeating exact-match phrases. Google's NLP models can detect whether an article thoroughly discusses a concept even if the exact keyword phrase does not appear frequently.

Agencies that understand this distinction write content that reads naturally for humans while still satisfying Google's semantic requirements. This is a hallmark of sophisticated topic research and a key part of how agencies research SEO topics at the highest level.

Tools for Topic Modeling

The main tools agencies use for topic modeling include:

Regardless of the tool, the output is the same: a structured outline that ensures comprehensive coverage and eliminates guesswork from the writing process.

Layer 5: Entity Optimisation — Speaking Google's Language

The most advanced topic research layer involves entity optimisation. Entities are specific people, places, things, or concepts that Google recognises as distinct objects. By optimising content around entities, agencies signal to Google that their content is authoritative on a specific subject.

How Entities Affect Rankings

Google's Knowledge Graph contains billions of entities and the relationships between them. When Google processes your article, it extracts the entities mentioned and cross-references them against the Knowledge Graph. Articles that mention the right entities in the right context are more likely to be considered authoritative on that topic.

For example, an article about SEO topic research should mention entities like:

Each of these entities reinforces the article's topical relevance. An article that uses the right entity vocabulary consistently outperforms an article that describes the same concepts in generic terms.

The Entity Optimisation Workflow

Top agencies incorporate entity optimisation into their topic research process as follows:

  1. Extract entities from top-ranking content — Use Google's Natural Language API or MarketMuse to identify the entities that appear in competing articles.
  2. Build an entity map — Group entities into categories (tools, concepts, people, companies, algorithms) and identify which are essential for coverage.
  3. Incorporate into the outline — Ensure each section of the article naturally incorporates relevant entities without forced insertion.
  4. Validate entity density — Check that your article mentions the same core entities as top-ranking content, ideally with greater depth or additional related entities.

Entity optimisation is the most technical layer of topic research, and it is the one that most clearly separates agency-grade content from amateur content. If you are evaluating how agencies research SEO topics, entity analysis is a strong signal that the agency understands modern search algorithms.

The Brief: Where Research Becomes Writing

All of the research layers described above converge into a single deliverable: the content brief. A proper content brief is not a one-line topic assignment. It is a comprehensive document that includes:

At SoloAgent, every article starts with a brief built from this exact research process. The brief is reviewed by both the researcher and the writer before drafting begins. This upfront investment is why we can deliver content that consistently outperforms generalist agencies — and it is a direct answer to the question of how agencies research SEO topics at a professional level.

The brief is where the research stops and the writing starts. A weak brief guarantees weak content no matter how talented the writer.

Common Mistakes Agencies Avoid (and Why You Should Too)

Understanding the mistakes that experienced agencies avoid is just as valuable as understanding their processes. Here are the most common topic research errors and how to sidestep them.

Mistake 1: Targeting Head Terms Only

High-volume head terms (e.g., "SEO content") are intensely competitive and often too broad to satisfy specific search intent. Agencies prioritise long-tail keywords with lower volume but higher conversion potential because the searcher's intent is clearer. An article about "how agencies research SEO topics for B2B SaaS" will convert better than an article about "SEO research" even though the latter has higher search volume.

Mistake 2: Ignoring the SERP Layout

Many content creators choose a topic, research keywords, and write an article without ever looking at the actual SERP. This is fatal. The SERP tells you what format Google prefers, what questions searchers are asking, and what features to target. Ignoring it means writing in a vacuum.

Mistake 3: Writing for Keywords Instead of Topics

Keyword-focused content optimises for exact-match phrases at the expense of comprehensive coverage. Topic-focused content covers a subject thoroughly and naturally ranks for hundreds of related keywords. The shift from keywords to topics is one of the defining characteristics of modern SEO, and agencies that fail to make this shift produce content that underperforms.

Mistake 4: Relying on a Single Data Source

No single keyword tool has perfect data. Ahrefs might show different search volumes than Semrush, and Google Search Console shows different click-through rates than either. Top agencies triangulate across multiple sources to validate topic demand and avoid making decisions on faulty data.

Mistake 5: Skipping the Competition Analysis

It is tempting to pick a topic based on keyword data alone and start writing immediately. But without understanding what competitors have already published, you cannot differentiate your content. The result is a me-too article that offers nothing new and struggles to rank.

How SoloAgent Approaches Topic Research

At SoloAgent, we do not treat topic research as a pre-writing step. It is a standalone service that feeds into everything we produce. When we work with a client, the research process looks like this:

This process is why SoloAgent's content consistently outranks content produced by generalist agencies. We invest the research time upfront so that every article has a structural advantage before a single paragraph is written. If you want to understand how agencies research SEO topics at a production level, this is the blueprint.

Measuring Topic Research ROI

Does all this research actually move the needle? The data suggests it does. In our experience, articles produced from a full research process (SERP analysis + clustering + gap analysis + topic modeling + entity optimisation) consistently outperform articles produced from a keyword-only brief by measurable margins:

These numbers reflect the difference between writing content and engineering content. Topic research is the engineering phase — it determines whether the content will work before anyone writes a word.

If you are a SaaS founder or marketing leader evaluating content agencies, ask them to walk you through their topic research process. If they cannot articulate a clear methodology — SERP analysis, clustering, gap analysis, topic modeling, entity optimisation — they are not using the approach that produces ranking content. And you now know exactly what to look for.

Ready to Put This Research Into Practice?

Understanding how agencies research SEO topics is the first step. The second is finding a partner who executes this methodology consistently. SoloAgent builds every article on the research framework described above — SERP analysis, keyword clustering, content gap analysis, topic modeling, and entity optimisation — before a single word is written.

We offer a no-risk trial: one article, written to your specifications, using the full research process, at no cost. Claim your free trial here and see what happens when topic research meets expert writing.

Related Articles