Most keyword research stops at a list of high-volume terms exported from a tool. The site then spends a year chasing queries it was never going to rank for while the questions its customers actually ask go unanswered. The gap between "keywords with volume" and "keywords you can win" is where the opportunity lives.
This guide is a working process, not a tool tutorial: build a seed list, find what competitors rank for that you do not, mine long-tail and question queries, classify intent, judge difficulty against your real authority, cluster keywords into pages, and score them so the next thing you write is the best available bet. The same process works for publishers deciding what to write.
Build a seed list from real sources
Seeds are the short phrases that describe what you do. Tools expand them, so bad seeds produce bad lists. Sources:
- Google Search Console: the Performance report shows every query you already get impressions for. Queries in positions 8 to 30 are the cheapest wins you have.
- Sales and support: the phrases customers use in tickets, calls, and demo requests, which often differ from your internal vocabulary.
- Your navigation: every category, feature, and service is a seed.
- Competitor navigation: how the top three competitors organize their sites shows the categories the market recognizes.
Aim for 20 to 50 seeds and expand them in Google Keyword Planner (free with a Google Ads account) or a paid tool.
Expand the list
Run a competitor gap analysis
A gap analysis lists keywords where competitors rank and you do not. Most paid SEO tools have a report for it: enter your domain plus two to four competitors and filter to keywords where at least two of them rank in the top 20 and you are absent. A keyword only one competitor ranks for may be a fluke; one that several rank for is a topic the market expects you to cover.
Pick competitors similar in size and authority to you. A list built against the category leader is one you cannot act on; one built against a competitor a step ahead is.
Mine long-tail and question keywords
Long-tail queries are specific, lower-volume phrases: "best running shoes for flat feet wide toe box" rather than "running shoes." Individually small, they add up and convert well because the searcher knows what they want. Question keywords ("how do I," "what is the difference between") are worth separating out because they map directly to article titles and People Also Ask boxes. Sources:
- Type a seed into Google and record the autocomplete suggestions, then append each letter of the alphabet.
- Expand several People Also Ask questions and record the new ones that appear.
- Search Reddit and niche forums for the seed and note how people phrase problems.
- Filter your tool's export for modifiers like how, why, vs, best, cheap, near me, for beginners.
Classify search intent
Intent determines what type of page can rank. Search the keyword and look at what Google already rewards; the results are the only reliable signal. Give each keyword one primary intent.
| Intent | Typical modifiers | What ranks | Page to build |
|---|---|---|---|
| Informational | how to, what is, why, guide, examples | Articles, guides, videos | Blog post or resource page |
| Commercial investigation | best, top, vs, review, alternatives | Comparison and roundup articles | Comparison, review, or "best of" page |
| Transactional | buy, pricing, discount, near me, order | Product, service, and category pages | Product or landing page |
| Navigational | Brand or product names, login | The brand's own site | Nothing, unless it is your brand |
If the top ten split between guides and product pages, either type can compete, but pick one; hybrid pages lose to focused pages on both sides.
Judge difficulty against your real authority
Tool difficulty scores are estimates, usually derived from the backlink profiles of the pages currently ranking. They are useful for sorting but not a promise; two sites can have very different chances at the same score depending on their own authority and topical relevance.
A more honest check is to open the top ten results and compare them to your site: their Moz Domain Authority or Ahrefs Domain Rating (third-party scores on a 0 to 100 scale, not Google metrics) versus yours, referring domains to the ranking page, whether those pages are dedicated to the query or only mention it, and how comprehensive they are. If every result comes from far stronger sites with dedicated, well-linked pages, park the keyword until your authority grows. If several are weak, generic, or outdated, it is winnable regardless of the score. Our domain authority guide explains what those scores do and do not tell you.
Difficulty is relative. The right question is never "how hard is this keyword" but "how hard is it for a site like mine."
Cluster and prioritize
Cluster keywords into pages
One page can rank for many related keywords, and each keyword should have only one page targeting it. Clustering groups your list by which keywords share the same ranking pages. If "crm for small business" and "small business crm software" return mostly the same URLs, they are one cluster and one page. If "crm pricing" returns different pages, it needs its own page.
Do this manually for small lists or with a tool's clustering feature for large ones. The output is a page map: one row per page with its primary keyword, secondary keywords, and intent. It also prevents cannibalization, where two of your pages compete for one query and both rank worse than one would.
Score and prioritize
Then score each page candidate so the order is defensible:
- Volume: combined monthly searches for the cluster, scored 1 to 5.
- Intent value: how close the query is to a purchase or goal, scored 1 to 5 (transactional highest; publishers monetizing traffic invert this).
- Difficulty fit: how winnable the cluster is for your site, scored 1 to 5 using the authority check above.
Multiply the three. A cluster scoring 4 x 4 x 4 beats one scoring 5 x 5 x 1 because a keyword you cannot rank for has no value. Sort by score, work from the top, and rescore quarterly as your authority changes.
Analyze SERP features before committing
The result page shows how much traffic a ranking will deliver. Check for:
- AI Overviews: when a generated summary sits at the top, informational clicks tend to shrink. Favor queries the summary cannot fully answer, such as comparisons that depend on the reader's situation, or where users need a tool, template, or download.
- People Also Ask: adjacent questions to fold into the page as subheadings.
- Video carousels: if video dominates, a text page may sit below the fold; consider a video alongside the article.
- Shopping, maps, and ads: heavy commercial features push organic results down and signal transactional intent.
Keyword research for publishers
If you run a content site, the same process decides what to write, with two changes. Intent value flips: evergreen informational queries are worth more than transactional queries you cannot monetize. And topical consistency matters more, because advertisers and link buyers evaluate your site by niche. A site listed on BacklinkCAT, for instance, is categorized among 150+ niches and filtered by buyers on traffic and authority metrics, so a publisher focused on one subject is easier to find and trust than one chasing unrelated volume. See our guest posting guide for publishers.
Tools
Free: Google Search Console (your own queries and positions), Google Keyword Planner (expansion and volume ranges), Google Trends (seasonality), and Google autocomplete and People Also Ask (long-tail and questions).
Paid: Ahrefs, Semrush, and Moz Pro cover volume, difficulty scores, and competitor gap reports; check each tool's own documentation for specifics. One paid tool plus Search Console is enough for most sites.
Key takeaways
- Seed from Search Console, customers, and competitor navigation, not guesswork.
- Run a gap analysis against similar-sized competitors and keep keywords at least two of them rank for.
- Label intent from the actual results, then build the page type that already ranks.
- Check difficulty against your own authority, not just the tool's score.
- Cluster keywords into one page each, score by volume, intent, and fit, and work from the top.
- Check the result page for AI Overviews, video, and commercial features before committing.
This is slower than exporting a list, but it produces a plan you can execute. Pair it with a content strategy that turns the plan into rankings.
