Finds it · ranks it · measures it

People who use your search were ready to buy.

Someone typing into a search box has already decided they want something and is telling you exactly what. On most sites they get an empty results page, or twelve items sorted by the date they were added, and they leave.

Better search is not about a clever model. It is about the boring failures: no tolerance for a typo, no idea that "torch" and "flashlight" are the same thing, no way to filter by the attribute that actually matters, and nobody at your company has ever looked at what people are searching for. That last one is usually the most valuable thing we hand over.

Drag left and right over the panel
ranking by hybriddrag to shift the weighting
TyposForgiven
IntentUnderstood
Zero resultsLogged, then fixed
UpliftMeasured, not claimed

Diagnosis

Six reasons your search box loses sales

None of these are exotic. They are the default behaviour of the search that shipped with your platform, and every one of them is fixable.

01

One typo, no results

Somebody types "recieve" or "safty" and gets nothing at all. On mobile, where most people are typing with a thumb on a moving bus, this is a large share of queries.

Fix: fuzzy matching with a sensible edit distance.

02

Your words, not theirs

Your catalogue says "torch". Half your customers say "flashlight". The database has no idea these are related, so the search returns nothing and the customer assumes you do not stock it.

Fix: synonyms, plus meaning-based matching.

03

Sorted by whatever

Results ordered by date added, or alphabetically, or by an internal ID. Relevance never enters into it, so the best match sits ninth and nobody scrolls.

Fix: a real relevance score, then business rules on top.

04

Descriptive queries fail

"Something to keep coffee hot on site" contains none of your product words. Keyword search cannot help, and the customer had told you precisely what they wanted.

Fix: semantic matching alongside keywords.

05

No useful filters

Four hundred results and no way to narrow by size, rating, availability or the one specification that decides the purchase. Faceting is table stakes and frequently absent.

Fix: facets built from real attribute data.

06

Nobody reads the logs

Your search box is the only place customers tell you, in their own words, what they want and cannot find. On most sites that data is collected by nobody and read by no one.

Fix: a weekly report of top queries and zero-result queries.

Interactive

Three kinds of search, same query

A small trade-supply catalogue, searched three ways at once. Type anything, or use one of the sample queries — each is chosen to break one of the three.

The lesson is not that meaning-based search wins. It is that each approach fails in a different direction: keyword search is exact and brittle, semantic search is flexible and vague about specifics like part numbers and certifications. Production systems run both and combine the scores.

try:
Keyword

Matches the letters people typed. Fast, exact, and completely defeated by a synonym or a typo.

Semantic

Matches what the query means. Handles description and intent, and gets vague about codes, sizes and certifications.

Hybrid

Both scores combined, then re-ranked. Slightly more to build and run, and it is what production systems actually do.

The stack

Search engines, not just models

Most of this problem was solved by search engineering long before language models existed. The models add meaning-matching on top of infrastructure that already handles ranking, faceting and speed at scale.

Search engines

Elasticsearch
OpenSearch
Algolia
Meilisearch
Apache Solr
Apache Lucene

Vector & analytical stores

Milvus
PostgreSQL + pgvector
Redis
ClickHouse
DuckDB
Vespa

Embeddings & language

OpenAI embeddings
Anthropic Claude
Google Gemini
Hugging Face
Ollama (self-hosted)
LangChain

Ranking & machine learning

PyTorch
scikit-learn
NumPy
pandas
Python
Apache Spark

Commerce platforms

Shopify
WooCommerce
Magento
BigCommerce
PrestaShop
WordPress

Content & front-end

Drupal
Contentful
Sanity
Next.js
Node.js
TypeScript

Interactive

"You might also like" is four different things

A customer is looking at a cordless impact driver. Here is what each recommendation strategy would put underneath it — and how each one goes wrong.

Most sites pick one strategy, wire it up once, and never look at it again. The useful version chooses per slot: complements on the product page, substitutes in search results, popularity on a cold home page. Which strategy sits where is a merchandising decision, and it should be measured rather than assumed.

currently viewing 18V cordless impact driverbasket emptyvisitor first visit

Applications

Six places this pays for itself

Ordered roughly by how quickly the difference shows up in the numbers.

Use 1 of 6
01 — Commerce

Product search that converts

Visitors who search convert at a markedly higher rate than those who browse, which makes the search box one of the highest-leverage surfaces on the site.

  • Typo and synonym handling
  • Facets from real attributes
  • Zero-result queries reported weekly

Usually the first thing we fix

02 — Catalogue

Large or technical inventories

Thousands of parts where customers know the application but not the part number. "Fits a 2019 model" is a query keyword search cannot answer and yours should.

  • Compatibility-aware matching
  • Exact codes still match exactly
  • Handles both novices and experts

Parts, industrial, wholesale

03 — Content

Site and knowledge search

Publishers, associations and service businesses whose archive is large, valuable and effectively unsearchable through the CMS default.

  • Passages, not just page titles
  • Respects access levels
  • Surfaces old material that still answers

Where the archive is the asset

04 — Merchandising

Rules on top of relevance

Promoting stocked items over backorders, margin-aware ordering, seasonal pinning — applied as deliberate rules rather than by fighting the ranking.

  • Business rules kept separate from relevance
  • Out-of-stock demoted, not hidden
  • Changes without a developer

Control without breaking search

05 — Discovery

Recommendations that fit the slot

Complements on the product page, alternatives in a dead-end search, popularity where nothing else is known — each chosen for the moment, not applied everywhere.

  • Different strategy per placement
  • Cold-start handled deliberately
  • Measured against a holdout group

Basket size, not just clicks

06 — Insight

What the search log tells you

The queries with no results are a product roadmap, a content plan and a merchandising brief, written by your customers, in their own words, for free.

  • Demand for things you do not stock
  • The vocabulary customers actually use
  • Seasonal shifts before they show in sales

Frequently the biggest surprise

Honesty

What to be sceptical about

Search and recommendation projects are unusually easy to declare successful without evidence. These are the traps.

01

Uplift claimed, not measured

Recommendations get credit for sales that would have happened anyway. Without a holdout group the reported lift is mostly attribution, and it is always flattering.

02

Popularity eats everything

Ranking by what already sells makes what already sells sell more. The long tail becomes invisible and the catalogue effectively shrinks.

03

Cold start is real

New products and new visitors have no behavioural data. A recommender that only learns from history will ignore your new range indefinitely unless it is designed not to.

04

Bad data, bad search

Missing attributes, inconsistent categories and copied-in manufacturer text limit results far more than the algorithm does. Search exposes data quality mercilessly.

05

Semantic search fumbles specifics

Part numbers, CSA certifications, exact dimensions. Meaning-based matching blurs precisely the details a technical buyer is filtering on, which is why hybrid exists.

06

Personalisation needs consent

Tracking behaviour to personalise carries privacy obligations, and the return is often smaller than the effort for catalogues under a certain size.

07

Latency is a feature

Search results must feel instant. A semantic layer that adds noticeable delay will be used less, and that cost rarely appears in the business case.

08

Creepy is a real risk

Recommendations that reveal too much inference about a person damage trust more than they lift revenue. Restraint is a design decision.

09

Sometimes it is just fixing search

A meaningful share of enquiries are solved by synonyms, typo tolerance and better facets on the existing engine — no AI involved, far less money.

Scope

What a search build includes

The query log audit comes first, because it usually rewrites the priorities.

01

Query log audit

What people actually search for, what returns nothing, and where they abandon. If no logging exists, adding it is the first task and often the most valuable.

02

Data assessment

Attribute completeness, category consistency and description quality across the catalogue — the ceiling on what any search can do.

03

Engine selection

Hosted or self-managed, decided on catalogue size, query volume, budget and who maintains it. Sometimes the existing engine is fine and only needs configuring.

04

Indexing pipeline

Keeping the index current as products, stock and prices change, without a nightly rebuild that leaves eight hours of stale results.

05

Relevance tuning

Field weights, synonyms, typo tolerance and hybrid blending, tuned against a set of real queries with known good answers.

06

Facets and filters

Built from genuine attributes, showing counts, and never leading a customer to a combination with zero results.

07

Recommendation slots

Deciding what appears where, which strategy drives each slot, and what happens when there is not enough data to fill it.

08

Measurement

Search conversion, zero-result rate, click position and recommendation lift against a holdout — set up before launch so there is a baseline.

09

Merchandising controls

A way for your team to pin, boost and bury without calling a developer, plus a record of who changed what.

Questions

Search and recommendations, answered

Do we need AI, or just better search?

Often just better search. Typo tolerance, synonyms, sensible field weighting and real facets fix the majority of complaints, cost far less, and add no latency.

Semantic matching earns its place when customers describe what they want rather than naming it — which is common in trade, technical and gift-buying catalogues, and rarer in others.

How big does our catalogue need to be?

Search matters from a few hundred items upward. Recommendations need enough behavioural data to learn from, which usually means meaningful traffic rather than a large catalogue.

Below that, hand-curated related products genuinely outperform a model, and we will say so.

Will it work with Shopify or WooCommerce?

Yes. Both expose the catalogue and both support replacing or augmenting the default search. The work is the indexing pipeline and the front-end, not the platform.

For very large catalogues an external search service is usually the right answer regardless of platform.

How do we know it actually helped?

By measuring against a baseline captured before launch, and for recommendations by holding back a percentage of visitors who see the old behaviour.

Without a holdout, any recommender looks successful, because it takes credit for purchases that were already going to happen.

Is personalisation a privacy problem?

It can be. Session-based recommendations using only the current visit need no profile and avoid most of the difficulty. Cross-visit personalisation involves storing behaviour, with the consent obligations that follow.

The return on the second is smaller than most vendors imply, so we tend to start with the first.

What about new products with no data?

Handled by attribute similarity rather than behaviour — a new item resembles existing items, so it can be recommended from day one and start gathering its own data.

Designing for this explicitly is the difference between a new range selling and sitting invisible for a quarter.

Can our team control what ranks?

Yes, and they should. Pinning, boosting, burying and seasonal rules belong in an interface your merchandisers use, kept separate from the relevance scoring underneath.

Mixing the two is how search quality quietly degrades over a year of well-intentioned tweaks.

How long does it take?

Fixing an existing engine — synonyms, typos, facets, logging — is often a matter of weeks. A hybrid semantic layer with a proper indexing pipeline is a longer project.

We would generally do the first, measure, and then decide together whether the second is justified.