What NLWeb is
NLWeb is a set of open protocols and tools that lets you ask a website a question in natural language and get a structured answer. Microsoft positions it as the HTML of the agentic web: a common way for a site to talk both to people and to AI agents. It builds on data the site already has: Schema.org markup and RSS feeds. The authors stress that the code in the repository is an example implementation, not the only correct one.
How it works
- The site loads its structured data — products, recipes, events, reviews — into a vector store.
- A user or an agent asks a question, for example “lightweight two-person tent under 3 kg”.
- NLWeb finds matching objects through semantic search, and an LLM composes the answer.
- The answer arrives as JSON: a list of Schema.org objects with a name, a URL, a relevance score and a description.
| Mode | What it returns |
|---|---|
list |
A list of the most relevant objects (the default mode) |
summarize |
The list plus a short summary |
generate |
An LLM answer to the question based on the objects found, as in classic RAG |
The /ask endpoint serves the site’s conversational interface, and /mcp serves agents over MCP. The project works with a range of LLMs (OpenAI, Gemini, Anthropic, DeepSeek and others) and vector databases.
NLWeb and other ways to open a site to agents
| Approach | What it gives the agent | Effort for the store |
|---|---|---|
| Schema.org | Structured data on the pages | Marking up templates |
| llms.txt | A Markdown map of key pages | One file |
| NLWeb | Natural-language questions answered from the catalogue, plus MCP | Deploying a service and an index |
| Your own MCP server | Any tools: search, basket, order | Development and maintenance |
What it means for a retailer
- Markup matters again. The accuracy of NLWeb answers depends directly on how complete your Product markup is: price, availability, brand, specifications.
- Two channels from one base. The same index powers natural-language search for shoppers and MCP access for agents.
- Data freshness. According to the project description, production deployments connect NLWeb to live databases rather than a copy of the content — otherwise prices and availability go stale.
- Status. As of September 2026 NLWeb is an open project, not a mandatory standard; a sensible start is a pilot within your agent-readiness plan.