Insight
A collection of 7 posts

Why Web Retrievability Is Critical for AI-Powered Search
A concept called Retrieval-Augmented Generation (RAG) has become of critical importance is critical to how AI agents find information online.
· Stephen Young

When AI Agents Struggle to Understand: The Semantic Hurdles on Modern Websites
Even when technical access is permitted, a range of semantic hurdles can limit an AI agent's ability to extract meaningful information.
· Stephen Young

Digital Barriers That AI Agents Encounter When Accessing Websites
Understanding the Infrastructure That Shapes AI Accessibility.
· Stephen Young

Invisible Barriers: Why Some Web Pages Fall Behind in AI Search Rankings
As AI agents increasingly perform search-based tasks on behalf of users - whether to compare products, gather insights, or evaluate services - their ability to access and navigate web pages has become critical.
· Stephen Young

How AI Agents Re-Rank Search Results to Suit Each Task
The rise of AI agents that use the web to answer questions or complete tasks is quietly changing how search results are processed. Unlike a human who might click the first promising link, AI agents collect, sort, and re-evaluate many web pages before they present a response.
· Stephen Young

How AI Agents Rewrite User Queries Before Searching the Web
When AI agents perform searches on the internet, they do not rely solely on the user’s original input. Instead, they rewrite or reshape the query to improve the relevance and usefulness of the results.
· Stephen Young

Understanding the Agentic Web: A New Frontier for Online Interaction
The nature of web interaction is changing. For decades, websites have been built for people using keyboards, mice, and touchscreens. But increasingly, autonomous software agents are becoming the primary users of the web.
· Stephen Young