The Answer Is Not to Hide From Google
The frightening version of the agentic-search story says that websites become raw material: models read them, users stay inside Google, and referrals shrink. That risk is real enough to change how developers should build, but it is not a reason to disappear from the index. Google's own AI-search guidance still routes AI Overviews and AI Mode through the Search index, retrieval systems, supporting links, crawlability, snippets, page quality, and visible content. In other words, the website is not obsolete. The weak website is obsolete.
The new role of a site is more demanding. It must be a canonical source that machines can quote responsibly, a human destination worth returning to directly, and an operational surface that agents can understand without guessing. A page that merely summarizes public information has little defense against answer engines. A page that contains original evidence, clear authorship, reusable data, working tools, strong images, and stable semantics has a reason to exist even when the search interface becomes more autonomous.
Treat every serious page as four assets at once: a human article, a structured data object, a feed item, and an evidence packet that can be cited, revisited, updated, and used by agents without breaking the reader experience.
Build a Source Layer, Not Commodity Posts
The first rule is brutal: stop publishing pages that can be fully recreated by a generic model. Google's generative-search documentation repeatedly points toward non-commodity content, original perspective, first-hand experience, strong organization, and high-quality supporting media. That is not a decorative content slogan. It is an architectural constraint. If the site has no original observation, no dataset, no test, no method, no named author, and no reason for a reader to trust it directly, an AI answer layer can compress it into one paragraph and the loss is barely visible.
For a media network, this means every article should carry at least one durable proprietary element. That can be a benchmark table, an interview, a teardown, a timeline, a visual model, a code sample, a pricing archive, a methodology box, or a strong editorial synthesis that is clearly tied to the author's expertise. The page should not only say what happened. It should show how the conclusion was reached.
- For reviews, publish test conditions, raw notes, screenshots, and limitations.
- For news analysis, preserve timelines, primary sources, and what changed since the last update.
- For tutorials, include runnable examples, failure modes, and maintenance notes.
- For market coverage, keep historical snapshots that are useful months later.
Expose the Machine-Readable Surface
There is no magic AI schema that guarantees inclusion in AI Overviews or AI Mode. Google says the fundamentals still matter: the page must be indexable, crawlable, eligible for snippets, internally linked, fast enough, readable as text, supported by relevant images or video, and represented honestly by structured data. Developers should interpret that as a boring but powerful stack: clean URLs, canonical tags, XML sitemaps, RSS, News sitemap where appropriate, Article JSON-LD, Breadcrumb JSON-LD, author pages, organization data, and visible source lists.
The important part is consistency. Structured data must describe what the user can actually see. Author links must resolve. Images used in metadata must be crawlable and relevant. Dates should change only when the content changes substantially. Internal links should create a graph that explains the site, not a maze of isolated posts. This is how a media site becomes legible to Search, Discover, AI features, RSS readers, and future agents at the same time.
The Page Should Work Without JavaScript Tricks
Google can process JavaScript, but developer guidance is still clear that important content should be visible in the DOM and expressed in text form. The same principle becomes more important for agents. If the core answer is hidden behind canvas rendering, unstable client-side state, hover-only controls, or decorative text generated by CSS, both crawlers and agents have to infer meaning from weak signals. That is unnecessary risk.
Design for Agents, Not Only for Browsers
The next visitor to a site may not be a person scrolling with a mouse. It may be an agent using screenshots, raw HTML, and the accessibility tree. This changes frontend priorities. Pretty motion and clever div-based controls are less valuable than stable layout, visible action states, real buttons, real links, labels connected to inputs, predictable forms, and interactions that expose their intent through semantic HTML.
For developers, agent-friendly design is not separate from accessibility. It is accessibility becoming infrastructure. A clean accessibility tree is a map for screen readers and for agents. A stable layout helps human users and screenshot-based AI systems. An anchor that says where it goes is more useful than a generic card with an onclick handler. A form field with a real label is easier for everyone to understand.
- Use
aelements for navigation andbuttonelements for actions. - Keep labels, names, roles, states, and errors visible to assistive technology.
- Avoid transparent overlays and ghost elements that cover real controls.
- Make critical actions visually obvious and structurally obvious in the DOM.
- Keep layout stable during loading, filtering, pagination, and personalization.
Turn Articles Into Product Surfaces
If a search engine can generate a short answer, a developer should build what cannot be reduced to a short answer. The strongest sites will combine editorial pages with product-like surfaces: calculators, comparison engines, benchmark explorers, datasets, changelogs, searchable archives, visual explainers, small utilities, and community signals. These features give readers a reason to visit directly and give agents structured actions to perform.
This does not mean every article becomes a SaaS product. It means the site architecture should allow an article to attach assets: data files, tables, source snapshots, image sets, code snippets, downloadable references, and update logs. A media network that only writes paragraphs is easy to summarize. A media network that maintains living evidence is harder to replace.
For every new content vertical, define the reusable asset behind the article: a dataset, a tool, a tracker, a glossary, a benchmark, a map, a timeline, or a visual system. The article explains it; the asset makes it worth returning to.
Use AI Without Looking Like Scaled Content Abuse
AI-assisted publishing is not automatically a problem. Google's guidance explicitly allows generative AI as a research and structuring tool when the final work meets quality, accuracy, relevance, and Search Essentials. The danger is volume without value. A network that uses agents to produce many thin pages across many topics creates the exact pattern that search systems are trained to distrust.
The safer architecture is an editorial pipeline with human accountability. Agents can gather sources, draft outlines, make charts, prepare structured data, and check links. Humans should choose the angle, verify claims, add original expertise, approve images, inspect snippets, and own the final page. The site should also explain AI usage where it matters, especially for AI-generated imagery or automated data updates.
Automation Should Increase Proof, Not Just Output
If automation only increases the number of pages, it weakens the brand. If automation increases verification, source coverage, metadata consistency, accessibility checks, image quality, and update discipline, it strengthens the network. That is the difference between an AI content farm and an AI-assisted newsroom.
Keep Discover as a Bonus, Not the Business
Discover remains important because it is one of the few Google surfaces that can create demand before a user types a query. But it is not a stable business foundation. Google describes Discover as interest-driven and less predictable than query search, with older content sometimes resurfacing if it stays useful and relevant. Developers should optimize for eligibility without building a company that depends on daily feed luck.
That means strong 16:9 images, clear titles, no clickbait previews, no manufactured outrage, good page experience, and a clean editorial focus. It also means measuring Discover separately from Search and direct traffic. A feed spike should be treated as distribution upside, not proof that the site has a durable audience.
Own Channels That Google Cannot Reprice Overnight
The strategic answer is not only technical SEO. It is distribution independence. A serious website needs a direct layer: email, RSS, Telegram or Discord, social profiles, browser bookmarks, account systems, notifications, events, paid reports, and community loops. Search can introduce strangers. Direct channels keep relationships.
This is especially important for a media network. If every visit begins as a Google query, Google owns the demand. If readers subscribe because they trust the analysis, the site owns part of the relationship. In an agentic web, the most valuable traffic is not only the click from a result page. It is the returning reader who asks for the brand by name.
The Developer Roadmap
The practical roadmap is straightforward, but not small. First, make the technical base clean: HTTPS, fast pages, indexable text, crawlable links, canonical URLs, sitemap, RSS, Article and Breadcrumb JSON-LD, author pages, and Search Console monitoring. Second, make the content base defensible: original evidence, visible sources, named expertise, update logs, strong images, and pages that answer a real audience need. Third, make the interface agent-ready: semantic HTML, accessible controls, stable layout, predictable navigation, and no hidden critical content. Fourth, make the business resilient: direct audience channels, branded search demand, reusable tools, and data assets.
Developers should not optimize for "being scraped." They should optimize for being the source that a user, a search system, and an agent all prefer because it is clearer, more trustworthy, more complete, and more useful than a synthetic summary. The web referral may shrink. The need for authoritative, well-structured, human-owned sites does not.
Sources
- Optimizing your website for generative AI features on Google Search Google Search Central
- AI features and your website Google Search Central
- Build agent-friendly websites web.dev
- Get on Discover Google Search Central
- Creating helpful, reliable, people-first content Google Search Central
- Google Search's guidance on using generative AI content Google Search Central
- Get started with Search: a developer's guide Google Search Central
- Structured data markup that Google Search supports Google Search Central
- Robots meta tags specifications Google Search Central
- Google's common crawlers: Google-Extended Google for Developers