Glean's "Boring" Search Moat Fuels AI Acceleration

Original Title: Anthropic, Glean & OpenRouter: How AI Moats Are Built with Deedy Das of Menlo Ventures

Resources

Resources & Recommendations

Books

  • "Thinking, Fast and Slow" by Daniel Kahneman - This book was mentioned in the context of how people process information and make decisions, which relates to how AI models operate and how humans interact with them.

Videos & Documentaries

  • "The Social Dilemma" - While not explicitly detailed, the mention of this documentary implies a connection to the broader societal impacts and ethical considerations of technology, similar to discussions around AI.

Research & Studies

  • "Mechanistic Interpretability" - Discussed as a critical area of research for understanding how AI models work internally, moving beyond empirical observations to probe the "why" behind model outputs. It's described as "brain surgery for LLMs."
  • Study on "Sycophancy" in GPT-4o - Mentioned as an example of a behavior that can be detected through mechanistic interpretability, highlighting how models can exhibit behaviors users might like but are not always transparently understood.
  • "The AI Index Report" (Stanford HAI) - Used to present market share data for enterprise LLM API spend, comparing OpenAI and Anthropic.

Tools & Software

  • Claude (AI model) - Discussed as a significant LLM, with its evolution from early access via Slack to wider availability. Its capabilities in coding (Claude Code) were highlighted.
  • ChatGPT (AI model) - Mentioned as the catalyst for the current AI boom and a benchmark for LLM capabilities.
  • Glean (Enterprise Search) - The company where Deedy Das previously worked, highlighted for its innovation in enterprise search and its "boring, unsexy" beginnings that became "sexy."
  • OpenAI (Company) - Discussed as a major player in the AI space, particularly in relation to ChatGPT and their market share.
  • OpenRouter (LLM Gateway) - A platform for accessing various LLMs, praised for its developer-friendly approach, PLG motion, and detailed provider insights.
  • Devin (AI Coding Agent) - Mentioned as a tool that works with LLMs and Slack, with a humorous note about handling multiple Slack workspaces.
  • Cognition AI (Company) - Mentioned in the context of AI coding agents and their interest in "fast agents."
  • Coursera (Educational Platform) - Mentioned as a platform that has startups building on top of LLMs.
  • Cursor (AI-Enhanced Code Editor) - Mentioned as a tool that can reveal code vulnerabilities, raising questions about developer reliance on AI and potential attack vectors.
  • SweetGrep (Code Search Tool) - Mentioned as a tool that could be integrated with AI assistance for developers.
  • Whisper (Voice Dictation Software) - Praised for its high accuracy, zero-edit rate, and user experience, making voice dictation more practical.
  • Nvidia (Company) - Mentioned in the context of diffusion models having implications for their stock and market dominance.
  • Amazon (Company) - Mentioned for its investment in AI infrastructure, including training chips.
  • Surgegate (AI Infrastructure) - Discussed in the context of massive capital investment in compute infrastructure.
  • DataBricks (Company) - Mentioned in the context of AI companies and their valuations.
  • Stripe (Company) - Mentioned as a company where Rahul Bado previously worked.

Articles & Papers

  • Blog post about a coding interview with Cursor - This was the source of the anecdote about an AI revealing a code vulnerability during an interview.

People Mentioned

  • Deedy Das (Menlo Ventures) - The guest, sharing insights from his venture capital perspective and previous experience at Glean.
  • Alessio (Latent Space Podcast Host) - Co-host of the podcast.
  • Swix (Latent Space Editor) - Co-host of the podcast.
  • Sam Altman (CEO of OpenAI) - Mentioned in relation to OpenAI's investor policies and their massive infrastructure investments.
  • Cat Woo - Mentioned as an individual who might have thought of the product innovation of Claude Code.
  • Emmanuel (from Anthropic) - Mentioned as a guest on a previous podcast episode discussing mechanistic interpretability.
  • Mark (from Goodfire) - Mentioned as someone invited to a conference.
  • Will Brown - Mentioned as having been on the podcast multiple times.
  • Alex (Founder of OpenRouter) - Described as a phenomenal founder who previously started OpenSea.
  • Jeremy - Mentioned as an influence for using Whisper.
  • Rahul Bado (CTO of Anthropic) - Highlighted as an example of success despite not coming from a top Indian university, emphasizing meritocracy and hard work.
  • Sundar Pichai (CEO of Google) - Mentioned as an example of someone who came from IIT.
  • Elon Musk - Mentioned in relation to Grok Code Fast and his company's presence on OpenRouter's leaderboard.
  • Greg Brockman (Former President of OpenAI) - Quoted regarding the vision of "a GPU for every human on Earth."
  • Kyle - Mentioned as a guest on a previous podcast episode.
  • Dylan Patel - Referred to as an expert on AI infrastructure.
  • Richard Feynman - His quote about "brain surgery for LLMs" was referenced in the context of mechanistic interpretability.
  • Edson - One of the historical figures in the debate between AC and DC currents.
  • Tesla - One of the historical figures in the debate between AC and DC currents.

Organizations & Institutions

  • Menlo Ventures - Deedy Das's current affiliation.
  • Kernel Labs - Alessio's affiliation.
  • Anthropic - A leading AI company, heavily discussed for its LLM (Claude), rapid growth, and investment rounds.
  • OpenAI - A major AI company, discussed in comparison to Anthropic, especially regarding market share and infrastructure.
  • Glean - Deedy Das's former company, a significant player in enterprise search.
  • Stanford HAI - Institution behind the AI Index Report.
  • Microsoft - Mentioned as a company that has invested heavily in AI infrastructure.
  • Google - Mentioned as a comparison point for AI innovation and market dynamics.
  • DeepMind - Mentioned as a comparison point for AI innovation.
  • Signal Fire - Mentioned for tracking employee retention stats.
  • Vercel - Mentioned for its AI Gateway and AI SDK.
  • iFund - An older fund example from Kleiner Perkins with Apple.
  • IIT (Indian Institute of Technology) - A prestigious educational institution in India.

Courses & Educational Resources

  • "The AI Engineer Podcast" - The podcast itself, where the discussion takes place.
  • "Latent Space" - The podcast's platform or publication.
  • "Kernel Labs" - Alessio's affiliation, likely a research or development lab.
  • "Mechinterp podcast with Emmanuel from Anthropic" - A previous podcast episode recommended for further learning on mechanistic interpretability.

Websites & Online Resources

  • Twitter - Used for sharing statistics, charts, and discussions about AI.
  • Slack - Mentioned as an early access channel for Claude and a critical data source for Glean.
  • Google Drive - Mentioned as a data source that Glean integrates with.
  • LinkedIn - Mentioned in relation to a coding interview anecdote.

Other Resources

  • "Thinking Hats" (Anthropic merchandise) - Mentioned humorously in relation to Anthropic's branding.
  • "Out of Home Advertising Campaigns" (Anthropic) - Discussed in the context of Anthropic's public image and rebranding efforts.
  • "Cafes" (Anthropic) - Part of Anthropic's branding strategy.
  • "Billboards" (San Francisco) - Mentioned in relation to an honest AI company billboard.
  • "New Tab Page" (Browser feature) - Discussed as a distribution channel for Glean.
  • "Chrome Extension" - Another distribution channel for Glean.
  • "M-Code 3" - Mentioned as a top model on OpenRouter's leaderboard.
  • "Grok Code Fast" - Mentioned as a free model that is popular on OpenRouter.
  • "Open Source AI Models" - Discussed in the context of competition and market dynamics.
  • "RL Environments" and "RLHF" - Mentioned as the "next wave" of AI development.
  • "AC vs. DC currents" debate - Historical example of technological paradigm shifts.
  • "Blu-ray vs. DVD vs. HD DVD" - Example of technological competition and market outcomes.
  • "PE Roll-ups" - A business strategy involving acquiring companies and automating them with AI.
  • "AI for Work" campaign - Glean's initial marketing campaign.
  • "Cisco ad in the airport" - An example of a disliked AI advertisement.
  • "Tesla" (Self-driving car technology) - Used as an analogy for user attention and AI augmentation in developer environments.

---
Handpicked links, AI-assisted summaries. Human judgment, machine efficiency.
This content is a personally curated review and synopsis derived from the original podcast episode.