Glean's "Boring" Search Moat Fuels AI Acceleration
Anthropic, Glean & OpenRouter: How AI Moats Are Built with Deedy Das of Menlo Ventures
Resources
Resources & Recommendations
Books
- "Thinking, Fast and Slow" by Daniel Kahneman - This book was mentioned in the context of how people process information and make decisions, which relates to how AI models operate and how humans interact with them.
Videos & Documentaries
- "The Social Dilemma" - While not explicitly detailed, the mention of this documentary implies a connection to the broader societal impacts and ethical considerations of technology, similar to discussions around AI.
Research & Studies
- "Mechanistic Interpretability" - Discussed as a critical area of research for understanding how AI models work internally, moving beyond empirical observations to probe the "why" behind model outputs. It's described as "brain surgery for LLMs."
- Study on "Sycophancy" in GPT-4o - Mentioned as an example of a behavior that can be detected through mechanistic interpretability, highlighting how models can exhibit behaviors users might like but are not always transparently understood.
- "The AI Index Report" (Stanford HAI) - Used to present market share data for enterprise LLM API spend, comparing OpenAI and Anthropic.
Tools & Software
- Claude (AI model) - Discussed as a significant LLM, with its evolution from early access via Slack to wider availability. Its capabilities in coding (Claude Code) were highlighted.
- ChatGPT (AI model) - Mentioned as the catalyst for the current AI boom and a benchmark for LLM capabilities.
- Glean (Enterprise Search) - The company where Deedy Das previously worked, highlighted for its innovation in enterprise search and its "boring, unsexy" beginnings that became "sexy."
- OpenAI (Company) - Discussed as a major player in the AI space, particularly in relation to ChatGPT and their market share.
- OpenRouter (LLM Gateway) - A platform for accessing various LLMs, praised for its developer-friendly approach, PLG motion, and detailed provider insights.
- Devin (AI Coding Agent) - Mentioned as a tool that works with LLMs and Slack, with a humorous note about handling multiple Slack workspaces.
- Cognition AI (Company) - Mentioned in the context of AI coding agents and their interest in "fast agents."
- Coursera (Educational Platform) - Mentioned as a platform that has startups building on top of LLMs.
- Cursor (AI-Enhanced Code Editor) - Mentioned as a tool that can reveal code vulnerabilities, raising questions about developer reliance on AI and potential attack vectors.
- SweetGrep (Code Search Tool) - Mentioned as a tool that could be integrated with AI assistance for developers.
- Whisper (Voice Dictation Software) - Praised for its high accuracy, zero-edit rate, and user experience, making voice dictation more practical.
- Nvidia (Company) - Mentioned in the context of diffusion models having implications for their stock and market dominance.
- Amazon (Company) - Mentioned for its investment in AI infrastructure, including training chips.
- Surgegate (AI Infrastructure) - Discussed in the context of massive capital investment in compute infrastructure.
- DataBricks (Company) - Mentioned in the context of AI companies and their valuations.
- Stripe (Company) - Mentioned as a company where Rahul Bado previously worked.
Articles & Papers
- Blog post about a coding interview with Cursor - This was the source of the anecdote about an AI revealing a code vulnerability during an interview.
People Mentioned
- Deedy Das (Menlo Ventures) - The guest, sharing insights from his venture capital perspective and previous experience at Glean.
- Alessio (Latent Space Podcast Host) - Co-host of the podcast.
- Swix (Latent Space Editor) - Co-host of the podcast.
- Sam Altman (CEO of OpenAI) - Mentioned in relation to OpenAI's investor policies and their massive infrastructure investments.
- Cat Woo - Mentioned as an individual who might have thought of the product innovation of Claude Code.
- Emmanuel (from Anthropic) - Mentioned as a guest on a previous podcast episode discussing mechanistic interpretability.
- Mark (from Goodfire) - Mentioned as someone invited to a conference.
- Will Brown - Mentioned as having been on the podcast multiple times.
- Alex (Founder of OpenRouter) - Described as a phenomenal founder who previously started OpenSea.
- Jeremy - Mentioned as an influence for using Whisper.
- Rahul Bado (CTO of Anthropic) - Highlighted as an example of success despite not coming from a top Indian university, emphasizing meritocracy and hard work.
- Sundar Pichai (CEO of Google) - Mentioned as an example of someone who came from IIT.
- Elon Musk - Mentioned in relation to Grok Code Fast and his company's presence on OpenRouter's leaderboard.
- Greg Brockman (Former President of OpenAI) - Quoted regarding the vision of "a GPU for every human on Earth."
- Kyle - Mentioned as a guest on a previous podcast episode.
- Dylan Patel - Referred to as an expert on AI infrastructure.
- Richard Feynman - His quote about "brain surgery for LLMs" was referenced in the context of mechanistic interpretability.
- Edson - One of the historical figures in the debate between AC and DC currents.
- Tesla - One of the historical figures in the debate between AC and DC currents.
Organizations & Institutions
- Menlo Ventures - Deedy Das's current affiliation.
- Kernel Labs - Alessio's affiliation.
- Anthropic - A leading AI company, heavily discussed for its LLM (Claude), rapid growth, and investment rounds.
- OpenAI - A major AI company, discussed in comparison to Anthropic, especially regarding market share and infrastructure.
- Glean - Deedy Das's former company, a significant player in enterprise search.
- Stanford HAI - Institution behind the AI Index Report.
- Microsoft - Mentioned as a company that has invested heavily in AI infrastructure.
- Google - Mentioned as a comparison point for AI innovation and market dynamics.
- DeepMind - Mentioned as a comparison point for AI innovation.
- Signal Fire - Mentioned for tracking employee retention stats.
- Vercel - Mentioned for its AI Gateway and AI SDK.
- iFund - An older fund example from Kleiner Perkins with Apple.
- IIT (Indian Institute of Technology) - A prestigious educational institution in India.
Courses & Educational Resources
- "The AI Engineer Podcast" - The podcast itself, where the discussion takes place.
- "Latent Space" - The podcast's platform or publication.
- "Kernel Labs" - Alessio's affiliation, likely a research or development lab.
- "Mechinterp podcast with Emmanuel from Anthropic" - A previous podcast episode recommended for further learning on mechanistic interpretability.
Websites & Online Resources
- Twitter - Used for sharing statistics, charts, and discussions about AI.
- Slack - Mentioned as an early access channel for Claude and a critical data source for Glean.
- Google Drive - Mentioned as a data source that Glean integrates with.
- LinkedIn - Mentioned in relation to a coding interview anecdote.
Other Resources
- "Thinking Hats" (Anthropic merchandise) - Mentioned humorously in relation to Anthropic's branding.
- "Out of Home Advertising Campaigns" (Anthropic) - Discussed in the context of Anthropic's public image and rebranding efforts.
- "Cafes" (Anthropic) - Part of Anthropic's branding strategy.
- "Billboards" (San Francisco) - Mentioned in relation to an honest AI company billboard.
- "New Tab Page" (Browser feature) - Discussed as a distribution channel for Glean.
- "Chrome Extension" - Another distribution channel for Glean.
- "M-Code 3" - Mentioned as a top model on OpenRouter's leaderboard.
- "Grok Code Fast" - Mentioned as a free model that is popular on OpenRouter.
- "Open Source AI Models" - Discussed in the context of competition and market dynamics.
- "RL Environments" and "RLHF" - Mentioned as the "next wave" of AI development.
- "AC vs. DC currents" debate - Historical example of technological paradigm shifts.
- "Blu-ray vs. DVD vs. HD DVD" - Example of technological competition and market outcomes.
- "PE Roll-ups" - A business strategy involving acquiring companies and automating them with AI.
- "AI for Work" campaign - Glean's initial marketing campaign.
- "Cisco ad in the airport" - An example of a disliked AI advertisement.
- "Tesla" (Self-driving car technology) - Used as an analogy for user attention and AI augmentation in developer environments.