Ep 28: LangChain CEO Harrison Chase on the Current State of Eval and Agents and The LLM Apps that Will Define 2024
Ep 28: LangChain CEO Harrison Chase on the Current State of Eval and Agents and The LLM Apps that Will Define 2024  
Podcast: Unsupervised Learning with Jacob Effron
Published On: Tue Feb 20 2024
Description: Last week LangChain announced a $20M Series A led by Sequoia and released the paid version of LangSmith, which has already been used by 1K+ teams and driven 80K signups. On this week’s episode of Unsupervised Learning, we sat down with LangChain Co-Founder and CEO Harrison Chase to talk about the current state of LLM evaluation, observability, and the agent landscape. (0:00) intro (1:07) applications of AI in the sports world (3:26) what does LangChain do? (7:51) building with LangSmith (10:00) best AI eval practices (16:51) to what extent is eval generalizable? (21:11) the current agent landscape (29:35) balancing present and future at LangChain (36:27) using LangServe to deploy LangChain applications (41:37) more complex chatbots are coming (45:51) current AI practices that will become obsolete (48:55) over-hyped/under-hyped (49:25) bigger surprise in building LangChain (51:50) how ubiquitous will open-source models be in the future? (52:43) most exciting AI startups (56:07) being an AI “celebrity” (58:09) Jacob and Jordan debrief  With your co-hosts:  @jacobeffron  - Partner at Redpoint, Former PM Flatiron Health  @patrickachase  - Partner at Redpoint, Former ML Engineer LinkedIn  @ericabrescia  - Former COO Github, Founder Bitnami (acq’d by VMWare)  @jordan_segall  - Partner at Redpoint