Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning
Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning  
Podcast: Unsupervised Learning with Jacob Effron
Published On: Wed Jul 19 2023
Description: Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more. 0:00 intro01:06 Aran’s background02:58 starting work on gpt-j05:49 gathering data for Lion and gpt-j08:51 history of EleutherAI11:16 open vs. closed-source models19:06 how will open-source models be used going forward21:33 thought cloning25:51 building AI models that understand video29:35 one model to rule them all31:58 influence of academia in the LLM space34:33 over-hyped/under-hyped38:01 Aran’s thoughts on AGI With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health@jordan_segall - Partner at Redpoint