Hardware Podcasts

Open Source LLMs with Simon Willison

Oxide and Friends · 17 Jan 2024 · 1h 33m · Episode 2

What this episode covers

Simon Willison, a software engineer and creator of Django, joins Bryan Cantrill and Adam Leventhal to debunk an IEEE Spectrum article claiming open source AI is uniquely dangerous. Willison details the rapid evolution of open source Large Language Models (LLMs), highlighting how tools like llama.cpp and models from Mistral AI have democratized access to powerful AI, allowing them to run on personal laptops. He argues that open source models are essential for security research, citing the discovery of universal adversarial attacks that work across both open and closed systems, and discusses the ethical and legal complexities surrounding training data and copyright.

Most relevant to

early-stage companies

Topics

Mentioned

Companies
Mistral AI, New York Times, OpenAI, Dropbox, Facebook, Google
Products
ChatGPT, Llama, Mistral 7B, Perplexity AI, Bard, Grok, Dataset, LLM
Also
IEEE Spectrum, Django, GPT-3, llama.cpp

Related episodes from other shows

Other shows on the same ground, closest first.

  • Coredump Sessions · 55m

    #007: AI, Open Source, and the Future of Embedded Development: How Much Code Will We Actually Write?

    François Baldassari, CEO of Memfault, and Thomas Sarlandie, Field CTO of Memfault, host a panel with Jonathan Beri, CEO of Golioth, and Dan Mangum, CTO of Golioth, to discuss the intersection of AI, open source, and embedded development. The group analyzes the maturity of edge AI for audio and video processing, the challenges of integrating LLMs into hardware due to rapid model iteration, and the current state of using AI for firmware development. They conclude that while AI is transforming code generation and review, open source remains critical for training models and providing trusted, complex infrastructure like Zephyr and FreeRTOS.

    Embedded firmwareAI & machine learning
    9 chapters

  • Hackaday Podcast · 48m

    Ep 218: Open Source AI, The Rescue of Salyut 7, The Homework Machine

    Hackaday Editor-in-Chief Elliot Williams and Kristina Panos discuss the rapid advancement of open source AI, highlighting how Meta's LLaMA model and the Open Assistant project are challenging the closed ecosystems of Google and OpenAI through community-driven improvements like low-rank adaptation. They review several hardware hacks, including a light-up breadboard using op-amps, Pepper's ghost holographic clocks, and a robotic 'homework machine' that mimics handwriting using a Core XY plotter and ChatGPT. The episode also covers the 1985 rescue of the Salyut 7 space station, the dyeing of PBT keycaps, and the technical challenges of autonomous vehicles in San Francisco.

    AI & machine learningMechanical engineering
    8 chapters

  • Built 2 Scale · 1h 05m

    The Delegation Era: AI as an Operator, Not a Tool

    Hosts Matt Perrott and Scott Wilcox discuss the rapid rise of OpenClaw (formerly Claude Bot), an open-source agent wrapping Claude Code that has gained 150,000 GitHub stars in two weeks, sparking security concerns about autonomous agents accessing credit cards and personal data. They analyze the competitive landscape, noting Claude's enterprise dominance via tools like Claude Code and Claude Cowork, while OpenAI counters with its new Codex desktop app, leading the hosts to recommend businesses go 'all in' on a single platform. The episode covers the $1.8 trillion SpaceX-XAI merger, the potential for Tesla to acquire these assets, and Australia's strategic opportunity to leverage its critical minerals and solar capacity to attract hyperscalers for free energy and compute.

    Connected products & IoTMicrocontrollers & dev platforms
    7 chapters

  • How I Built This · 58m

    ICYMI... HIBT Lab! OpenAI: Sam Altman

    Sam Altman, co-founder of OpenAI and former president of Y Combinator, discusses the evolution of artificial intelligence from narrow tasks to the pursuit of Artificial General Intelligence (AGI). He details OpenAI's structural shift from a nonprofit to a hybrid model to secure necessary capital, the strategic decision to keep powerful models like GPT-3 behind an API for safety control, and his vision for AI as a ubiquitous, helpful companion rather than just a job-replacing tool.

    AI & machine learningStarting a product company
    7 chapters

  • IoT For All Podcast · 20m

    Large Language Models and How To Use Them | Cyrano.ai's Scott Sandland | Internet of Things Podcast

    Scott Sandland, Founder and CEO of Cyrano.ai, explains that Large Language Models (LLMs) are essentially advanced autocomplete systems that predict the next word based on massive datasets, making natural language the new interface for computing. He argues that while LLMs accelerate execution, the 'move fast and break things' philosophy is dangerous for AI due to unpredictable ethical outcomes and biases, necessitating a parallel 'ethics roadmap' alongside technical development. Sandland highlights Cyrano.ai's proprietary API, which uses linguistic analysis to assess empathy and relationship value in contexts like sales and mental health, rather than relying on generic sentiment analysis.

    AI & machine learningSecurity & privacy
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Oxide and Friends. The episode itself belongs to its publisher.