Hardware Podcasts

Large Language Models and How To Use Them | Cyrano.ai's Scott Sandland | Internet of Things Podcast

IoT For All Podcast · 15 Jun 2023 · 20m

What this episode covers

Scott Sandland, Founder and CEO of Cyrano.ai, explains that Large Language Models (LLMs) are essentially advanced autocomplete systems that predict the next word based on massive datasets, making natural language the new interface for computing. He argues that while LLMs accelerate execution, the 'move fast and break things' philosophy is dangerous for AI due to unpredictable ethical outcomes and biases, necessitating a parallel 'ethics roadmap' alongside technical development. Sandland highlights Cyrano.ai's proprietary API, which uses linguistic analysis to assess empathy and relationship value in contexts like sales and mental health, rather than relying on generic sentiment analysis.

Most relevant to

early-stage companies

Topics

Mentioned

Companies
Cyrano.ai
Products
ChatGPT, Google Bard, Llama, Vicuna
Also
Hugging Face

Related episodes from other shows

Other shows on the same ground, closest first.

  • Oxide and Friends · 1h 33m

    Pragmatic LLM usage with Nicholas Carlini

    Security researcher Nicholas Carlini joins Bryan Cantrill and Adam Leventhal to discuss his blog post on the pragmatic use of Large Language Models (LLMs) as tools for reducing friction in software development. Carlini shares specific examples of using GPT-4 and Claude 3.5 Sonnet to simplify code, decompile Python bytecode, and generate plots, while emphasizing the importance of verifying outputs and understanding the models' limitations. The conversation also explores the impact of LLMs on education, hiring practices, and the potential for these tools to democratize programming by lowering the barrier to entry for beginners.

    AI & machine learningDebugging & failure analysis
    8 chapters

  • Oxide and Friends · 1h 33m

    Open Source LLMs with Simon Willison

    Simon Willison, a software engineer and creator of Django, joins Bryan Cantrill and Adam Leventhal to debunk an IEEE Spectrum article claiming open source AI is uniquely dangerous. Willison details the rapid evolution of open source Large Language Models (LLMs), highlighting how tools like llama.cpp and models from Mistral AI have democratized access to powerful AI, allowing them to run on personal laptops. He argues that open source models are essential for security research, citing the discovery of universal adversarial attacks that work across both open and closed systems, and discusses the ethical and legal complexities surrounding training data and copyright.

    AI & machine learningSecurity & privacy
    9 chapters

  • Oxide and Friends · 1h 31m

    Are LLMs Insufficently Lazy?

    Bryan Cantrill and Adam Leventhal of Oxide Computer Company are joined by software engineer Gregoirein to critique Y Combinator CEO Garry Tan’s claim of writing 37,000 lines of code daily using LLMs. Gregoirein used Claude to audit Tan’s public projects, revealing broken assets, legal non-compliance, and a site outage, while the hosts discuss the 'peril of laziness' and the difference between generating code and engineering elegant systems. They argue that while LLMs are useful for review or low-stakes tasks, they cannot replace the deep thinking required for complex, high-consequence software like kernel linkers or signal handlers.

    AI & machine learningEmbedded firmware
    8 chapters

  • Being an Engineer · 57m

    S4E43 Kevin Surace | How To Use AI For Engineering

    Kevin Surace, an AI keynote speaker and founder of Appvance, explains that large language models are statistical tools that amplify human intelligence rather than replace it, comparing them to calculators for language. He argues that AI will increase productivity, potentially leading to shorter workweeks, and helps engineers by generating novel design ideas, writing code, and improving quality assurance through computer vision. Surace emphasizes that while AI is not yet good at designing complex machinery, it excels at processing vast amounts of technical data to suggest solutions and automate routine tasks. He advises engineers to use AI as a co-pilot for communication, coding, and creative problem-solving to overcome skill gaps and accelerate their careers.

    AI & machine learningEmbedded firmware
    9 chapters

  • Oxide and Friends · 1h 01m

    AI Detection with Max Spero

    Max Spero, founder and CEO of Pangram, joins Bryan Cantrill and Adam Leventhal to discuss the technology and societal implications of AI detection. They analyze the recent Stanley Druckenmiller Wall Street Journal op-ed as a watershed moment for AI-assisted writing and explain how Pangram's classifier model, Pangram 4, achieves low false positive rates through 'synthetic mirroring' training data. The conversation covers the use of AI detection in hiring processes, the threat of 'humanizer' tools, and the philosophical impact of LLMs on truth and thought.

    AI & machine learningValidation & product-market fit
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by IoT For All Podcast. The episode itself belongs to its publisher.