Hardware Podcasts

275: Don't Do What the Computer Tells You (Repeat)

Embedded.fm · 7 Oct 2021 · 1h 10m · Episode 275

What this episode covers

Janelle Shane, founder of AI Weirdness, explains how character-level Recurrent Neural Networks (RNNs) generate nonsensical but humorous outputs like paint colors and ice cream flavors by predicting the next character in a sequence. She discusses the limitations of these models, such as short memory windows and the inability to understand context, which leads to absurd recipes and image generation artifacts in BigGAN. Shane warns against trusting AI for critical decisions, citing biased training data in hiring algorithms, and highlights that current AI lacks the complexity of biological brains, comparing them to jellyfish in terms of neuron count.

Most relevant to

makers and hobbyists

Topics

Mentioned

Companies
Sherwin Williams, Amazon, NVIDIA
Also
AI Weirdness, BigGAN, TextGen RNN, Char RNN

Related episodes from other shows

Other shows on the same ground, closest first.

  • The Next Byte Podcast · 28m

    104. Recapping 2022

    Hosts Daniel and Forbode recap their top four episodes from 2022, covering biomimicry inspired by dandelion seeds, AI curiosity models like DALL-E, wearable sleep apnea detection, and sustainable hydropower turbines. They discuss the ethical implications of generative AI, the challenges of explaining complex topics like reinforcement learning to a lay audience, and their podcast's growth metrics, including a shift in global listenership away from the US. The hosts also outline goals for 2023, such as improving community engagement, producing better swag, and rebranding the show.

    AI & machine learningConnected products & IoT
    6 chapters

  • Oxide and Friends · 1h 31m

    Are LLMs Insufficently Lazy?

    Bryan Cantrill and Adam Leventhal of Oxide Computer Company are joined by software engineer Gregoirein to critique Y Combinator CEO Garry Tan’s claim of writing 37,000 lines of code daily using LLMs. Gregoirein used Claude to audit Tan’s public projects, revealing broken assets, legal non-compliance, and a site outage, while the hosts discuss the 'peril of laziness' and the difference between generating code and engineering elegant systems. They argue that while LLMs are useful for review or low-stakes tasks, they cannot replace the deep thinking required for complex, high-consequence software like kernel linkers or signal handlers.

    AI & machine learningEmbedded firmware
    8 chapters

  • Global Medical Device Podcast · 53m

    #464: Why LLM Unpredictability is a Liability in MedTech

    Tyler Harmon, CEO of Iaso Automated Medical Systems, explains why the inherent randomness in Large Language Models (LLMs) makes them unsuitable for safety-critical medical devices compared to deterministic algorithms like Convolutional Neural Networks (CNNs). He details how Iaso uses non-LLM machine learning to detect Acute Respiratory Distress Syndrome (ARDS) in ICU patients and advocates for treating third-party AI stacks as Software of Unknown Provenance (SOUP). Harmon also outlines the need for a dedicated Machine Learning Management System (AIMS) within Quality Management Systems to govern AI governance, hallucination risks, and data integrity.

    AI & machine learningQuality & yield
    7 chapters

  • The Amp Hour · 1h 08m

    AI aren't sentient yet...right?

    Dave Jones and Chris Gammell discuss the recent controversy surrounding Google's Lambda AI, concluding that current models are sophisticated simulations rather than sentient beings, and debating the ethical implications of training them. They analyze Mark Rober's new engineering kits and warehouse lab, contrasting his high-production educational content with traditional maker tools like Kiwi Co and vintage electronics. The conversation shifts to the 'Right to Repair' movement, highlighting New York's legislation and Apple's controversial response of selling service tools while maintaining component serialization to prevent third-party repairs. Finally, they cover Arduino's $32 million Series B funding round and the ongoing impact of ITAR regulations on global electronics trade.

    AI & machine learningPolicy, trade & tariffs
    6 chapters

  • The Next Byte Podcast · 34m

    88. Dall-E, But Better

    Hosts Daniel and Farbode discuss OpenAI's DALL-E 2, explaining how it uses CLIP embeddings to generate photorealistic images from text prompts. They analyze DALL-E's limitations with spatial relationships and text rendering, and explore the ethical concerns regarding training data bias and artist copyright. The episode highlights MIT research into 'composable diffusion,' a method that combines multiple AI models to improve accuracy and creativity in generated imagery.

    AI & machine learningSecurity & privacy
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Embedded.fm. The episode itself belongs to its publisher.