Hardware Podcasts

Crucible: The Oxide Storage Service

Oxide and Friends · 14 Feb 2024 · 1h 38m · Episode 6

What this episode covers

Bryan Cantrill, Adam Leventhal, Josh Clulow, Alan Hanson, James MacMahon, and Matt Keeter of Oxide Computer Company discuss the design and implementation of Crucible, their open-source block storage service. They explain the decision to build a hyper-converged, software-defined storage solution using ZFS and Rust to ensure reliability and enable live migration without third-party dependencies. The team details the architectural evolution from initial prototypes to the final 'upstairs/downstairs' model, emphasizing the critical role of extensive testing, explicit back pressure mechanisms, and the volume layer for snapshot management.

Most relevant to

early-stage companies

Topics

Mentioned

Companies
Oxide Computer Company
Products
Crucible, Propellus
Also
ZFS, Ceph, Rust, SQLite, ZNS

Related episodes from other shows

Other shows on the same ground, closest first.

  • Embedded.fm · 57m

    342: That Girl's Brain

    Jessie Frazelle, Co-Founder and Chief Product Officer at Oxide Computer, explains how the company builds open-source, rack-scale servers for enterprises by adopting hyperscaler-style hardware design. She details the decision to open-source firmware and hardware to eliminate vendor finger-pointing and security vulnerabilities inherent in proprietary BMCs. The discussion covers their use of Rust for firmware and control plane software, power efficiency metrics like PUE, and the challenges of deploying high-density compute in traditional colocation environments.

    Embedded firmwareSecurity & privacy
    7 chapters

  • The Amp Hour · 1h 38m

    An Interview with Rick Altherr

    Rick Altherr, a firmware and software designer at Google, discusses the Open Compute Project and the design of hyperscale server technologies like the Zaius machine and Open Rack V2. He explains the shift from traditional 1U rack units to open, airflow-optimized designs that eliminate unnecessary plastics and panels to reduce costs and improve efficiency. The conversation covers the technical challenges of managing massive data centers, including 48-volt power distribution, point-of-load conversion, and advanced cooling strategies like chilled water heat exchangers. Altherr also details the software stack, including Kubernetes and OpenStack, which manage cluster-level resource allocation and self-healing architectures in environments where hardware failure is a constant statistical reality.

    Embedded firmwareMechanical engineering
    11 chapters

  • The Amp Hour · 57m

    Finding Hardware Flaws with Laura Abbott

    Laura Abbott, an engineer at Oxide Computer, discusses her accidental discovery of a buffer overflow vulnerability in the ROM update mechanism of the NXP LPC55S69 microcontroller while working on Oxide's server root of trust. She explains how Oxide is rebuilding the server from the ground up with a focus on hardware security, utilizing their open-source operating system Hubris and the Rust programming language to mitigate risks like memory safety issues. The conversation covers the architecture of the server's secure components, including the service processor and TrustZone-M, as well as the challenges of remote hardware debugging and contributing to the Linux kernel community.

    Security & privacyMicrocontrollers & dev platforms
    6 chapters

  • Moore's Lobby · 1h 01m

    Ep. 40 | AWS VP of Engineering Wayne Duso on Managing ⅓ of the Internet's Cloud Storage

    Wayne Duso, VP of Engineering at Amazon Web Services (AWS), discusses the evolution of cloud storage and the engineering challenges behind managing a third of the internet's infrastructure. He recounts his career path from Digital Equipment Corporation (DEC) and EMC to AWS, explaining how AWS originated from internal needs to build scalable microservices rather than spare capacity. Duso details AWS's response to the Log4j security vulnerability, the company's 'working backwards' philosophy, and the critical role of hardware engineers in supporting software-defined cloud services.

    Scaling productionSecurity & privacy
    7 chapters

  • Embedded.fm · 1h 05m

    479: Make Your Voice Heard

    Carles Cufí, an open source software engineer at Nordic Semiconductor, discusses the company's strategic shift to Zephyr and the development of the nRF Connect SDK. He explains the architectural decisions behind maintaining a downstream SDK, including the use of binary blobs and proprietary licensing, to balance open-source collaboration with commercial control. Cufí also provides guidance for developers on navigating Zephyr's steep learning curve, highlighting resources like the Memfault 'Practical Zephyr' series, Nordic's DevAcademy, and the community Discord server.

    Embedded firmwareStarting a product company
    9 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Oxide and Friends. The episode itself belongs to its publisher.