Holistic Engineering with Robert Mustacchi

Oxide and Friends · 23 Jan 2025 · 1h 50m · Episode 3

What this episode covers

Robert Mustacchi, a co-founder and key engineer at Oxide Computer Company, discusses the company's holistic approach to building rack-scale servers, from board design to firmware. He details the engineering challenges of eliminating BIOS/UEFI by reverse-engineering AMD's AGESA code, debugging the Spectre and Meltdown vulnerabilities in early Joyent systems, and resolving a PCIe link training failure on the T6 NIC during manufacturing. Mustacchi emphasizes the importance of hardware-software co-design, deep system observability, and anticipating operational issues like firmware upgradability before they occur.

Mentioned

Companies
Oxide Computer Company, Joyent, AMD, Chelsio, Murata
Chips
T6
Tools
DTrace, MDB, KMDB
Also
AGESA, Redfish, UEFI, BIOS, PCIe, Spectre, Meltdown

Other shows on the same ground, closest first.

  • Embedded.fm · 57m

    342: That Girl's Brain

    Jessie Frazelle, Co-Founder and Chief Product Officer at Oxide Computer, explains how the company builds open-source, rack-scale servers for enterprises by adopting hyperscaler-style hardware design. She details the decision to open-source firmware and hardware to eliminate vendor finger-pointing and security vulnerabilities inherent in proprietary BMCs. The discussion covers their use of Rust for firmware and control plane software, power efficiency metrics like PUE, and the challenges of deploying high-density compute in traditional colocation environments.

  • The Amp Hour · 57m

    Finding Hardware Flaws with Laura Abbott

    Laura Abbott, an engineer at Oxide Computer, discusses her accidental discovery of a buffer overflow vulnerability in the ROM update mechanism of the NXP LPC55S69 microcontroller while working on Oxide's server root of trust. She explains how Oxide is rebuilding the server from the ground up with a focus on hardware security, utilizing their open-source operating system Hubris and the Rust programming language to mitigate risks like memory safety issues. The conversation covers the architecture of the server's secure components, including the service processor and TrustZone-M, as well as the challenges of remote hardware debugging and contributing to the Linux kernel community.

  • Unnamed Reverse Engineering Podcast · 1h 01m

    055 - Stacks Of Bricked Chips

    Laura Abbott, a software developer at Oxide Computer, explains how her team reverse engineered the NXP LPC55S69 microcontroller to build a root of trust for their servers. She details discovering an undocumented ROM patching hardware block that allowed privilege escalation, leading to a CVE and a DEF CON presentation. Abbott also discusses her background in Linux kernel development, the transition to Rust for microcontrollers, and the challenges of working with contradictory chip documentation.

  • Embedded.fm · 59m

    203: Save My Board

    Charlie Ladd, a principal electrical engineer with experience in medical, FAA, and consumer products, discusses bridging the gap between hardware and firmware. He details his work on an oil quality sensor for VSI Oil and emphasizes the importance of designing for failure, using redundancy, and providing clear documentation like 'PickIO' spreadsheets and 'Theory of Ops' to help firmware engineers debug boards safely. Ladd also shares insights on the evolution of the industry, the value of mentorship, and how to stay current with new components through trade magazines and development boards.

  • Unnamed Reverse Engineering Podcast · 1h 56m

    070 - I Have a DediProblem

    Jesse Michael and Mickey Shkatov from Eclypsium discuss the intricacies of BIOS and UEFI reverse engineering, tracing their careers from Intel to their current startup. They detail specific research projects, including an exploit of a Nissan Leaf's telematics unit and a DMA attack on Intel WiGig, while explaining the technical evolution from legacy BIOS to UEFI. The conversation covers practical tools for hardware debugging, such as DediProg programmers and Intel DCI, and explores the emerging scene of UEFI-based game cheating and System Management Mode vulnerabilities.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Oxide and Friends. The episode itself belongs to its publisher.