The Network Behind the Network

Oxide and Friends · 9 May 2023 · 1h 39m · Episode 13

What this episode covers

Oxide colleagues Arjen Roodselaar, Matt Keeter, and John Gallagher join Bryan Cantrill and Adam Leventhal to detail the design and debugging of Oxide's 'Monorail' management network. They explain the decision to abandon NCSI in favor of a separate network using Microchip VSC7448 switches and 100BASE-FX signaling over twinax cables. The team discusses the complex bring-up of the switch firmware, the development of custom debugging tooling in Hubris and Humility, and the critical capability to stream OS images over the slow management link for remote recovery.

Mentioned

Companies
Oxide Computer Company
Products
Hubris, Humility
Chips
Microchip VSC7448, Tofino
Also
100BASE-FX, QSGMII

Other shows on the same ground, closest first.

  • Embedded.fm · 57m

    342: That Girl's Brain

    Jessie Frazelle, Co-Founder and Chief Product Officer at Oxide Computer, explains how the company builds open-source, rack-scale servers for enterprises by adopting hyperscaler-style hardware design. She details the decision to open-source firmware and hardware to eliminate vendor finger-pointing and security vulnerabilities inherent in proprietary BMCs. The discussion covers their use of Rust for firmware and control plane software, power efficiency metrics like PUE, and the challenges of deploying high-density compute in traditional colocation environments.

  • The Amp Hour · 57m

    Finding Hardware Flaws with Laura Abbott

    Laura Abbott, an engineer at Oxide Computer, discusses her accidental discovery of a buffer overflow vulnerability in the ROM update mechanism of the NXP LPC55S69 microcontroller while working on Oxide's server root of trust. She explains how Oxide is rebuilding the server from the ground up with a focus on hardware security, utilizing their open-source operating system Hubris and the Rust programming language to mitigate risks like memory safety issues. The conversation covers the architecture of the server's secure components, including the service processor and TrustZone-M, as well as the challenges of remote hardware debugging and contributing to the Linux kernel community.

  • Embedded.fm · 1h 03m

    521: Are You The Tiny Domino?

    Kenneth Finnegan, Senior Solutions Architect at Nvidia and creator of the Fremont Cabal Internet Exchange (FCIX), explains how he accidentally built load-bearing internet infrastructure. He details the history of FCIX, which grew from a joke among five friends into a major peering point, and his Micro Mirror CDN that serves a significant portion of Ubuntu and VLC downloads. Finnegan also discusses the importance of distributed systems knowledge for embedded developers and shares anecdotes about his hobbies, including coin collecting and driving locomotives.

  • Embedded.fm · 1h 08m

    134: Diet-Friendly Dog Food

    Eric Hankinson, an instructor at Contextual Electronics and developer at Lean Dog, discusses the embedded software components of his online apprenticeship program. He explains how he uses Vagrant and VirtualBox to create consistent development environments for students using STMicroelectronics Nucleo-F030R8 boards and open-source tools like OpenOCD and KiCad. Hankinson also covers the pedagogical challenges of teaching bare-metal C programming, the role of CMSIS in hardware abstraction, and the transition from Arduino to more powerful microcontrollers.

  • Embedded.fm · 1h 10m

    523: Bad Experience With Donuts

    Elecia White and Christopher White discuss the LeapFrog LeapPad and Odyssey Globe, recalling Elecia's work on their capacitive sensing and custom ASIC technology around 2001. They analyze the governance models of open source projects like Valetudo, ESPHome, and Zephyr as analogies for large company politics, and review Bunnie Huang's Dabao Evaluation Board for its verifiability features. The hosts also cover practical tools like Merlin Bird ID and Excel data bars, while debating the use of Ethernet in embedded systems and the state of Renesas MCUs.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Oxide and Friends. The episode itself belongs to its publisher.