Since Facebook started open sourcing the datacenter in 2011 in the Open Compute Project (OCP), Facebook and its OCP partners have had some successes in making datacenter computing more open and affordable. Now, the OCP takes on what may be its biggest challenge to date: Creating open-source, high-end network switches.
As Frank Frankovsky, chairman of OCP, said:
We are working together, in the open, to design and build smarter, more scalable, more efficient datacenter technologies — but we're still connecting them to the outside world using black-box switches that haven't been designed for deployment at scale, and don't allow consumers to modify or replace the software that runs on them.
With that in mind, we are today announcing a new project within OCP that will focus on developing a specification and a reference box for an open, OS-agnostic top-of-rack switch . Najam Ahmad, who runs the network engineering team at Facebook, has volunteered to lead the project, and a wide variety of organizations — including Big Switch Networks, Broadcom, Cumulus Networks, Facebook, Intel, Netronome, OpenDaylight, the Open Networking Foundation, and VMware — are already planning to participate. Work on the project will begin in earnest at the first-ever OCP Engineering Summit (http://www.opencompute.org/events/ocp-engineering-summit-mit/), being held at MIT on May 16.
It's our hope that an open, disaggregated switch will enable a faster pace of innovation in the development of networking hardware; help software-defined networking continue to evolve and flourish; and ultimately provide consumers of these technologies with the freedom they need to build infrastructures that are flexible, scalable, and efficient across the entire stack. This is a new kind of undertaking for OCP — starting a project with just an idea and a clean sheet of paper, instead of building on an existing design that's been contributed to the foundation — and we are excited to see how the project group delivers on our collective vision.
Of course, there's nothing new about open-source switches. Any Linux or BSD server can also serve as a switch. Vyatta, an open-source router project designed to handle speeds from DSL to 10Gbps, has been around for years. That last number is the telling one, though. Datacenters need network switches that can start with 10Gbps and move up from there.
What will such an open-source switch look like? We don't know yet. One of Linux's weaknesses is that its network stack isn't that fast, noted Adrian Cockcroft, director of architecture for Netflix's cloud systems, at Linux Foundation's Linux Collaboration Summit in San Francisco in April 2013.
That said, many high-speed switches today use BSD Unix as their basis. While many say that the OCP is starting with a "clean sheet of paper", the ultimate goal of the project seems to be to give datacenter administrators a "bare metal network switch". I think it's likely that BSD will lie at its heart. After all, why reinvent the wheel?
What I find especially interesting about this OCP move is that it's coming immediately after the Linux Foundation's move to unify most of the software-defined networking (SDN) powers under an open-source approach in the Open Daylight Foundation.
In the past, the major network hardware vendors would use open-source software for their black boxes; but, since they used BSD-licensed code, they didn't need to share their improvements. We now seem to be moving to a much more truly open-source-friendly network infrastructure world. The result should be better and cheaper high-end network gear for server farms and datacenters.