Magazine Button
Broadcom delivers industry’s first 51.2Tbps co-packaged optics Ethernet switch platform for scalable AI systems

Broadcom delivers industry’s first 51.2Tbps co-packaged optics Ethernet switch platform for scalable AI systems

HardwareOperations & SystemsTop Stories

Broadcom has announced it has delivered Bailly, the industry’s first 51.2Tbps co-packaged optics (CPO) Ethernet switch, to its customers. The product integrates eight silicon photonics based 6.4Tbps optical engines with Broadcom’s best-in-class StrataXGS Tomahawk5 switch chip.

Bailly enables the optical interconnect to operate at 70% lower power consumption and delivers an 8x improvement in silicon area efficiency as compared to pluggable transceiver solutions. 

The optical interconnect is critical for both front-end and back-end networks in large scale Generative AI clusters. Today, pluggable optical transceivers consume approximately 50% of system power and constitute more than 50% of the cost of a traditional switch system. The growing bandwidth requirement for the newer generation of GPUs, coupled with the ever- increasing sizes of AI clusters, requires disruptively power-efficient and cost-efficient optical interconnects that extend beyond discrete solutions. Broadcom’s CPO and silicon photonics technology platform, with its high degree of integration, provides the lowest latency, highest bandwidth density, lowest power and lowest cost solution to meet this need and can help build large-scale, power-efficient AI clusters. 

Bailly integrates hundreds of optical components and hundreds of millions of transistors in a single optical engine. The high degree of integration enables the placement of the optical engines on a common substrate with complex logic ASICs minimising the need for signal conditioning circuitry. This allows the optical interconnect to operate at 70% lower power consumption as compared to pluggable transceivers. Bailly’s high-volume production is made possible by Broadcom’s innovative manufacturing approach that utilises proven CMOS foundry processes, advanced packaging technologies and a highly automated high-density, Edge-coupled fibre attach capability. 

Broadcom is co-designing platforms with cloud service providers (CSPs) and system integrators to accelerate adoption of CPO platforms. Broadcom will showcase the Bailly 51.2T CPO system at the Optical Fiber Communication (OFC) 2024 exhibition. 

“As AI clusters demand higher bandwidth density, lower power consumption and lower latency, we are pleased to announce delivery of the industry’s first 51.2-Tbps CPO switch,” said Near Margalit, Ph.D., Vice President and General Manager of the Optical Systems Division at Broadcom. “Bailly will enable hyperscalers to deploy lower-power, cost-efficient, large-scale AI and compute clusters. Broadcom’s technology leadership and manufacturing innovations help Bailly deliver 70% better power efficiency and ensure an optical I/O roadmap that can walk in tandem with the future bandwidth and power needs of AI infrastructure.” 

Sameh Boujelbene, Vice President at Dell’Oro Group, said: “Pluggable optics are expected to account for an increasingly significant portion of power consumption at a system level, exceeding 50% of the switch system power at 51.2Tbps and beyond. This issue will be further exacerbated as CSPs build their next-generation AI networks and continue to push for higher speeds. Substantial investments in AI infrastructure are accelerating the development of innovative optical connectivity solutions such as Broadcom’s Bailly co-packaged optics platform, aiming to meet the demands of AI clusters while solving cost and power consumption hurdles.” 

Feng Luo, Head of Network Systems at ByteDance, added: “Innovation in the optical interconnect will be of great importance to future generations of AI networks. Broadcom’s continued progress in the development of co-packaged optics is exactly what the industry will require to overcome cost and power bottlenecks of current generation optical interconnects.” 

Richard Li, General Manager of H3C’s Switch Product Line, said: “System design has become more challenging with each increase in SerDes speed, but only recently have we had to re-design our systems and optics to overcome the physical limitations of copper. Our partnership with Broadcom to design systems with highly integrated co-packaged optics is a huge step forward to overcoming the design limitations of pluggable transceivers in high density systems.” 

Mansour Karam, Global Vice President of Data Centre Products at Juniper Networks, said: “AI has introduced a set of challenges that the networking must address. We are excited to partner with Broadcom to deliver co-packaged optics throughout the data centre, thereby improving cost, power consumption and bandwidth efficiency of the optical interconnect.” 

Click below to share this article

Browse our latest issue

Intelligent Data Centres

View Magazine Archive