草榴社区

The Future of PCIe Is Optical: 草榴社区 and OpenLight Present First PCIe 7.0 Data-Rate-Over-Optics Demo

Keivan Javadi Khasraghi, Priyank Shukla

Apr 09, 2024 / 3 min read

The transition of PCIe over optical interfaces heralds a breakthrough for low-latency operations. As a key player in the PCI Special Interest Group (PCI-SIG), 草榴社区 is deeply involved in actively helping develop a new standard. The wheels of change are in motion for the Peripheral Component Interconnect Express (PCIe) standard, with transformative implications for the chip design process.

The PCI-SIG formation of a PCIe Optical Workgroup, , means that PCIe is set to transcend the practical limitations of copper signaling. The group sees optical, light-based interfaces as integral to the future of PCIe. This shift carries multiple prospective advantages, including expanded ranges and data rates and reduced power requirements.

pcie 7.0 over fiber optics

The Transition to PCIe Over Fiber Optics

The goal is to standardize the implementation of PCIe over fiber optics while keeping the field open to a broad swathe of optical technologies. There is also talk of evolving the card electromechanical (CEM) connector toward an optical-based solution as a means to deliver PCIe.

However, while full ecosystem change will not be instantaneous, we can be sure that it is coming and prepare accordingly. With this in mind, 草榴社区 has been an active participant in the PCI-SIG Workgroup (as well as the only IP company on the board of directors) and is , a leader in integrated silicon photonics technology, to develop tools that will enable a smooth transition.

pcie 7.0 over optics

Figure 1: 草榴社区 PCIe PHY demonstrates non-retimed linear-drive PCIe 7.0 data-rate Electro-Optical-Electro Link

At the recent Optical Fiber Communication Conference and Exposition (OFC) in San Diego, 草榴社区 and OpenLight brought two data center energy-efficient solutions to life. In the first demonstration, 草榴社区 showcased both a PCIe 7.0 and PCIe 6.0 over Optics with OpenLight’s Photonics IC delivering PCIe at a rate of 128 and 64 gigatransfers per second (GT/s) correspondingly. The second featured 草榴社区 224G TX over optics performance with OpenLight’s 200G per Lambda Photonic IC.

The Benefits and Challenges of PCIe Over Optics

It bears noting that this is not the PCI-SIG’s first foray into this new territory. Calls to draft a proposal for PCIe over optics surfaced almost a decade ago, driven by demand for low-power use cases. However, the case for development was not strong enough back then (even though increased efficiency does stand to reduce the total cost of ownership for data center operators).

Now, however, the promise of low latency that PCIe and Compute Express Link (CXL) offer together is compelling enough to warrant true progress. Reducing latency is a challenge that has dogged the industry for years, as excess latency threatens a system’s throughput.

PCIe over optics doesn’t just represent a low-power option; it can also provide a cache — a coherent way of splitting compute resources between processors and accelerators using an optical link. This breakthrough is likely to prove timely given the proliferation of large language models and requisite training systems, the growing need for unstructured data processing, and the corresponding exponential increase in demand for compute power.

A further advantage for data centers that the low-latency PCIe over optics solution offers is the disaggregation of resources such as central processing units (CPUs) and graphics processing units (GPUs), freeing up access to memory that is currently highly localized and often untapped.

PCIe over optics is crucial in enabling connectivity between rack units and enabling them to function as a cluster. PCIe itself serves as a controller — the digital logic that interfaces with a piece of software. One challenge is ensuring the shift to PCIe over optics does not upend the software stack control process.

A bigger challenge lies in managing the physical layer and the interoperability of the electro-optical interface. This is where 草榴社区, together with OpenLight, plays a pivotal role by providing an electrical IP solution that can work in conjunction with a photonic one. Once a common standard is set, any photonic die vendor will be in a position to assimilate PCIe.

In an age defined by the activities of supercomputers and hyperscalers as well as data centers, it is clear that PCIe over optics represents the future of signaling. Its development and adoption depends on the enablement of a supportive ecosystem, which 草榴社区 is energetically pursuing. Once it becomes a reality, 草榴社区 complete IP solutions for PCIe, CXL and Ethernet will be on hand to make your first-pass silicon success possible.

Continue Reading