Communications: It’s AI or die
On March 21, 2024, nVIDIA CEO Jensen Huang told us how AI is changing the world. It has surely changed the attitudes of everyone in the data-communications industry.
At OFC 2024, one thing was clear: if you’re in the data communications business, you’d better claim that your company helps move AI-related data or risk being left behind. All the data that those GPUs and CPUs need for AI/ML must move in quantities we never dreamed of just two years ago. Yes, AI was already in use before, but now everyone in datacom claims to support it.
Having not attended OFC for several years, I expected to hear the usual claims about the need for faster data rates. Numerous people told me that there was a marked change from 2023, and it was because of AI.
In the recent past, we mostly heard that networks needed more speed for transporting video. We also heard about how 5G would enable those faster mobile downloads. Many people I spoke to at OFC claim that data demands from AI will soon greatly exceed those from video, overwhelming datacenters with data. Everywhere I turned, there was a booth touting AI and how that company’s product — be that network switches, optical network components, semiconductors, and test equipment — would enable it. That put people at OFC 2024 on edge, making them a little jittery. They were wondering if optical data rates could keep up with the coming demand for moving data. They were not concerned about AI taking away their jobs but with how the industry could possibly keep up. Moreover, they were feeling the need to beat their competitors to the next speed.
Optical link rates of 400 Gb/sec (4 x 100 Gb/sec) and 800 Gb/ sec (8 x 100 Gb/sec) are in use today, and they were everywhere at OFC. Some companies claimed they are already moving toward 1.6 Tb/sec, known as 1.6T. A few mentioned 3.2T and one presentation included a timeline to 6.4T.
The demand for faster data transport may finally result in the deployment of technologies that have been on the table for some time. Silicon photonics is one such technology. We’ve been hearing about it for years, but now, moving data electrically on boards and in semiconductors may no longer meet demand. Coherent optics is another technology that has gained importance, both in OFC exhibithall products and technical sessions. It uses I/Q modulation, which is common in wireless communications. Coherent optics modulates amplitude, frequency, and polarization, which increases data rates on a fiber.
Today, DSP chips in the optical modules convert signals from electrical to optical and back. The DSP takes electrical digital signals, retimes them, and converts them into analog to drive the optical engine.
Linear-drive optics (LDO), also called linear-drive pluggable optics (LPO), moves the DSP out of the pluggable optical module and into the network switch. With LDO, the electrical signal arrives in the module in analog form, ready to drive the laser. Shifting to LDO can reduce energy consumption, size, and cost in optical modules. AI is expected to bring many more optical cables to data centers and move computing from the cloud to the network edge. Moving DSP chips to the switch makes them easier to cool, and there’s no need to replace the DSP just because the module needs replacement.
The need for speed is already pushing 224 Gb/sec electrical links. Once it’s in production, we’ll see 800G optical links running on 4 x 200 Gb/sec lanes. The moment that happens, the race for 1.6T (8 x 200 Gb/sec lanes) commences. In my experience, what we hear at OFC regarding data rates translates into talks at the following year’s DesignCon.
Martin Rowe,
Senior Technical Editor
Leave a Reply
You must be logged in to post a comment.