New chip for AI computing at light speed

A new silicon photonics platform for vector–matrix multiplication.

Penn Engineers have developed a new chip that uses light, rather than electricity, to perform the complex math essential to training AI. The chip has the potential to radi­cally accelerate the processing speed of computers while also reducing their energy consumption. The silicon-photonic (SiPh) chip’s design is the first to bring together Nader Engheta’s pioneering research in mani­pulating materials at the nanoscale to perform mathe­matical compu­tations using light with the SiPh platform, which uses silicon, the cheap, abundant element used to mass-produce computer chips.

Nader Engheta manipulates materials at the nanoscale to perform mathematical...
Nader Engheta manipulates materials at the nanoscale to perform mathematical computations using light. (Source: F. Macera, UPenn)

Engheta’s group developed the new chip together with that of Firooz Aflatouni. “We decided to join forces,” says Engheta, leveraging the fact that Aflatouni’s research group has pioneered nanoscale silicon devices. Their goal was to develop a platform for performing vector-matrix multi­plication, a core mathematical operation in the development and function of neural networks, the computer architecture that powers today’s AI tools. Instead of using a silicon wafer of uniform height, explains Engheta, “you make the silicon thinner, say 150 nanometers,” but only in specific regions. Those variations in height – without the addition of any other materials – provide a means of controlling the propa­gation of light through the chip, since the variations in height can be distributed to cause light to scatter in specific patterns, allowing the chip to perform mathe­matical calcu­lations at the speed of light.”

“Due to the constraints imposed by the commercial foundry that produced the chips”, Aflatouni says, “this design is already ready for commercial appli­cations, and could potentially be adapted for use in graphics processing units (GPUs), the demand for which has skyrocketed with the widespread interest in developing new AI systems. They can adopt the Silicon Photonics platform as an add-on and then you could speed up training and classi­fication.”

In addition to faster speed and less energy consumption, Engheta and Aflatouni’s chip has privacy advantages: because many computations can happen simul­taneously, there will be no need to store sensitive information in a computer’s working memory, rendering a future computer powered by such technology virtually unhackable. “No one can hack into a non-existing memory to access your infor­mation,” says Aflatouni. (Source: UPenn)

Reference: V. Nikkhah et al.: Inverse-designed low-index-contrast structures on a silicon photonics platform for vector–matrix multiplication, Nat. Phot., online 16 February 2024; DOI: 10.1038/s41566-024-01394-2

Link: Engheta Group, Dept. of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, USA

Award

AutomationsBest Award

AutomationsBest Award

The AutomationsBest Award is now entering its 3rd round. The award will be presented at SPS - Smart Production Solutions on 25 November 2025

Digital Events

Digital Event Calendar 2025
live or on demand

Digital Event Calendar 2025

By participating in our free digital events, you can stay up to date in your field of expertise.

most read