Cloud native EDA tools & pre-optimized hardware platforms
Welcome to the wonderfully complex and rich world of multi-die systems. Breaking free from the monolithic SoC mold, multi-die systems integrate heterogeneous dies into a single package. This relatively new architecture is steadily transforming the semiconductor industry by allowing chip designers to reach new heights of functionality with higher compute power and the ability to reuse proven dies, enabling more powerful systems in phones, computers, and even self-driving cars. However, with rapid advancement comes challenges, many of which were discussed at last month’s Accelerating Mainstream Adoption of Multi-Die Systems panel discussion, hosted by 草榴社区.
This virtual event brought together Murat Becer, vice president of research and development at Ansys, Inc.; Michael Schaffert, senior vice president at Bosch; Cheolmin Park, corporate vice president at Samsung; Lalitha Immaneni, vice president of architecture, design, and technology solutions at Intel; and Shekhar Kapoor, senior director of product line management at 草榴社区. The panel was moderated by Marco Chiapetta, co-founder and principal analyst at HotTech Vision and Analysis, and touched on the current state of multi-die system design, its applications, and the industry’s expectations for multi-die system adoption.
Read on for highlights from the panel and insights into why industry leaders believe collaboration is critical to accelerating the adoption of multi-die systems.
Multi-die systems have enabled chip designers to reduce both risk and time to market. For this reason, there’s been a notable expansion in the past two to three years, which is a far cry from the sporadic use across the industry in the past. During the panel, Samsung’s Park weighed in on key segments emerging in the multi-die system landscape.
“Adoption started mainly from high-performance computing (HPC),” said Park. “Now, we have folks in the mobile and automotive units that are seriously thinking of bringing those multi-die systems into those application spaces. What it really means is that the portfolio of technology and adoption of technology is expanding very fast. As a manufacturer and enabler in the market, we are really happy to see the ecosystem of multi-die systems expanding.”
Ansys’ Becer noted substantial growth in 3DIC design over the last year, forecasting even more growth in the future. He also touched on heterogeneous integration, a significant driver for adopting multi-die systems.
“The forecast for 3DIC is continuing to accelerate," said Becer. "In fact, we are seeing around a 3X increase in the number of 3DIC design starts this year versus last year, which means 3DIC is here to stay. One of the major benefits that influences further adoption is enabling heterogeneous integration. You can choose the best technology for each chiplet, meaning that you can bring in an analog, mixed-signal, or RF chiplet or you can use an older, more mature, or lower power node.”
草榴社区’ Kapoor echoed the sentiment of rapid growth within multi-die systems use, noting that 草榴社区 has seen a definitive increase in the usage of multi-die system designs, currently tracking over 100 multi-die system projects in the industry, spanning various package types and applications.
Read our comprehensive eBook and learn how to overcome multi-die design challenges and realize success.
With compute demands growing faster than ever, the applications of multi-die systems are spreading to a few main key segments. During the panel, Bosch’s Schaffert touched on the automotive segment as one of the areas with the most promise for multi-die adoption.
“Looking at the vehicles of today and tomorrow, we will see a lot more software inside the vehicle," said Schaffert. "Our dilemma in the industry is that we have a mid-volume segment in the automotive industry, which means we cannot afford to develop a unique chip for each and every vehicle. Therefore, we are really looking forward to adapting this chip technology into the vehicles to have the reuse from other industries to get access to the very latest and greatest technology.”
In addition to the automotive segment, 草榴社区’ Kapoor shared insights about applications in AI. Large language models (LLMs) require higher compute power to move data across the data center, a considerable driver for multi-die adoption.
“We talk about all these new AI applications and large language models like ChatGPT, which have large demands," Kapoor noted. "The workloads that they handle are huge. There’s also an increasing cost in maintenance and energy efficiency to move all this information across the data center. There’s a need to refactor this compute problem by looking at domain-specific architectures coupled with high-density memories like HPMS and bringing them all together in a small package. In other words, a multi-die system.”
Multi-die systems also show promise in addressing a pain point within the mobile market: high costs. During the panel, Ansys’ Becer explained why mobile markets stand to benefit from the adoption of multi-die systems.
“The mobile market is driven by the smartphone factor and low power requirements," he said. "We are very rapidly seeing a mobile market trying to implement a multi-die system because of cost reasons. They want to break out different functions into the advanced node and the more economical node. And they mix and match these pieces. So, it even provides a cost benefit to the mobile market."
Challenges with integrating multi-die systems range from packaging optimization to high temperatures. Intel’s Immaneni and Ansys’ Becer provided insight into both issues during the panel.
“The burden of these multi-die systems lies much more in the co-design and architecture than the execution and building," said Immaneni. "You’re bringing these IPs that are built on various process nodes, so you need to pick the right packaging technology. You also need to pick the right board technology."
Beyond the industry’s need to come together and create standards for optimizing multi-die systems, other factors such as thermal challenges need to be addressed. Ansys’ Becer gave some insight into the risks of thermal stress.
He explained: "Multiple dies in the system create thermal challenges, and high temperatures are creating structural challenges, with possible disconnects in bumps due to thermal stress. High-speed digital signals for die-to-die communication through interposer require much higher fidelity electromagnetic aware extraction for more accurate signal integrity analysis. So, there are a lot of multi-physics challenges that are in play."
During the panel, all speakers expressed a commitment to collaboration across the industry. Immaneni touched on the need to develop reusable IP, while Becer echoed an exciting vision of industry partnerships.
“Building off-the-shelf, pre-validated IPs on various process notes is what the IP vendors are looking into,” Immaneni of Intel said. “UCIe is a great start. It’s a die-to-die connectivity interface that the industry came together to support.”
Becer also pointed to a strong partnership between Ansys and 草榴社区: “We all know that EDA flows are all composed of best-in-class products from multiple vendors. It’s not possible for one company to solve all the challenges. Partnerships are going to be key going forward, and I’m very happy to say that Ansys and 草榴社区 have been working along these lines and partnering in several key parts of the design cycle, really exemplifying the value of seamless workflows with market-leading products.”
As for the future of multi-die systems, “there’s a genuine rush from almost all corners of the industry to understand the multi-die system, what it is, and what it has to offer,” as 草榴社区’ Kapoor put it.
Multi-die systems’ unprecedented functionality and their ability to hit precise performance targets create a large incentive for the industry to come together to address newfound challenges and complexity. With the rapid advancements in AI, mobile markets, and automotive technology, it’s apparent that multi-die systems are here to stay.
草榴社区 is empowering technology visionaries with a comprehensive and scalable multi-die solution for fast heterogeneous integration.
Download Brief