Contact Us
Blog / Beyond the GPU: Components Driving the AI Server Boom

Beyond the GPU: Components Driving the AI Server Boom

Posted: November, 2026 Last Updated: November, 2026 Writer: Julia Wu Share: NEXTPCB Official youtube NEXTPCB Official Facebook NEXTPCB Official Twitter NEXTPCB Official Instagram NEXTPCB Official Linkedin NEXTPCB Official Tiktok NEXTPCB Official Bksy

Beyond the GPU: The Components Driving the AI Server Boom (and What They Mean for Your BOM)

Illustration of an AI server GPU surrounded by six component groups: MLCC capacitors, inductors, MOSFETs, connectors, cooling and optics

Ask anyone what powers the AI boom and they will say GPUs. But a GPU is useless without the parts around it: capacitors that steady its supply, power devices that convert hundreds of amps, connectors that move data at 224G per lane, optical modules that join racks together, and cooling hardware that keeps it all alive. Those parts are bought from the same distributors, and assembled on the same kinds of boards, as the components in your industrial, medical, automotive or networking product.

That is why AI demand is no longer only an "AI company" problem. When high-end parts are pulled toward data centers, lead times and prices move for everyone. This article focuses on where the pressure is greatest, with the most space given to three areas that get less attention than they deserve: 48V power devices, 224G connectors and optical modules. For topics we have already covered in depth, we link to those guides instead of repeating them.

Key Takeaways

  • Demand is polarized. High-end, high-capacitance and AI-grade parts are tight, while many general-purpose parts remain available. Check each part number rather than assuming.
  • Power architecture is changing. The move to 48V distribution is reshaping MOSFET, capacitor and inductor choices.
  • Interconnect is the next speed bump. 224G connectors and 800G/1.6T optics push signal-integrity demands down to the footprint level.
  • Sourcing risk belongs in the design phase. Long-lead parts, alternates and package-specific assembly needs are cheapest to fix before layout is frozen.

The Six Component Groups at a Glance

Six component groups behind AI server hardware: MLCC capacitors, inductors, MOSFETs, high-speed connectors, cooling hardware and optical modules
Component group Why demand is rising Where to read more
MLCC capacitors Thousands per accelerator board for decoupling; tight supply of high-capacitance parts MLCC for AI server power delivery
Inductors and magnetics High-current VRM and bus-converter stages Power inductor selection and placement
MOSFETs and power devices 48V conversion and hot-swap protection (covered below) This article
High-speed connectors 224G backplane, mezzanine and near-ASIC cable systems (covered below) This article; see also 112G PAM4 board design
Heat sinks and thermal materials Rack power density is pushing liquid cooling; thermal hardware is a reported bottleneck Thermal management and liquid cooling integration
Optical modules 800G today, 1.6T ramping (covered below) This article

Capacitors, Inductors and Cooling: The Short Version

MLCCs. Figures attributed to Murata put an ordinary server at roughly 2,200 to 4,000 MLCCs and an NVIDIA GB300-class AI server at about 30,000. TrendForce reported that book-to-bill ratios at Murata, Samsung Electro-Mechanics and Taiyo Yuden reached 1.30, 1.31 and 1.25 in late June, the highest since the pandemic, and said the fourth quarter will show whether the high-end segment becomes a full shortage. Distributor reporting has AI-related passive prices up 15% to 35% this year. For selection, sizes and decoupling strategy, read our MLCC guide; for sourcing tactics, see our article on the passive component shortage.

Inductors. High-current shielded and flat-wire inductors are harder to make than standard ferrite parts, and lead-time trackers saw inductors appear on watch lists as an early sign of wider passive tightening. Footprint, copper weight and thermal planning are covered in our power inductor guide.

Cooling. Flex notes that liquid cooling has become a necessity at the power levels of the latest AI processors, and Sourceability's Q3 lead-time report calls thermal management a key bottleneck, with lead times and prices expected to rise through Q4. Board-level techniques such as thermal vias, copper coins and stiffeners are covered in our guides on thermal management and liquid cooling integration.

MOSFETs and the Shift to 48V Power

One of the quietest but most consequential changes in AI hardware is the move from 12V to 48V distribution. A magnetics supplier's technical note puts it plainly: quadrupling the voltage cuts current to a quarter and distribution losses by a factor of sixteen. In practice, a 48V bus feeds an intermediate bus converter that steps down to 12V, followed by multiphase point-of-load stages that supply the processor core, as described in Arrow's overview of AI power conversion.

48V power delivery chain from rack bus through hot-swap protection, bus converter and point-of-load stages to the GPU core
Source: Coilmaster Electronics; Arrow

Semiconductor makers have responded with parts built for this architecture:

  • Hot-swap protection. ROHM released a 100V MOSFET aimed at hot-swap circuits in 48V AI server systems, emphasizing wide safe operating area (SOA), and Alpha and Omega Semiconductor introduced a high-SOA device in an LFPAK 8x8 package for the same job.
  • Secondary-side conversion. ROHM also offers 80V parts for the secondary AC-DC stage of 48V server power supplies, in a compact 5 x 6 mm package.
  • Market outlook. One market forecast values AI server power MOSFETs at about USD 1.3 billion in 2024, rising to roughly USD 4 billion by 2031. Treat any single forecast cautiously, but the direction is consistent: more conversion stages, higher efficiency targets and stricter thermal behavior.

What it means for your build:

  • Voltage ratings ripple outward. A 48V bus calls for higher-rated MOSFETs and, as Samsung has pointed out, 100V-class high-capacitance MLCCs in server power supplies and power modules. Those are exactly the parts under pressure.
  • Thermal design starts at the pad. Compact power packages rely on generous copper, thermal via arrays or via-in-pad, and controlled solder voiding. Ask your assembler how voiding is inspected, typically with X-ray.
  • Creepage and clearance change. Higher voltage means revisiting spacing rules and surface finish choices before layout, not after.
  • Check availability early. Lead-time trackers cite power devices as an emerging bottleneck alongside AI accelerators, so confirm stock and alternates before freezing a layout.
Cross-section of a PCB under a power MOSFET showing the solder joint, copper pad, thermal via array, inner copper planes and bottom copper heat path

High-Speed Connectors: Where the Channel Starts

At 224G PAM4, the connector is no longer a passive detail. As Altium's guidance on 224G design puts it, the connector and cable system become part of the channel from day one. The industry has moved quickly to support this. Molex offers a 224G portfolio that includes a genderless backplane system, a near-ASIC connector-to-cable system and an enhanced mezzanine board-to-board connector. TE Connectivity offers its own 224G cabled backplane and board-mount line.

A notable design pattern is the "flyover" or near-chip cable: rather than running the fastest signals through long PCB traces, designers carry them above the board on twinax cable and attach it close to the ASIC. This lowers loss, but it does not make the board easier. The breakout region, the connector footprint and the nearby vias still decide whether the channel meets its budget. Molex also supports PCIe Gen 6 at 64 Gbps with its NextStream internal I/O family, a reminder that even "slower" internal links are getting tighter.

Comparison of traditional PCB trace routing and flyover cable routing for 224G signals between an ASIC and a connector

What it means for your build:

  • Footprints are part of the electrical design. Follow the connector vendor's recommended pad, anti-pad and via guidance exactly, and share the datasheet with your manufacturer before layout is final.
  • Via stubs matter. Backdrilling and tight via structures are standard tools at these speeds.
  • Assembly tolerances tighten. BGA-attach mezzanine connectors and dense press-fit parts raise the bar for placement accuracy and inspection.
  • Track lifecycle. High-speed connector families are specific to a speed generation, so record alternates and lifecycle status in the BOM.

For material and stack-up choices at these data rates, see our guides on 112G PAM4 board design and high-speed PCB materials.

Optical Modules: The Network Behind the Compute

An AI cluster is only as useful as the network that joins it, and optics are scaling fast. Cignal AI reported that 400G and 800G module shipments nearly quadrupled in a year to more than 20 million units in 2024, with revenue above USD 9 billion. TrendForce now estimates the market for AI-focused optical transceivers will grow from about USD 16.5 billion in 2025 to USD 26 billion in 2026, and expects 800G-and-above modules to account for more than 60% of shipments this year.

Bar chart of the AI optical transceiver market growing from USD 16.5 billion in 2025 to an estimated USD 26 billion in 2026
Source: TrendForce

Architecture is driving the numbers. TrendForce projects that Google's TPU deployments alone could generate demand for more than 6 million 800G-plus modules this year, and notes that moving a cluster from 800G to 1.6T can be done by swapping in faster modules rather than rebuilding the system. Looking further out, silicon photonics and co-packaged optics shift more of the work to wafer-level processes, and TrendForce sees this pulling new players, including outsourcing partners in Southeast Asia, into AI optical communications.

What it means for your build:

  • Host boards get harder. Boards that carry optical cages and modules need controlled impedance, clean reference planes and careful placement of the cage and connector.
  • Heat and signal integrity compete. Optical modules dissipate real power in a small footprint, so thermal path and signal path must be planned together.
  • Supply is diversifying. Optical supply chains are being restructured, so if you buy modules or cages, confirm sourcing and country-of-origin requirements with your supplier early.

Board-Level Ripple Effects

These component changes sit on top of a board story. According to TrendForce, NVIDIA's Rubin generation uses a 24-layer HDI switch tray with M8U-class materials, while some interface and midplane boards use M9-class materials with up to 104 layers. Industry commentary suggests such boards will be hybrid constructions that use premium materials only where the loss budget demands them. That is also why PCB capacity and laminate supply are tightening, which we explain in why AI demand is pushing PCB prices up. For stack-ups and via structures, see our HDI guide, and for an overview of what sits inside these systems, What Is an AI Server?

A Sourcing and Design Checklist

Risk What to do
Long-lead capacitors, inductors and power devices Run a BOM availability check before layout freeze; flag high-capacitance, 100V and high-SOA parts first
Single-source dependency Qualify alternates with the same footprint and ratings, and record them in the BOM
Connector and cage footprints Use vendor-recommended footprints and share datasheets with your manufacturer before layout
Thermal surprises Plan copper, thermal vias, stiffeners and heat-sink mounting at stack-up stage
Price swings between quote and build Confirm pricing and stock at order time; consider partial or full turnkey sourcing to lock parts

How NextPCB Can Help

NextPCB is not a hyperscale rack builder, and this article does not claim we build the most extreme boards on the market. Where we fit is the broad group of AI-adjacent and high-reliability products: accelerator and edge-AI cards, power boards, networking and test hardware, and the prototypes and pilot runs that come before them.

  • Multilayer and HDI fabrication: up to 32 layers, HDI Class III and any-layer structures, with blind, buried and filled vias. See our advanced PCB capabilities.
  • High-speed support: ±5% impedance control, stack-up optimization, backdrilling and low-loss high-speed laminates.
  • Turnkey PCBA: fabrication, component sourcing and assembly in one workflow, with full turnkey, partial turnkey or consigned options. See PCB manufacturing and assembly.
  • DFM and BOM review: our engineers can check stack-up, footprints and sourcing risk before you commit to a build.

Working on a design that leans on tight-supply parts or demanding signal integrity? Request a quote and send your BOM and stack-up for a manufacturability and sourcing review.

FAQ

Is every component in short supply right now?

No. Analysts describe the tightness as concentrated in high-end and AI-grade parts. Many general-purpose components remain available, which is why checking each part number matters.

Why does 48V power matter for my BOM?

Higher bus voltage changes the ratings you need for MOSFETs, capacitors and protection circuits, and it affects spacing rules on the board. Those higher-rated parts are often the ones with the longest lead times.

Do I need to use the newest connectors and optics to stay competitive?

Not necessarily. Match connector and module speed to your real bandwidth need and upgrade path. For many deployments, 800G is the practical choice today, with 1.6T as a planned upgrade.

When should I involve my manufacturer?

Before layout is final. Stack-up, impedance targets, connector footprints and part availability are far cheaper to adjust on paper than after boards are built.

Sources

  1. TrendForce: AI demand for high-end MLCCs drives book-to-bill ratios to post-pandemic highs
  2. 36Kr: MLCC demand in AI servers
  3. Rand Technology: The next AI bottleneck may be an MLCC
  4. Sourceability: Q2 lead time report highlights
  5. Sourceability: Q3 lead time report highlights
  6. Accuris: Electronic component lead times
  7. Flex: Harnessing liquid cooling in AI data centers
  8. Coilmaster Electronics: AI server power (48V to 12V to POL)
  9. Arrow: Enhancing power conversion efficiency for AI applications
  10. Electropages: ROHM 100V MOSFET for AI servers
  11. Electronics For You: Power MOSFETs for server efficiency
  12. Alpha and Omega Semiconductor: 48V hot-swap MOSFET
  13. Mobility Foresights: AI server power MOSFET market
  14. Altium: Designing for 224G
  15. Electronic Design: Molex 224G chip-to-chip connectivity
  16. Molex: High-speed internal I/O connectors
  17. TE Connectivity: 224G backplane solution
  18. Converge Digest: Cignal AI on 400G and 800G optical module shipments
  19. TrendForce via I-Connect007: 800G+ optical transceiver share
  20. TrendForce via I-Connect007: AI interconnect boom and optical outsourcing
  21. TrendForce: Rubin cableless architecture and high-layer HDI
  22. I-Connect007: What AI servers are asking of the PCB
Author Name

About the Author

Julia Wu - Senior Sales Engineer at NextPCB.com

With over 10 years of experience in the PCB industry, Julia has developed a strong technical and sales expertise. As a technical sales professional, she specializes in understanding customer needs and delivering tailored PCB solutions that drive efficiency and innovation. Julia works closely with both engineering teams and clients to ensure high-quality product development and seamless communication, helping businesses navigate the complexities of PCB design and manufacturing. Julia is dedicated to offering exceptional service and building lasting relationships in the electronics sector, ensuring that each project exceeds customer expectations.