To understand where Nvidia is going with N2X and N3X, you have to look at how computers are built today. Right now, chips are hitting physical limits. You cannot simply shrink transistors indefinitely without running into massive heat and power issues. To get around this, Nvidia is shifting its focus to advanced packaging and optical interconnects. This means instead of one giant piece of silicon, they are linking multiple smaller chips together using light instead of traditional copper wires.
What does this look like in practice? The N2X and N3X systems will likely rely heavily on silicon photonics, which uses lasers to move data at lightning speeds between memory and processors. This drastically reduces the energy wasted as heat. We can expect these chips to consume massive amounts of power individually, but they will be far more efficient per calculation. Nvidia is also designing these systems to work as giant, unified data center computers rather than standalone chips. If you want a computer that can reason, talk, and solve complex science problems instantly, you need a system that can handle petabytes of data in real-time. That is the exact engineering challenge N2X and N3X are designed to solve.
