When building an enterprise infrastructure to train deep neural networks, why do engineers deploy dedicated AI accelerators (such as GPUs, TPUs, or NPUs) rather than expanding their cluster using standard multi-core CPUs?
Select an answer to reveal the explanation.
Short Explanation
Here's the deal: deep learning is basically just a mountain of math—specifically, multiplying massive matrices of numbers over and over again. Think of a CPU like a genius mathematician who can solve incredibly complex problems, but only one at a time. That's sequential processing. Now, think of a GPU or TPU like thousands of elementary school kids who can all do basic addition at the exact same time. If you have a million simple addition problems, who wins? The kids, hands down! That's parallel processing. AI accelerators pack thousands of these smaller cores to crunch those math blocks simultaneously. Trust me, trying to train a modern AI model on CPUs is like trying to dig a swimming pool with a teaspoon. It'll take forever!
Full Explanation
Deep learning workloads, particularly the training and inference of large neural networks, are highly dependent on matrix multiplications and vector additions. These mathematical operations are inherently parallelizable, meaning they can be divided into thousands of independent, simultaneous calculations. Traditional Central Processing Units (CPUs) are designed for general-purpose computing. They typically feature a small number of complex, highly optimized cores (e.g., 8 to 64 cores per socket) designed to execute sequential tasks as fast as possible, using sophisticated branch prediction and large cache hierarchies. AI accelerators—such as Graphics Processing Units (GPUs), Tensor Processing Units (TPUs), and Neural Processing Units (NPUs)—are built with a completely different architecture. Instead of a few fast sequential cores, they contain thousands of smaller, simpler arithmetic logic units (ALUs) designed to perform parallel operations. This enables them to process large blocks of data simultaneously, leading to orders-of-magnitude improvements in throughput and energy efficiency for deep learning tasks. Let's check the other options: Option B is incorrect because facilities management systems and intelligent cooling controllers regulate cooling and power, not the AI accelerators themselves. Option C is incorrect because network infrastructure and security protocols are handled by switches, firewalls, and SmartNICs/DPUs (Data Processing Units), not AI accelerators like GPUs or TPUs. Option D is incorrect because backup and disaster recovery are software-defined storage management functions, not hardware features built into compute accelerators.