AI takes command: No rest for the data warriors

AI is reshaping data centre operations with unblinking precision-predicting failures, cutting energy waste, and fighting downtime in real time.

- BY PUNAM SINGH

As Artificial Intelligence (Al) continues to evolve, data centres are undergoing a fundamental transformation. The demand for Al applications now necessitates specialised infrastructure and new operating models. Al is also being harnessed to manage the very hardware that powers it, shifting data centre operations from manual oversight to intelligent, automated systems.

According to Rohan Sheth, Head - Colocation and Data Centre Services at Yotta, while many Al use cases are still emerging, applications developed over the past five to ten years have already played a pivotal role in predictive operations. “Data centres are mission-critical facilities where downtime is unacceptable,” Sheth remarks. “The main selling point of a good data centre is zero downtime throughout the year, which is possible through predictive maintenance.”

Traditional data centres are designed to manage general computing workloads, such as hosting websites or running databases. In contrast, Al-focused datacentres are built for high-performance computing, training and deploying Al models. This necessitates a unique setup: Al data centres use specialised processors such as Graphics Processing Units (GPUs), Tensor Processing Units, and dedicated Al accelerators capable of handling parallel processing.

Common choices for such tasks include NVIDIA's H100, B200, and GB200 chips. While these chips take on the heavy computational load, Central Processing Units (CPUs) continue to manage data flow and support the accelerators.

High-speed data transfer between processors is critical in AI environments. AI workloads generate immense east-west traffic, particularly between GPU clusters, requiring both high bandwidth and ultra-low latency. To meet this demand, AI data centres employ low-latency connections, such as InfiniBand, and advanced Ethernet standards, like 400G and 800G.