AI grids optimise inference on distributed networks

Source: NVIDIA. Concept visual for an AI grid. 3D shapes overlaid on an aerial view of a city.
Source: NVIDIA. Concept visual for an AI grid.

At NVIDIA GTC 2026, leading operators announced that they are leveraging their network footprint to power and monetise new AI services across the distributed edge.

Telcos and distributed cloud providers are using AI grids — geographically-distributed and interconnected AI infrastructure — to facilitate a new class of AI‑native applications that are real‑time, hyperpersonalised, concurrent and token-intensive, NVIDIA has said.

- Personal AI is using NVIDIA Riva to power human‑grade conversational agents on the AI grid. By running small language models closer to users, it achieves sub-500 millisecond end-to-end latency and over 50% lower cost-per-token, enabling voice experiences that feel natural while remaining economically viable at scale. Riva is a software development kit for building speech-related AI apps.

- Linker Vision is transforming city operations by running real‑time vision AI on the AI grid. By processing thousands of camera feeds across distributed edge sites, it delivers predictable latency for live detection and instant alerting — enabling safer, smarter cities with up to 10x faster traffic accident detection, 15x faster disaster response and sub‑minute alerts for unsafe crowd behaviour.

- Decart is redefining hyperpersonalised distributed media by bringing real‑time video generation to AI grids. By running its Lucy models at the network edge, it achieves sub‑12-millisecond network latency, enabling interactive video streams and overlays that adapt instantly to each viewer, delivering smooth, immersive live video experiences even when viewership peaks.

A growing ecosystem of full‑stack partners, including Cisco and infrastructure partners like HPE, are bringing AI grid solutions to market on systems built with the NVIDIA RTX PRO 6000 Blackwell Server Edition. Armada, Rafay and Spectro Cloud are among the partners building an AI grid control plane to seamlessly orchestrate workloads across distributed AI infrastructure.

Hashtags: #AIInfrastructure, #GTC, #GTC2026, #NVIDIARTX, #Telecommunications

Comments

Popular posts from this blog

Fortinet enhances FortiRecon to align with CTEM framework

SentinelOne recognised as a 2025 Gartner Peer Insights Customers’ Choice for XDR

AWS: AI adoption grows 20% in Singapore