NVIDIA unveils most affordable generative AI supercomputer
NVIDIA is putting generative AI within reach of more people with a new compact supercomputer that offers increased performance at a lower price.
The new NVIDIA Jetson Orin Nano Super Developer Kit, which fits in the palm of a hand, provides gains in generative AI capabilities and performance for everyone from commercial AI developers to hobbyists and students, the company said, for US$249 (down from US$499).
The kit can be used to run the most popular generative AI models, like vision transformers, large language models, vision-language models, and more, and delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102 GBps compared with its predecessor.
The developer kit consists of a Jetson Orin Nano 8 GB system-on-module (SoM) and a reference carrier board, providing an ideal platform for prototyping edge AI applications. The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a six-core Arm CPU, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions.
Jetson runs NVIDIA AI software including NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI and NVIDIA Holoscan for sensor processing. Development time can be reduced with NVIDIA Omniverse Replicator for synthetic data generation and NVIDIA TAO Toolkit for finetuning pretrained AI models from the NGC catalogue.
Jetson ecosystem partners offer additional AI and system software, developer tools and custom software development. They can also help with cameras and other sensors, as well as carrier boards and design services for product solutions.
The software updates to boost 1.7x generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules. Existing Jetson Orin Nano Developer Kit users can obtain the performance boost by upgrading the Jetpack software development kit (SDK).
Comments
Post a Comment