"Nvidia's Jetson AGX Thor Developer Kit is predicted to fly off store shelves: Initial reviews affirm that this product is poised to be a hidden gem by Nvidia."
NVIDIA has made a significant stride in the realm of robotics and edge AI development with the launch of the Jetson AGX Thor Developer Kit, unveiled on March 16, 2023. The new platform, manufactured by NVIDIA, is poised to make a splash in the market, as predicted by ServeTheHome, who dubbed it as "going to sell like hotcakes."
In a series of tests, the Jetson AGX Thor demonstrated impressive performance, outperforming its predecessor, the Jetson Orin, across every model. On smaller workloads such as Qwen 2.5-VL 7B and Llama 3.1 8B, the Jetson AGX Thor performed around 1.3 times faster, while on larger models like Deepseek-R1 7B, it showed an improvement of about 1.5 times.
The Jetson AGX Thor's CPU multi-threaded performance was comparable to an AMD Ryzen AI 7 350 or Mac Mini M4, showcasing its power and efficiency. This performance boost is attributed to the Jetson AGX Thor's architecture, built on the Blackwell platform, which features a GPU with 2,560 CUDA cores, 96 Tensor cores, and a 14-core Arm Neoverse CPU.
The Jetson AGX Thor comes equipped with 128GB of LPDDR5x memory and 1TB of onboard storage, providing ample space for complex projects. Connectivity options include USB C, USB A, HDMI 2.1, Wi-Fi 6E, Bluetooth, Gigabit Ethernet, and a 100GbE port, ensuring seamless integration with various devices.
HotHardware's testing revealed the Jetson AGX Thor to be a strong performer, particularly with large language models, which performed well in testing. Nvidia's Arm64 containers ran smoothly during testing, although testing against other Blackwell hardware wasn't possible, and the older Orin kit failed to complete workloads.
Both ServeTheHome and HotHardware agreed that the Jetson AGX Thor is a capable step forward for edge AI and robotics projects. ServeTheHome's review found that the Jetson AGX Thor Developer Kit's performance on Llama 3.1 8B was close to Nvidia's claims, with 149.1 tokens per second. They concluded that the Jetson AGX Thor offers the compute and memory needed for advanced robotics.
The Jetson AGX Thor's performance was compared to that of an RTX 3050 and RTX 5070 in testing, underscoring its power and potential for high-performance applications in the field of AI and robotics. The included 1TB SSD in the Jetson AGX Thor was identified as a WD/SanDisk SN5000S.
In summary, the Jetson AGX Thor Developer Kit is a powerful tool for developers seeking robust hardware for their projects in the realm of robotics and edge AI. Its impressive performance, ample storage, and versatile connectivity options make it a compelling choice for those looking to push the boundaries of AI and robotics technology.
Read also:
- Impact of Alcohol on the Human Body: Nine Aspects of Health Alteration Due to Alcohol Consumption
- Understanding the Concept of Obesity
- Microbiome's Impact on Emotional States, Judgement, and Mental Health Conditions
- Criticisms levelled by a patient advocate towards MPK's judgement on PCR testing procedures
