I tested NVIDIA Nemotron Super 120B locally on a single NVIDIA DGX Spark using BenchLocal to see how well it handles real-world AI tasks.
The model completed the benchmark, but the results were mixed:
Overall score: 45.2/100
Passed: 27 tests
Partial: 10 tests
Failed: 41 tests
Instruction Following: 11/100
Reasoning and Math: 81/100
Bug Finding: 77/100
In this video, I show the full local setup, benchmark process, performance, and the areas where Nemotron Super 120B struggled. A model running locally does not always mean it will perform well across every task.
Subscribe for more real-world local AI model tests on the NVIDIA DGX Spark.
#Nemotron #DGXSpark #LocalAI #NVIDIA #AIModels #BenchLocal #LLMBenchmark
ข้อเสนอแนะ
รายงาน
ห้ามทำซ้ำหรือดัดแปลงโดยไม่ได้รับอนุญาตจากครีเอเตอร์
ข้อเสนอแนะ
รายงาน