Scaling Small Language Models (SLMs) for Edge Devices: A New Frontier in AI

nextcomputingIndustry

Via Forbes.com, article by Santhosh Vijayabaskar Learn about the growing importance of Small Language Models (SLMs) in the field of AI, particularly for edge devices. SLMs are lightweight neural network models designed to perform specialized natural language processing tasks with fewer computational resources. They typically range from a few million to several billion parameters and are optimized for efficiency, making … Read More

Intel, Ampere show running LLMs on CPUs isn’t as crazy as it sounds

nextcomputingIndustry

Via The Register “Popular generative AI chatbots and services like ChatGPT or Gemini mostly run on GPUs or other dedicated accelerators, but as smaller models are more widely deployed in the enterprise, CPU-makers Intel and Ampere are suggesting their wares can do the job too – and their arguments aren’t entirely without merit.” NextComputing is proud to offer systems featuring … Read More

‘For many AI applications, GPUs are compute overkill, consuming much more power and money than needed’: How Ampere Computing plans to ride the AI wave

nextcomputingIndustry

Via TechRadar Pro “Ampere Computing is a startup that’s making waves in the tech industry by challenging the dominance of tech giants like AMD, Nvidia, and Intel. With the rise of AI, the demand for computing power has skyrocketed, along with energy costs and demand on power grids. Ampere aims to address this with a low-power, high-performance solution. “Despite being … Read More

AMD Ryzen Threadripper 7980X flexes as world’s most powerful HEDT CPU by powering past all Xeon and EPYC chips on PassMark

nextcomputingAMD, Industry

Via NotebookCheck “The AMD Ryzen Threadripper 7980X has turned up on PassMark and immediately left its mark near the top of the CPU Mark table. The Zen 4-based Storm Peak part defeated all EPYC and Xeon chips in its path and was only kept off the top spot by Threadripper PRO 7000 SKUs. AMD calls the Ryzen Threadripper 7980X the … Read More

AMD Ryzen Threadripper 7980X & 7970X Review: Many-Core Desktop Supremacy

nextcomputingIndustry

Via hothardware.com PC enthusiasts, workstation users, and regular readers will no doubt be aware of Threadripper. They are AMD’s ultra-powerful, many-core processors that target the professional workstation or High End Desktop (HEDT) markets. With the introduction of the Threadripper Pro and Threadripper 7000 series, AMD leverages its Zen 4 architecture and has re-introduced an HEDT-focused selection of processors to address … Read More

The Best GPUs for Deep Learning

nextcomputingIndustry, nvidia

PhD student from the University of Washington, Luke Zettlemoyer, has written a comprehensive and insightful article on the best GPUs for deep learning. Deep learning is a field with intense computational requirements, and your choice of GPU will fundamentally determine your deep learning experience. When it comes to the most important GPU specs for deep learning processing speed, Tensor Cores … Read More

Intel’s Xeon W9-3495X processor claims world record

nextcomputingIndustry, Intel

Via https://www.techradar.com/news/intel-breaks-cinebench-r23-world-record-with-its-super-powerful-sapphire-rapids-chip Intel’s Xeon W9-3495X 56-core workstation processor has claimed a new world record in rendering using the Cinebench R23 benchmark. Despite having 8 fewer cores and 16 fewer threads than the previous record holder, the W9-3495X managed to achieve 132,484 points in Cinebench R23’s multicore performance. This is more than 10,000 points higher than the previous world-record holder. Though … Read More

NVIDIA GeForce RTX 3060 8GB Tested

nextcomputingIndustry, nvidia

NextComputing offers portable workstations for video encoding and live video streaming with vMix and the latest NVIDIA GPUs. Check out VideoCardz.com test of the RTX 3060 below. NVIDIA GeForce RTX 3060 8GB Tested