Intel· @intel · X·· 17 天前AI 评分36
AI 导读
将 AI 从试点推向生产,并不意味着要更换你的基础设施。 最新的 MLPerf Inference v6.1 结果显示,持续的软件和系统级优化使 Intel Xeon 处理器相比 v6.0 实现了 2.4 倍的 Llama 3.1 8B 服务器吞吐量提升和 56% 的离线吞吐量提升。 了解详情:https://www.intel.com/content/www/us/en/newsroom/news/data-center/intel-software-optimizations-boost-ai-inference-in-mlperf-v6-1.html
AI 生成摘要 · 以原文为准
正文
Moving AI from pilot to production shouldn't mean replacing your infrastructure.
The latest MLPerf Inference v6.1 results showed how continued software and system-level optimizations help Intel Xeon processors deliver 2.4x higher Llama 3.1 8B server throughput and 56% higher offline throughput compared with v6.0.
来源:Intel · x.com