Today for AI
返回全部资讯
llama.cpp 与 ggml 发布 1.0 版本Hacker News AIT2·开源与评测

ggml 发布 v1.0.0 无依赖张量库正式定版

原标题：Ggml v1.0.0
58AI 研判分

ggml 发布 v1.0.0，标志着这一支撑 llama.cpp 生态的底层张量库首次进入正式版本化阶段。其核心卖点是无依赖纯 C/C++ 实现、跨 x86/ARM/RISC-V 等多架构、2 至 8 位整数量化并支持 MXFP4 与 NVFP4 微缩放格式，且运行时零内存分配。对本地推理与端侧部署开发者而言，这是生态稳定性的重要信号。

关联知识实体

术语GGUF工具ggml工具llama.cpp术语MXFP4术语NVFP4

报道正文

本文目录3 个章节

ggml

Tensor library for machine learning

Quick start

Build from source:

BASH
git clone https://github.com/ggml-org/ggml
cd ggml

mkdir build && cd build
cmake ..
cmake --build . --config Release -j 8

For a minimal, fully commented example (matrix multiplication), see examples/simple.

Description

The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.

  • Plain C/C++ implementation without any dependencies
  • Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
  • SIMD-optimized kernels for x86, ARM, and RISC-V
  • Broad backend support - CPU, GPU, NPU, and browser
  • 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
  • Zero memory allocations during runtime

Documentation