英文标题：Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation
作者：Ben Merbaum, Mohammad Amin Raeisi, Wenhao Wang, Charalampos Papamanthou, Katerina Sotiraki, Fan Zhang
arXiv ID：2609.10264 | 分类：cs.CR | 发表：2026-09-09
许可：CC-BY
摘要 开源LLM正日益与闭源模型相竞争，同时提供透明度，并能够在不将用户输入暴露给服务提供商的情况下运行推理。{{NL}}然而，在本地运行大规模模型需要大量计算资源。{{NL}}在实践中，用户可能仍会求助于第三方提供商，从而引发隐私和正确性方面的担忧。{{NL}}现有解决这些问题的方案往往给服务器带来大量开销，或引入额外的信任假设。 在本文中，我们提出了Maverick，一种基于矩阵–向量乘法委托协议的私有且可验证LLM推理新方法，矩阵–向量乘法是LLM中的主导操作。{{NL}}在其核心，Maverick提供了据我们所知首个信息论可靠的矩阵–向量乘法委托验证协议，具有透明预处理、高效（批量）验
Open-source large language models (LLMs) are increasingly competitive with closed-source models while offering transparency and the ability to run inference without exposing user inputs to a service provider. However, running large-scale models locally requires substantial computational resources. In practice, users may still resort to a third-party provider, giving rise to privacy and correctness concerns. Existing solutions that address these problems often impose substantial server overhead or introduce additional trust assumptions. In this paper, we present Maverick, a novel approach to private and verifiable LLM inference based on a protocol for delegating matrix-vector multiplication, a dominant operation in LLMs. At its core, Maverick provides, to our knowledge, the first information-theoretically sound verification protocol for matrix-vector multiplication delegation with transparent preprocessing, efficient (batch) verification, and virtually no server overhead. We combine this verification primitive with LPN-based pseudorandom masking to provide input privacy. We implement our matrix-vector delegation primitive and use it to build an end-to-end prototype of Maverick, which we evaluate on Qwen3-4B by measuring throughput in tokens per second. We evaluate client configurations with 1-8 threads. With one client thread and a CPU server using up to 128 threads, Maverick achieves throughput gains over local inference of up to 17x when privacy masks are generated online, 45x when they are precomputed, and 44x when only verification is required. With four client threads, the corresponding gains are 13x, 18x, and 17x. When server computation is no longer the bottleneck, client-side microbenchmarks with simulated network delay show speedups of 12x-20x, 34x-135x, and 38x-157x.
查看完整双语翻译 →
正在跳转到翻译阅读页… 如果没有自动跳转，请点击这里。