Efficient Scalable Oversight via Rewinding
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
Efficient Scalable Oversight via Rewinding Ziyi Guan∗
Yael Tauman Kalai†
Ron Rothblum‡
Zoe Xi§
Abstract
arXiv:2610.40535v1 [cs.AI] 29 Oct 2026
Scalable oversight asks how a weak verifier can check the outputs of computations performed by more powerful AI systems. One proposed approach uses relativizing interactive proofs, in which a weak verifier checks the output of a complex oracle-aided computation by interacting with one or more powerful provers. A prominent example is debate, which is highly efficient but assumes that one of two powerful AI models, or provers, is truthful. For certain classes of oracle-aided computations, this assumption can be removed, but at substantially greater computational cost. In this work, we introduce rewindable interactive proofs (RIPs), a new model of relativizing interactive proofs for scalable oversight. In an RIP, the verifier may rewind the prover to an earlier state of the interaction and continue from there. This is possible when the prover is an AI model, since the verifier can save a snapshot of the model’s state and later restore it. We construct a relativizing RIP for computations whose outputs are robust to changing a small fraction of oracle answers. Our construction is more efficient than prior relativizing proofs that do not assume a truthful prover, and it uses no cryptography. In our construction the honest prover runs in time linear in that of the original computation, and the verifier, after a one-time preprocessing step, runs in time nearly linear in the input length (which can be much smaller than the computation itself). We implement our protocol, report a preliminary MNIST experiment, and show that an RIP can be faster than a state-of-the-art deployed proof system. RIPs may be of independent interest. Rewinding is possible whenever the verifier controls the prover’s machine, for example when the prover runs on trusted hardware or in a virtual machine whose state can be checkpointed.
∗
MIT. ziyiguan@mit.edu. MIT. tauman@mit.edu. ‡ Succinct. rothblum@gmail.com § MIT. zoexi@mit.edu. †
1
Contents 1 Introduction 1.1 Our results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2 Related work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 4 6
2 Technical Overview
6
3 Preliminaries 3.1 Oracle-aided computation and robustness . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2 Interactive oracle proofs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.3 Error-correcting codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.4 Encoded-witness IOPs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8 9 10 11 13
4 Relativizing Interactive Oracle Proofs 4.1 Construction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2 Proof of Theorem 4.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
15 16 16
5 Relativizing Rewindable Interactive Proofs 5.1 Definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.2 From IOPs to RIPs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.3 RIPs with linear-time provers and succinct verifiers . . . . . . . . . . . . . . . . . . . .
17 18 19 20
6 Implementation and Experiments 6.1 Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2 MNIST experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3 Comparison with a SNARG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.4 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
22 22 22 24 25
AI Disclosure
26
Acknowledgments
26
References
26
A Multi-prover interactive proofs A.1 Relation to RIPs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
32 33
2
1
Introduction
As AI capabilities grow rapidly, a critical problem is: how can we ensure that AI systems remain safe and behave as intended? One major concern is that, as we are training AI models to perform increasingly complex tasks, we may no longer be able to efficiently verify the accuracy of their outputs. As a result, we may not be able to verify that they are behaving in a way that aligns with our intentions. This problem of providing accurate training supervision for increasingly powerful AI models is known as scalable oversight. Verifiable computation has been studied for decades in cryptography and computational complexity. This research has led to proof systems that allow a powerful but untrusted “prover” (in our setting, a powerful AI model) to convince a weak “verifier” (a weaker AI model or a human) that the output of a hard computation is correct [BGKW88; FK97; AS98; ALMSS98; GKR15; RVW13; BCS16; RRR16]. In this work, we observe that scalable oversight has some unique characteristics that make existing approaches either inapplicable or less efficient than they could be. First, the prover is not an external party but rather an AI model whose execution the verifier controls. In particular, the verifier can rewind the model to an earlier state and continue the interaction without the model remembering what happened in previous runs. To capitalize on this, we consider a new proof-system model which we call rewindable interactive proofs (RIPs),1 in which the verifier is allowed to rewind the prover in this way. This model is closely related to previous proof-systems studied in the literature such as MIPs [BGKW88] and PCPs [FK97; AS98; ALMSS98], but we show that it can have significant efficiency gains over them. Second, classical results in proof systems do not apply directly to our setting, because the computations we wish to verify may involve functions that we can’t see the inner workings of—such a function can be used to represent human judgment or query access to an external database, for example. We model such “black-box” functions as oracles, and say that a proof system relativizes if its guarantees hold with respect to any oracle. Relativization is believed to be essential for AI safety purposes, because we do not know what sorts of capabilities AI may have in the future. The UK AISI team even writes that “in order to be relevant to AI safety, an interactive proof result must relativize” [IM25]. The difficulty is that classical results in proof systems, including the celebrated IP = PSPACE and MIP = NEXP theorems, do not relativize [CCGHHRR94], and moreover results show that efficient verification is impossible for arbitrary oracle-aided computations [FS88; FRS94; HCCRR92; For94; CL20; BCG25]. For a concrete example of where scalable oversight is needed, consider the scenario of training an LLM to determine which laws a company has violated based on hundreds of pages of records. The LLM outputs one bit for each law (representing yes or no), and now we need to verify whether these bits are correct or not. The straightforward way of doing this would be to have a human expert carefully read through the documents, but this seems unreasonably expensive, especially to produce just one training label. In a scenario like this, we would like to have a more efficient training protocol, especially one that is more efficient in its use of human judgments. As another example, we may consider a scenario where we train an LLM to answer questions using a large public dataset, such as the web; we would like to be able to verify that an output of this LLM is correct efficiently, making few queries to the dataset. Various approaches to scalable oversight have been proposed in the literature [CSA18; LKEMML18; ICA18], including some based on relativizing proof systems. One prominent example of such an approach is debate, which was introduced by Irving, Christiano, and Amodei [ICA18]. In an AI debate, there are two powerful AI models, or provers, who claim different outputs, and the provers debate each other to try to convince a verifier that their output is the correct one. The verifier is extremely efficient, or succinct, meaning that it runs in much less time and makes far fewer oracle queries than it would need to run the computation on its own. The authors show that DEBATE, the class of problems which admit 1
Not to be confused with another RIP. Our provers are merely rewound, never harmed.
3
a debate protocol, is powerful: in the language of computational complexity theory, DEBATE = PSPACE (where PSPACE is the class of problems solvable in polynomial space). Moreover, this result relativizes. However, debate makes the strong assumption that one of the provers is truthful, i.e., one of the AI models is guaranteed to argue for the correct answer. Intuitively, this means that the verifier has one of the powerful AI models on his side. But scalable oversight is especially important precisely when we do not know whether we can trust any AI model. Recently, Chen, Kalai, and Xi [CKX26] sought to remove this assumption by constructing “doubly-efficient” interactive proofs [GKR15]. In an interactive proof [GMR19; Bab85], a prover interacts with a verifier to convince him of a claim; a doubly-efficient one has an efficient prover as well as an efficient verifier. Since this is impossible for arbitrary oracle computations, [CKX26] instead give protocols for a natural restricted setting where the computation is robust, meaning that the output does not change even if a small fraction of answers to oracle queries are modified. However, these protocols still require substantially more work from the verifier than debate. A natural question, then, is: Can we obtain a more efficient relativizing interactive proof without assuming any prover is truthful? Motivated by this question, we give a positive answer for robust oracle computations in the RIP model: by exploiting the verifier’s ability to rewind the prover, we obtain strong efficiency guarantees without assuming that any prover is truthful.
1.1
Our results
We introduce and formally define rewindable interactive proofs, and construct a relativizing RIP for robust oracle-aided computations, with a succinct verifier and a linear-time prover. We also implement our protocol and evaluate its performance experimentally. The model. In an interactive proof, a prover and a verifier exchange messages, after which the verifier accepts or rejects. The proof must be complete, meaning that the honest prover convinces the verifier of a correct output, and sound, meaning that no cheating prover can convince it of an incorrect output, except with small probability. An RIP is an interactive proof in which the verifier has one extra power: at any point, it may rewind the prover to an earlier state of the interaction and continue from there, as one would restore an AI model from a save point (Section 5.1 gives the formal definition). Completeness is as usual: the honest prover must convince the verifier, now across whatever rewinds the verifier performs. Soundness, on the other hand, asks less than it does of a standard proof system. A standard proof system must be sound against every cheating prover, however it behaves; an RIP need only be sound against provers that the verifier can rewind, whose answer after a rewind cannot depend on anything the verifier did after the restored state. This is a weaker guarantee, and it is what makes the model powerful: the verifier can question the prover about one state as many times as it likes, and the prover never learns the other questions. We emphasize that soundness violated if a cheating prover has access to external storage that is not rewound. A relativizing RIP for robust computations. Following Chen, Kalai, and Xi [CKX26], we model the computation as an oracle Boolean circuit and call it ε-robust if its output does not change when up to an ε fraction of the oracle’s answers are modified. Our main result is a relativizing RIP for verifying the output of any robust oracle circuit, with a succinct verifier and a prover that runs in linear time. Theorem 1.1 (Informal; see Theorem 5.8). Let C O be an oracle circuit with n input bits, m output bits, and S gates, whose oracle queries have polylogarithmic length. After a one-time preprocessing step taking e + m + S) time, there is a relativizing RIP for verifying the output of C O on any input with respect O(n to which it is ε-robust, with the following guarantees: 4
• The honest prover always convinces the verifier of a correct output, while a cheating prover (even a computationally unbounded one) can convince the verifier of an incorrect output with probability at most 1/3. e + m + 1/ε) time and makes O(1/ε) oracle queries. • The verifier runs in O(n e • The honest prover runs in O(n + m + S) + O(1/ε) time. e • The number of rounds is O(log(n + m + S)) and the total communication is O(1/ε). e hides factors polylogarithmic in n + m + S, and running times count field operations. Here O(·) In the preprocessing step, the verifier reads the description of the circuit and stores a representation of it, which it reuses in every evaluation of the circuit; the cost is thus amortized over all evaluations, which suits our setting, where a fixed circuit is evaluated on many inputs. Some such step is necessary to achieve online verification time sublinear in the size of a general circuit, and preprocessing is standard in efficient proof systems [CHMMVW20; Set20; CBBZ23]; see Remark 3.22. Comparison with [CKX26] and debate. Compared with the protocols of [CKX26], after the preprocessing step our verifier’s running time depends only on the lengths of the input and output and on the robustness parameter, instead of on the size or depth of the circuit, and its number of oracle queries depends only on the robustness parameter; compared with their succinct protocol, ours is statistically sound, uses no cryptography, and has a linear-time rather than a polynomial-time prover. Unlike debate, our protocol does not assume that a prover is truthful. Why not concretely efficient SNARGs? The proof systems deployed in practice, notably in blockchains [BSCGGMTV14; Tha22], are SNARGs, succinct non-interactive arguments. Why not take one off the shelf? First, off-the-shelf SNARGs do not handle oracle-aided computations, even robust ones. Second, their soundness rests on unproven cryptographic assumptions, from standard ones such as collision-resistant hash functions to more aggressive ones chosen for concrete efficiency. As AI brings such assumptions under increasing scrutiny (recent AI-discovered results, still under review, claim to refute the Exponential Time Hypothesis [Ope26; Cla26] and, assuming them, give a subexponential algorithm for the elliptic-curve discrete logarithm problem [ABHKNNTW26]), it is unclear whether this is a prudent tradeoff for scalable oversight. RIPs address both concerns: they handle robust oracle-aided computations without cryptographic assumptions and are sound even against computationally unbounded provers. Perhaps surprisingly, dispensing with cryptography can also improve prover efficiency: rewinding avoids the cost of cryptographic commitments (Remark 5.9), and our second experiment demonstrates the resulting speedup. Experiments. We complement our theoretical result by implementing the protocol and running two experiments. The first is a proof-of-concept experiment inspired by the MNIST debate experiment of Irving, Christiano, and Amodei [ICA18]: we run the protocol once, at soundness error 2−40, on robust oracle circuits with between 28 and 226 oracle gates, whose oracle is the debate experiment’s judge, a sparse MNIST classifier. Across this range the verifier makes a median of about 76 oracle queries, against up to 226 needed to evaluate the largest circuit directly, and its online running time falls below that of direct evaluation from about seven million oracle gates on, to an eighth of it at the largest size. For our second experiment, we consider Flock [BRW26], a state-of-the-art SNARG built from an interactive oracle proof (IOP) [BCS16; RRR16] (see Section 2) for batch evaluation of the BLAKE3 hash function. To study the efficiency gains of rewinding, we compile Flock’s IOP into an RIP and find that its prover runs 1.8 to 2.1× faster than Flock’s own SNARG prover (Section 6.3).
5
1.2
Related work
Relativizing proof systems. Relativization has been studied extensively as a barrier in computational complexity theory, and notably the classical results on interactive proofs, e.g., the celebrated IP = PSPACE and MIP = NEXP theorems, do not relativize [CCGHHRR94]. Additionally on the negative side, results show that efficient verification is impossible for arbitrary oracle-aided computations (even when the security guarantee is relaxed to hold only against efficient dishonest provers) [FS88; FRS94; HCCRR92; For94; CL20; BCG25]. Our work circumvents these barriers by restricting to the setting of robust oracle computation. On the positive side, prior work has shown that IP = PSPACE and MIP = NEXP do algebrize, meaning that they relativize if the proof system is also given a low-degree extension of the oracle [AW09], and there has also been work on constructing relativizing succinct cryptographic proof systems in some structured oracle models [CT10; CCS22; CCGOS23; CGSY24; CKX26]. Interactive proofs for scalable oversight. There has been a recent line of work studying interactive proofs as an approach to scalable oversight, starting with a paper by Irving, Christiano, and Amodei on “AI safety via debate” [ICA18]. Their model assumes that the debating provers are computationally unbounded; later, Brown-Cohen, Irving, and Piliouras introduced doubly-efficient debate, where the provers are guaranteed to be efficient [BIP24]. More recent works on debate have focused on its limitations, e.g, the “obfuscated arguments problem,” where a lying debating prover can make it very hard for the other prover to find the flaw in her argument [Bar20; BIP25; BPHI25]. Very recently, Chen, Kalai, and Xi initiated the study of relativizing interactive proofs for scalable oversight without a truthful prover, constructing protocols with a succinct verifier and a polynomial-time prover for certain classes of oracle computations [CKX26]. Our work considers the setting of robust computation that they introduce; we leverage rewinding to improve the efficiency of their protocols. Interactive proofs for trustworthy machine learning. There is also a line of work on applying interactive proofs to problems of trust in machine learning [AGPR24; AZWG21; HAD24; KCELMB24; WSTZP24]. In particular, Amit, Goldwasser, Paradise, and Rothblum [AGPR24] introduce self-proving models, which are trained to provide both an answer and an interactive proof that the answer is correct; their focus is on training models to produce proofs for computations that already admit interactive proofs, whereas we construct new interactive proofs for oracle-aided computation.
2
Technical Overview
Here, let us briefly outline the key ideas behind our construction. We model the computation that the verifier wishes to verify as an oracle Boolean circuit C O , i.e., a Boolean circuit that may contain gates that make calls to an arbitrary oracle O : {0, 1}∗ → {0, 1}. We assume that the oracle circuit is ε-robust with respect to the verifier’s input, meaning that its output on this input does not change if at most an ε-fraction of answers to its oracle queries are changed (see Definition 3.14 for a formal definition). Given an oracle circuit C O , an input x for which C O is ε-robust, a claimed output a, and access to O, the prover and the verifier engage in a rewindable interactive proof (RIP, Section 5) that C O (x) = a. Recall that the verifier may rewind the prover to any earlier state of the interaction and continue from there. Our goal is to design a protocol that is efficient enough to use in practice. Most practical proof systems are built from an interactive oracle proof (IOP) [BCS16; RRR16], which is an interactive proof where the prover sends long messages but the verifier reads only a few bits of each message, because IOPs admit very efficient provers and verifiers. We first construct a relativizing IOP and then turn it 6
into a relativizing RIP that inherits the IOP’s efficiency. A relativizing IOP (Section 4). To start, a natural strategy is to try to turn the oracle circuit C O into a circuit without oracle gates and then use standard IOPs. To “deoraclize” the circuit, suppose that the prover provides a string w containing a claimed answer for each oracle gate. We can then define a circuit Cw without oracle gates, which is C O except with each oracle gate replaced by the corresponding answer in w. The basic idea is to have the prover send the string w in the first round of the IOP and then prove that Cw (x) = a. Then the verifier can check that the answers in w are correct with respect to O. The verifier cannot check that all the answers in w are correct, since this would require making all the oracle calls needed in order to run the computation, which he cannot afford. But the verifier does not actually need to do this, since we assume C O is ε-robust: if C O (x) = ̸ a, then any w satisfying Cw (x) = a must contain more than an ε-fraction of incorrect oracle answers, so the verifier can catch an incorrect oracle answer with good probability by sampling O(1/ε) answers in w. To obtain stronger efficiency guarantees, instead of w itself, we have the prover send an encoding of a witness consisting of w together with a “transcript” of evaluating Cw on x. The prover and verifier then run an IOP to check that this encoding is close to the encoding of a valid witness for Cw (x) = a. The advantage of using an encoding is that the verifier can later recover a few bits of this same witness, with the prover’s help, without reading the entire witness. In particular, the verifier can sample a few oracle gates, recover the claimed answer in w for each oracle gate and the corresponding query using the transcript, and check that the pair is correct using O. To achieve this, we construct a variant of an IOP that we call an encoded-witness IOP (Section 3.4). Relativizing IOP → relativizing RIP (Section 5.2). Now we turn our relativizing IOP into a relativizing RIP. The idea is similar to the one behind the standard proof for turning a (non-relativizing) IOP into an MIP [BCS16] (see Section A for MIPs and their relation to RIPs). We have the RIP verifier simulate the IOP verifier and the RIP prover simulate the IOP prover, except that the “IOP” prover computes her long messages but does not send them. If the verifier simply asked the prover for the bits he wants to read, she could answer adaptively, e.g., her answer to the verifier’s second query to some message could depend on his first query. Instead, whenever the verifier wants to read a bit in some message, he rewinds the prover to her state right after she computed that message and asks her for the bit. Her answer then cannot depend on his other queries, so she cannot do better than an IOP prover who fixes each message before the verifier queries it, and the soundness error is that of the IOP. Rewinding thus allows the RIP to be as efficient as the IOP. Experiments (Section 6). We implement our protocol and run two experiments. The first evaluates it on robust oracle circuits and measures what the verifier saves over evaluating the circuit directly. The second compares it with an existing proof system. Since no relativizing protocol has an implementation, we compare with a state-of-the-art proof system for an oracle-free computation, which is built from an IOP: compiling the same IOP into an RIP instead measures what rewinding saves. The first experiment is a proof of concept inspired by the MNIST debate experiment of Irving, Christiano, and Amodei [ICA18]. We use a sparse MNIST classifier, which predicts a digit from six revealed nonzero pixels of an MNIST image, to define our oracle. Given a “sparse view” of an MNIST image and a candidate digit, the oracle outputs whether the classifier predicts that digit. Our circuits query this oracle on many random sparse views of an image and output whether a majority of the views vote for the candidate digit. We run the protocol once, at soundness error 2−40, on 50 MNIST test images while increasing the number qC of oracle gates from 28 to 226. The robustness parameter remains nearly constant across these circuit sizes, and the median number of oracle queries made by the verifier stays between 74 and 80. At the largest circuit size, the verifier makes 840,000× fewer oracle queries than are needed to evaluate the 7
circuit directly. The verifier’s online running time is also sublinear in the circuit size, growing substantially more slowly than direct evaluation: it falls below direct evaluation at about seven million oracle gates, and at qC = 226 is 0.12× the time required to evaluate the circuit directly. The prover, which also generates the witness, takes about 60× the time of direct evaluation at the largest sizes. For the second experiment we use Flock [BRW26], a proof system for batch evaluation of an ordinary Boolean circuit with no oracle gates, namely the BLAKE3 hash function. Flock is built from an IOP, which is not by itself a realistic proof system, since the prover sends long strings; Flock compiles it into a SNARG using cryptography. We compile the same IOP into an RIP instead, which saves the cryptographic compilation: the prover no longer commits to its proof strings, and since a cheating prover gets one attempt per execution rather than unlimited offline retries, the IOP can run at a lower security level and over a smaller field. On instances of size 222 to 234, our prover runs 1.8 to 2.1× faster than Flock’s prover (Section 6.3).
3
Preliminaries
Here we introduce some definitions and tools that we use. Definition 3.1 (Language). A language L ⊆ {0, 1}∗ is a set of binary strings. We think of a language as a decision problem: given an instance ∈ {0, 1}∗, we want to determine whether ∈ L.
x
x Definition 3.2 (Relation). A relation R ⊆ {0, 1} × {0, 1} is a set of pairs (x, w), where x is an instance and w is a witness for x. The language associated with R is L := {x : ∃w(x, w) ∈ R}. ∗
∗
Definition 3.3 (Oracle and oracle access). An oracle is a fixed function O : {0, 1}∗ → {0, 1}; in particular, its answer to a query does not depend on earlier queries. We write that an algorithm has oracle access to O if it can send a query qry ∈ {0, 1}∗ and receive the answer string O(qry) in one timestep. Definition 3.4 (Relativized language). For an oracle O, a relativized language LO is a language whose membership may depend on O. Definition 3.5 (Relativized relation). For an oracle O, a relativized relation RO is a relation whose membership may depend on O. Its associated relativized language is LRO . Definition 3.6 (Equality polynomial). Let F be a finite field and h ≥ 0 an integer. The equality polynomial eq : Fh × Fh → F is eq(r, e) :=
h Y
riei + (1 − ri)(1 − ei) .
i=1
For b, e ∈ {0, 1}h, eq(b, e) is 1 if b = e and 0 otherwise. Definition 3.7 (Multilinear extension). Let F be a finite field and h ≥ 0 an integer. We interpret every h vector v ∈ F2 as a function v : {0, 1}h → F. The multilinear extension of v is the unique polynomial b v : Fh → F of degree at most one in each variable satisfying b v(b) = v(b) for every b ∈ {0, 1}h. Explicitly, X b v(r) = v(b) eq(r, b), b∈{0,1}h
where eq is the equality polynomial (Definition 3.6). For a binary string of length 2h, we view its bits as elements of F and use the same definition. For a vector or string of any other length, the multilinear extension is that of its zero-padding to the next power-of-two length 2h.
8
3.1
Oracle-aided computation and robustness
Following [CKX26], we model the computation that the verifier verifies as an oracle Boolean circuit. Informally, this is a diagram that shows how to obtain an output string from an input string by applying some sequence of OR (∨), AND (∧), and NOT (¬) operations together with calls to an oracle. More formally, we have: Definition 3.8 (Boolean circuit). An n-bit input, m-bit output Boolean circuit is a directed acyclic graph with n input vertices and an ordered list of m output vertices. Input vertices have no incoming edges; every other vertex is a gate labeled ∨ or ∧ with two incoming edges, or ¬ with one. Any vertex may be an output. A circuit C is given by its description ⟨C⟩, a binary string that lists its gates in a fixed order, each with its label and its incoming edges, followed by the list of output vertices; we refer to gates by their position in this list. On input x ∈ {0, 1}n, the value of the ith input vertex is the ith bit of x, and each gate applies its operation to the values of its children, i.e., the vertices with edges going into the gate. The output of the circuit on x consists of the values of the output vertices read in order. The size of a circuit is its number of gates. Definition 3.9 (Oracle Boolean circuit). For an oracle O : {0, 1}∗ → {0, 1}, an oracle Boolean circuit C O is a Boolean circuit that may also contain oracle gates. Each oracle gate has an arbitrary number of incoming edges. We view the input to an oracle gate as the string given by the values of its children read in order. The value of an oracle gate is O applied to its input string. Definition 3.10 (Family of circuits). A family of circuits {Cn}n∈N consists of one circuit Cn with an n-bit input and an m(n)-bit output for each n. It computes a function f : {0, 1}∗ → {0, 1}∗ if Cn(x) = f(x) for every n and every x ∈ {0, 1}n. Definition 3.11. Let C O be an oracle circuit of size S. We define the computation transcript on input x to be the string that lists the values of all the gates in C when run on input x in order (using O to evaluate oracle gates), and denote the computation transcript by z = TrCO (x) ∈ {0, 1}S . Definition 3.12. Suppose C O has qC oracle gates, and consider running C on an input x. We use QCO (x) = Q = ((qry1, ans1), . . . , (qryqC , ansqC )) for the string of queries and answers that C O makes to O on input x, where qryi (resp. ansi) is the input to (resp. output of) oracle gate i. Call Q a query-answer trace. We write Qin (resp. Qout) for the string of queries (resp. answers) in Q. Definition 3.13 (De-oraclized circuit). Let C O be an oracle circuit with an input of length n and qC oracle gates. We say that its de-oraclized circuit is the (non-oracle) circuit C with input (x, w) ∈ {0, 1}n ×{0, 1}qC obtained by replacing, for every j ∈ [qC ], oracle gate j with an input vertex with value wj . We next define robustness. Informally, the output of a robust oracle circuit should not change if at most a small fraction of answers to its oracle queries are incorrect. More formally, we define robustness as follows, adapting the definition that Chen, Kalai, and Xi use [CKX26]: Definition 3.14 (Robustness). Let C O be an oracle circuit with an input of length n and qC oracle gates, and let C be its de-oraclized circuit (Definition 3.13). For an input (x, w), where x ∈ {0, 1}n and w ∈ {0, 1}qC , and an index j ∈ [qC ], let qryj (w) denote the input to oracle gate j in C O when we run C O on x except with the value of each oracle gate replaced with the corresponding bit in w. For ε ∈ (0, 1], we say that C O is ε-robust with respect to x ∈ {0, 1}n if, for every w ∈ {0, 1}qC satisfying {j ∈ [qC ] : wj = ̸ O(qryj (w))} ≤ εqC , 9
we have that C(x, w) = C O (x). Definition 3.15 (Circuit-satisfiability relation). The circuit-satisfiability relation RCSAT is the relation defined as follows. The instance is a triple = (⟨C⟩, x, a), where ⟨C⟩ is the description of a Boolean circuit with n+nw input vertices, of which the first n form the public input and the remaining nw the private input, an output of length m, and S gates, x ∈ {0, 1}n is a public input, and a ∈ {0, 1}m is a claimed output. The witness is a pair = (w, z) ∈ {0, 1}nw × {0, 1}S of a private input and a transcript. Then
x
w
xw
( , ) ∈ RCSAT
⇐⇒
z = TrC (x, w) ∧ C(x, w) = a,
where TrC is the computation transcript of Definition 3.11. Definition 3.16 (Oracle-circuit-evaluation relation). Fix an oracle O. The oracle-circuitO evaluation relation RCVAL is the relativized relation (Definition 3.5) defined as follows. The instance O is a triple = (⟨C ⟩, x, a), where ⟨C O ⟩ is the description of an oracle circuit with an input of length n, output of length m, and S gates, x ∈ {0, 1}n is an input, and a ∈ {0, 1}m is a claimed output. The witness is a transcript z ∈ {0, 1}S . Then
x
x
O ( , z) ∈ RCVAL
z = TrCO (x) ∧ C O (x) = a,
⇐⇒
where TrCO is the computation transcript of Definition 3.11. Remark 3.17 (Transcript as witness). The witness of Definition 3.15 is a private input w together with the entire transcript z, and the witness of Definition 3.16 is the entire transcript. The transcript is not needed to define either relation, as it is determined by the instance and w in Definition 3.15 and by the instance alone in Definition 3.16. Including it nevertheless allows succinct verification, since the verifier can check an encoding of the witness at a few positions instead of evaluating the circuit (Definition 3.32, Lemma 3.36, and Theorem 4.1).
3.2
Interactive oracle proofs
An interactive oracle proof (IOP), introduced in [BCS16; RRR16], lets a powerful prover convince a weak verifier that an instance has a valid witness by sending long proof strings that the verifier checks at a few locations. The parties may interact over several rounds. Definition 3.18 (Interactive oracle proof). An interactive oracle proof for a relation R is an interactive protocol between a probabilistic polynomial-time verifier V and a possibly computationally unbounded prover P. The parties receive a common input , and the honest prover additionally receives a witness with ( , ) ∈ R. In round i, the prover sends a proof string πi over a finite alphabet Σ, which is a finite field in our constructions. The verifier has oracle access (Definition 3.3) to every proof string sent so far. The protocol satisfies the completeness and soundness properties defined below.
w
x
xw
w
x
We write ⟨P( ), V⟩( ) = 1 when the verifier accepts after interacting with the prover on common input . Note that we denote the IOP prover and verifier by P and V, rather than by P and V as for rewindable interactive proofs (Section 5) and MIPs (Section A), to distinguish between the settings. The probabilities below are over the verifier’s private random bits (we assume without loss of generality that the prover is deterministic).
x
xw
Definition 3.19 (Completeness). An IOP for R has perfect completeness if, for every ( , ) ∈ R, the honest prover satisfies Pr [⟨P( ), V⟩( ) = 1] = 1.
w
x
10
Definition 3.20 (Soundness). An IOP for R has soundness error ϵIOP if, for every e possibly computationally unbounded cheating prover P, h i e V⟩( ) = 1 ≤ ϵIOP(| |). Pr ⟨P,
x
x ∈/ L and every
x
Definition 3.21 (Relativizing IOP). Fix an oracle O and a relativizing relation RO . A relativizing IOP for RO is an IOP for RO in which the verifier and prover, including a cheating prover, have black-box access to the same oracle O. The protocol relativizes if its completeness, soundness, and efficiency guarantees hold for RO for every oracle O.
x
x x
x
Remark 3.22 (Preprocessing). An instance may have the form = ( pre, post), where pre is long and is the same for many instances. In our setting pre is the description of a circuit and post is an input together with a claimed output (Definition 3.16). An IOP with preprocessing has a verifier that is a pair V = (Vpre, Vpost). First Vpre receives pre and outputs a state stV . Then Vpost receives stV and post and interacts with the prover. The verifier reads pre only in the preprocessing, which is done once and whose state is reused for every post. Completeness and soundness are as in Definitions 3.19 and 3.20. For the verifier’s online time to be sublinear in the size of a general circuit, we need to preprocess the circuit. Intuitively, without preprocessing the verifier must read the entire circuit, since two circuits that differ in one gate can produce different outputs on the same input. Preprocessing is standard in deployed proof systems [CHMMVW20; Set20; CBBZ23]. Since we typically fix a circuit and evaluate it on many inputs, the one-time cost of preprocessing is amortized over all the evaluations. Preprocessing is unnecessary, however, for a circuit with a short description, since the verifier can then work from the description instead of reading the whole circuit [GKR15; CMT12; Tha13; XZZPS19]. It is also unnecessary when a circuit is evaluated on a batch of inputs, since the verifier can read the circuit once per batch [BRW26].
x
x
x
x
x
x
We track the following worst-case efficiency parameters of a (relativizing preprocessing) IOP: • Proof length ℓ: the total number of alphabet symbols in the proof strings. • Proof query complexity qπ : the total number of verifier queries to the proof strings. • Round complexity rIOP: the number of back-and-forth rounds between the verifier and the prover. Queries to proof strings do not count as interaction rounds. • Verifier oracle query complexity qO : the number of verifier calls to the oracle O, when present. These calls are counted separately from proof queries. • Verifier preprocessing time tVpre : for an IOP with preprocessing (Remark 3.22), the running time of Vpre, which bounds |stV |. • Verifier online time tV : the running time of Vpost, with random access to stV . • Prover running time tP : the honest prover’s total running time.
3.3
Error-correcting codes
An error-correcting code maps a message to a longer string, its codeword, so that any two codewords differ in many positions. A locally decodable code [KT00] lets a decoder recover any symbol of the message from a few queries to a (possibly corrupted) codeword, and a relaxed locally decodable code [BGHSV04] also allows the decoder to refuse to answer. Definition 3.23 (Distance). Let Σ be a finite alphabet and ℓ a positive integer. The distance ∆(π, π′) between π, π′ ∈ Σℓ is the fraction of positions in which they differ. The distance between π and a set S ⊆ Σℓ is ∆(π, S) := min ∆(π, π′), ′ π ∈S
11
and ∆(π, S) := 1 if S is empty. For δ ∈ (0, 1), we say that π is δ-close to S if ∆(π, S) ≤ δ, and δ-far from S otherwise. Definition 3.24 (Code). Let Σ be a finite alphabet and ℓ a positive integer. A code is a set C ⊆ Σℓ, whose elements are called codewords. Its relative distance is the minimum distance (Definition 3.23) between two distinct codewords, ∆(C) := min ∆(c, c′). ′ c̸=c ∈C
For a finite alphabet Γ and an integer k ≥ 0, an encoding is an injective map Enc : Γk → Σℓ. Its image is a code, and the relative distance of Enc is that of its image. We write I = (i1, . . . , i|I|) ∈ [k]∗ for a list of positions and |I := ( i1 , . . . , i|I| ) for the symbols of ∈ Γk at these positions.
w
w
w
w
Definition 3.25 (Relaxed local decoder). Let Enc : Γk → Σℓ be an encoding. A relaxed local decoder for Enc with query complexity qdec is a probabilistic algorithm Dec that receives a list I of positions, has oracle access to a string c ∈ Σℓ, reads at most qdec symbols of c, and outputs ζ ∈ Γ|I| ∪ {⊥}. We write ζ ← Decc(I) for its output. Definition 3.26 (Completeness). A relaxed local decoder for Enc has perfect completeness if, for every ∈ Γk and every list I of positions, Pr ζ = |I ζ ← DecEnc(w)(I) = 1.
w
w
Definition 3.27 (Decoding error). A relaxed local decoder for Enc has decoding error ϵdec : (0, 1) × N → [0, 1] if, for every proximity parameter δ ∈ (0, 1), every list I of positions, every ∈ Γk , and every ec ∈ Σℓ that is δ-close to Enc( ) (Definition 3.23), Pr ζ ∈ / { |I , ⊥} ζ ← Decec(I) ≤ ϵdec(δ, |I|).
w
w w
In this paper we use a more relaxed notion, interactive local decoding, in which a prover helps the decoder. This relaxation is what enables efficient proving and verification: the encoding of Lemma 3.31 has linear length, and decoding a few positions costs the prover linear time and the decoder polylogarithmic time in the message length. Definition 3.28 (Interactive local decoder). Let Γ ⊇ {0, 1} be a finite alphabet and let Enc : Γk → Σℓ be an encoding (Definition 3.24). An interactive local decoder for Enc is an interactive protocol between a probabilistic polynomial-time decoder D and a possibly computationally unbounded prover Pdec. The parties receive a common input I, a list of positions. The decoder has oracle access to a string π ∈ Σℓ, and the honest prover receives ∈ Γk with π = Enc( ). The prover sends proof strings as in an IOP (Definition 3.18), and at the end the decoder outputs ζ ∈ Γ|I| ∪ {⊥}.
w
w
w
We write ζ ← ⟨Pdec( ), Dπ ⟩(I) for the output of the decoder. We track the efficiency parameters of an interactive local decoder as for an IOP (Section 3.2), with the queries to π counted as proof queries. Definition 3.29 (Completeness). An interactive local decoder for Enc has perfect completeness if, for every ∈ Γk and every list I of positions, the honest prover satisfies Pr ζ = |I ζ ← ⟨Pdec( ), DEnc(w)⟩(I) = 1.
w
w
w
Definition 3.30 (Decoding error). An interactive local decoder for Enc has decoding error ϵdec : (0, 1) × N → [0, 1] if, for every proximity parameter δ ∈ (0, 1), every list I of positions,
12
w
w
every ∈ Γk , every π e ∈ Σℓ that is δ-close to Enc( ) (Definition 3.23), and every possibly computationedec, ally unbounded cheating prover P h i edec, Dπe ⟩(I) ≤ ϵdec(δ, |I|). Pr ζ ∈ / { |I , ⊥} ζ ← ⟨P
w
Lemma 3.31 ([BFRW26; Spi96]). Let k ≥ 1. There is a prime field F of size at least a sufficiently large polynomial in k and at most polynomial in k, and an injective encoding Enc : Fk → Fℓ with ℓ = O(k), computable in O(k) field operations, with relative distance at least a constant δEnc > 0, such that for every constant proximity parameter δ ∈ (0, δEnc/4) there is an interactive local decoder for Enc that, on a list I of positions, has the following parameters, where the constants in the O(·) depend on δ. • Perfect completeness. • Decoding error: ϵdec(δ, |I|) ≤ 1/12. • Round complexity: O(log k). • Proof query complexity: O(log k). • Proof length: O(k). • Prover time: O(k + |I|). • Verifier time: O((|I| + 1) log k). The decoder’s verifier has oracle access to a string of length k1/2+o(1) that depends only on k and is computable in that time; in Lemma 3.36 the verifier computes it in its preprocessing. Proof sketch. Enc is the encoding of TensorSwitch [BFRW26], a tensor code of two linear-time encodable codes of constant rate and constant relative distance [Spi96], so it has linear length, constant relative distance, and linear encoding time. TensorSwitch binds a string to a message by decoding its columns and then its rows, each within the unique decoding radius of the respective code; a string that is δ-close to Enc( ) with δ < δEnc/4 has few enough undecodable columns for this to recover , and in this regime the hypotheses of TensorSwitch on the codes hold for every linear code. The decoder works as follows. The prover sends the claimed values ζ ′ ∈ F|I| ofPthe positions picks a random r ∈ F|I|, P in I.′ The decoderP and the parties run a sumcheck for the claim i ui i = k rk ζk , where u := k rk eik has |I| nonzero entries. This reduces the claim to one evaluation of the multilinear extension of at a random point, which the parties check against π by running the remaining rounds of TensorSwitch’s commitment phase and its opening protocol. The decoder outputs ζ ′ if every check passes and ⊥ otherwise. If some ζk′ = ̸ ik , the combined claim is false except with probability 1/|F| over r, and then the sumcheck or the opening rejects except with error polynomially small in |F| plus the error of the opening, which is 2−λ for O(λ) queries; λ = 4 gives decoding error below 1/12. The prover runs the sumcheck in O(k) field operations, since u is sparse, and the opening in O(k). The verifier runs in O(log k) for the sumcheck, O(|I| log k) to evaluate the multilinear extension of u at the random point, and O(log k) for the opening, which reads a preprocessed string of length k1/2+o(1) that depends only on the code.
w
w
w
w
w
3.4
Encoded-witness IOPs
Here we define the notion of encoded-witness IOPs, which serve as a building block in our relativizing IOP in Section 4. An encoded-witness IOP is an IOP in which the prover’s first message is an encoding of its witness. Soundness is stated in terms of this first message [BCS16; BBHR18]. In addition, the encoding is required to have an interactive local decoder (Definition 3.28).
13
w
Definition 3.32 (Encoded-witness IOP). Let R be a relation whose witnesses are strings ∈ {0, 1}k , and let Enc : Γk → Σℓ be an encoding (Definition 3.24). An encoded-witness IOP for R with encoding Enc is an IOP with preprocessing (P, V) for R (Definition 3.18 and Remark 3.22) in which the prover’s first message is a proof string π1 ∈ Σℓ, and the honest prover sends π1 := Enc( ), where the encoding Enc has an interactive local decoder (Pdec, D) (Definition 3.28). We write
w
w
x
(π1, b) ← ⟨P( ), V⟩( ) where π1 denotes the first message of the prover and b denotes the decision bit of the verifier. The decoder has the completeness and decoding error of Definitions 3.29 and 3.30; the IOP has the completeness and soundness properties defined below. Definition 3.33 (Completeness). An encoded-witness IOP has perfect completeness if, for every ( , ) ∈ R, the honest prover satisfies
xw
w
x
Pr [b = 1 | (π1, b) ← ⟨P( ), V⟩( )] = 1.
x
w
xw
Definition 3.34 (Soundness). For an instance , let Cx := {Enc( ) : ( , ) ∈ R} be the set of encodings of valid witnesses. An encoded-witness IOP has soundness error ϵIOP : (0, 1) → [0, 1] if, for every proximity parameter δ ∈ (0, 1), every instance , and every possibly computationally unbounded e cheating prover P, h i e V⟩( ) ≤ ϵIOP(δ). Pr b = 1 ∧ ∆ π1, Cx > δ (π1, b) ← ⟨P,
x
x
Remark 3.35 (Holographic proofs). Encoded-witness IOPs are similar to holographic PCPs [BFLS91], PCPs of proximity [BGHSV04], and IOPs of proximity [BCS16; RRR16], in which the verifier has oracle access to an input and certifies that it is close to a language; here the input is the prover’s first message and the language is the set of encodings of valid witnesses. However, these proof systems only guarantee proximity to such an encoding, whereas we also need to recover positions of the witness from the first message, which is what the interactive local decoder provides. Lemma 3.36 (Encoded-witness IOP for circuits, adapted from [CBBZ23; CHMMVW20; BFS20; BFRW26]). Consider instances of RCSAT (Definition 3.15) whose circuit has a public input of length n, a private input of length nw , output length m, and S gates. Let N ′ := S +n+nw +m, and let Enc be the encoding with an interactive local decoder given by Lemma 3.31 for k := N ′, applied to the witness (w, z) padded with zeros to length N ′. Then, for every constant proximity parameter δ ∈ (0, δEnc/4), with δEnc as in Lemma 3.31, RCSAT has an encoded-witness IOP (Pew , Vew ) with encoding Enc with the following e hides factors polylogarithmic in N ′ and the constants in the O(·) depend on δ. parameters, where O(·) • Perfect completeness. • Soundness error: ϵIOP(δ) ≤ 1/12. • Round complexity: O(log N ′). • Proof query complexity: O(log N ′). • Proof length: O(N ′). • Prover time: O(N ′). e ′). • Verifier preprocessing time: O(N e + m). • Verifier online time: O(n Proof sketch. The IOP is the standard compilation of a polynomial IOP into an IOP [CHMMVW20; BFS20], applied to the polynomial IOP for circuit satisfiability of HyperPlonk [CBBZ23], with polynomials 14
sent as codewords of the encoding Enc of Lemma 3.31 and evaluation claims checked by the proximity test of TensorSwitch [BFRW26]. The prover’s first message is Enc(w, z), the encoding of the witness. The verifier’s preprocessing encodes the polynomials that describe the circuit and computes the string of Lemma 3.31, e ′) cost; its online work is that of the polynomial IOP’s verifier, which reads only the public which is its O(N input and output, plus a polylogarithmic number of queries. Whenever the polynomial IOP’s verifier queries a polynomial at a point, the prover answers with the evaluation, and the two run the proximity test on the encoding and the claimed evaluation. For soundness, since δ is below the unique decoding radius, every queried string is δ-close to at most one codeword, and the proximity test ensures, except with its error, that every answer is an evaluation of the polynomial that this codeword encodes. The soundness of the polynomial IOP then applies to the polynomial encoded by the first message, so if the verifier accepts with probability above 1/12, the first message is δ-close to the encoding of a valid witness. The prover runs in O(N ′) field operations, since the prover of HyperPlonk, the encoding, and the prover of the proximity test all do. The constants in the O(·) depend on δ through the proximity test’s query complexity.
4
Relativizing Interactive Oracle Proofs
In this section we construct a relativizing IOP (Definition 3.21) for the oracle-circuit-evaluation relation O RCVAL of Definition 3.16, that is, for proving that C O (x) = a. Theorem 4.1 (Relativizing IOP for robust oracle circuits). Fix an oracle O : {0, 1}∗ → {0, 1} and 0 < ε ≤ 1. Let C O be an oracle circuit with an input of length n, an output of length m, and S gates, and let N ′ := S + n + m. Suppose that the oracle queries of C O have length polylogarithmic in O N ′. Then RCVAL , for instances (⟨C O ⟩, x, a) with this circuit such that C O is ε-robust with respect to x, has a relativizing IOP with preprocessing (Remark 3.22) over a prime field of size polynomial in N ′ with the e hides factors polylogarithmic in N ′, running times count field operations, following properties, where O(·) and proof lengths count field elements. • Perfect completeness. • Soundness error: at most 1/3. • Round complexity: O(log N ′). • Proof query complexity: O(log N ′). • Verifier oracle queries: O(1/ε). • Proof length: O(N ′). e • Prover time: O(N ′) + O(1/ε). e ′). • Verifier preprocessing time: O(N e • Verifier online time: O(n + m + 1/ε). O Recall that we want a relativizing IOP for RCVAL , that is, for the claim that C O (x) = a, in which the verifier makes only a few queries to O. Without oracle gates this would be ordinary circuit satisfiability, which standard IOPs handle; the difficulty is the oracle gates, which the verifier cannot evaluate itself without making qC oracle queries. Intuitively, we can ask the prover to supply the answer to every oracle query. This turns C O into its de-oraclized circuit (Definition 3.13), an ordinary circuit whose evaluation an IOP can verify, and leaves the verifier with the task of checking that the supplied answers agree with O. Checking all of them would again take qC oracle queries, but by robustness a wrong output can only be reached by lying about more than an ε fraction of the answers, so a few random spot checks suffice. Concretely, the construction combines the encoded-witness IOP for circuits of Lemma 3.36 with random sampling of oracle gates. The prover encodes the evaluation of the de-oraclized circuit of C O
15
(Definition 3.13) on input x and the oracle answers in its transcript, and proves that the de-oraclized circuit outputs a. The verifier then samples a few oracle gates, decodes the query and the recorded answer at each of them from the encoded witness, and checks that each answer agrees with the oracle. By robustness (Definition 3.14), a wrong output forces more than an ε fraction of the recorded answers to be wrong, so O(1/ε) samples suffice. Section 4.1 gives the protocol and Section 4.2 proves the theorem.
4.1
Construction
O We describe the protocol (P, V) for RCVAL . Fix O, ε, and a field F as in Theorem 4.1, an instance O O = (⟨C ⟩, x, a) with pre = ⟨C ⟩ and post = (x, a), and the witness z = TrCO (x). Let C be the de-oraclized circuit of C O (Definition 3.13), let w ∈ {0, 1}qC be the values of z at the oracle gates, and let
x
x
x
u := w ∥ TrC (x, w), be the witness of RCSAT (Definition 3.15) for the instance (⟨C⟩, x, a). The answer at oracle gate j is the bit wj of u, and each bit of its query is a bit of x or of u, at a position determined by ⟨C O ⟩. Let (Pew , Vew ) be the encoded-witness IOP of Lemma 3.36 for a constant proximity parameter δ ∈ (0, δEnc/4), let Enc be its encoding, and let (Pdec, D) be the interactive local decoder of Enc for proximity parameter δ (Lemma 3.31). The protocol is as follows. 1. IOP: P and V run (Pew , Vew ) on (⟨C⟩, x, a) with witness u. This gives the first message π1 = Enc(u) and the decision bit b. 2. Decoding: V samples a uniformly random set {j1, . . . , jt} of t := min{qC , ⌈(ln 6)/ε⌉} oracle gates and lets I be the positions of their answers and query bits. Then P and V run (Pdec, D) on π1 and I, which gives ζ ∈ {0, 1}|I| ∪ {⊥}. Unless ζ = ⊥, this yields for each k ∈ [t] a decoded answer f k. f k at the jk -th oracle gate and, together with the bits of x, a decoded query qry ans f k for every k ∈ [t]. f k ) = ans 3. Decision: V accepts if and only if b = 1, ζ = ̸ ⊥, and O(qry
4.2
Proof of Theorem 4.1
Completeness. Suppose that C O (x) = a. Then w holds the answers of O in the evaluation of C O on x, so C(x, w) = a and (w, TrC (x, w)) is a valid witness. Hence b = 1 with probability 1 by the completeness of the encoded-witness IOP, and ζ = u|I with probability 1 by the completeness of the decoder (Lemma 3.31). f k is the query at the jk -th oracle gate and ans f k = O(qry f k ). The decoded bits are bits of u, so qry
x
e be a cheating prover for Soundness. Consider an instance = (⟨C O ⟩, x, a) with C O (x) = ̸ a, and let P our IOP. Since δ < δEnc/4 and Enc has relative distance at least δEnc (Lemma 3.31), the first message e is δ-close to the encoding of at most one string. Let (w∗, z∗) be this string if it is a valid witness π1 of P of RCSAT for (⟨C⟩, x, a), and ⊥ otherwise; it is determined by π1. We consider three events: • E1: (w∗, z∗) = ⊥ and b = 1; • E2: (w∗, z∗) = ̸ ⊥ and ζ ∈ / {(w∗, z∗)|I , ⊥}; f k ) = ans f k for every k ∈ [t]. • E3: (w∗, z∗) = ̸ ⊥, ζ = (w∗, z∗)|I , and O(qry If V accepts, then b = 1, ζ = ̸ ⊥, and every oracle check passes, so one of E1, E2, E3 occurs. Suppose toward a contradiction that h i e V⟩( ) = 1 > 1 . Pr ⟨P, 3
x
16
Then, by the union bound, Pr [E1] > 1/12, Pr [E2] > 1/12, or Pr [E3] > 1/6, and we show that each case is impossible. eew be the cheating prover for the encoded-witness IOP (Pew , Vew ) • Suppose Pr [E1] > 1/12. Let P e that runs P in the IOP step and then stops; the first message and the decision bit in this run are distributed as π1 and b in our protocol. When (w∗, z∗) = ⊥, the first message π1 is δ-far from Cx, the set of encodings of valid witnesses of RCSAT for (⟨C⟩, x, a), because it is δ-close to the encoding of at most one string and that string is not a valid witness. Therefore h i eew , Vew ⟩(⟨C⟩, x, a) ≥ Pr [E1] > 1 ≥ ϵIOP(δ), Pr b = 1 ∧ ∆(π1, Cx) > δ (π1, b) ← ⟨P 12 contradicting the soundness of Lemma 3.36 (Definition 3.34). • Suppose Pr [E2] > 1/12. By averaging, there is a transcript of the IOP step together with a choice of the sampled gates, which fix π1, (w∗, z∗) = ̸ ⊥, and I, conditioned on which E2 occurs with edec be the cheating prover for the decoder (Pdec, D) that has probability greater than 1/12. Let P e from the decoding step; the this transcript and these gates hardwired and continues to run P output of D in this run is distributed as ζ in our protocol under the same conditioning. Since π1 is δ-close to Enc(w∗, z∗), we get h i edec, Dπ1 ⟩(I) > 1 ≥ ϵdec(δ, |I|), Pr ζ ∈ / {(w∗, z∗)|I , ⊥} ζ ← ⟨P 12 contradicting the decoding error of Lemma 3.31 (Definition 3.30). • Suppose Pr [E3] > 1/6. When (w∗, z∗) = ̸ ⊥, it is a valid witness, so C(x, w∗) = a = ̸ C O (x), and ∗ ∗ by robustness (Definition 3.14) O(qryj (w )) = ̸ wj for more than εqC indices j ∈ [qC ], with qryj (·) as in that definition. On E3 the decoded bits are those of (w∗, z∗), so the k-th decoded pair is (qryjk (w∗), wj∗k ), and every oracle check passes only if no sampled gate is one of these indices. The sampled set is uniformly random and independent of (w∗, z∗), which is determined by π1, sent before the sampling. Hence Pr [E3] ≤ (1 − ε)t ≤ e−εt ≤ 1/6 if t = ⌈(ln 6)/ε⌉, and Pr [E3] = 0 if t = qC , a contradiction. Hence V accepts with probability at most 1/3. If qC = 0, then C(x) = C O (x) = ̸ a, so there is no valid witness and only E1 can occur. Efficiency. The circuit C has qC ≤ S private input bits and S − qC gates, so Lemma 3.36 applies to it with N ′ = S + n + m as in the statement of the theorem, and the list I has at most e t · wO ≤ ⌈(ln 6)/ε⌉ · wO = O(1/ε) positions, where wO is one plus the maximum fan-in of an oracle gate, which is polylogarithmic by hypothesis. The round complexity, proof query complexity, proof length, and prover time are the sums of those of the IOP in Lemma 3.36 and of the decoder in Lemma 3.31; e in particular the prover time is O(N ′) + O(|I|) = O(N ′) + O(1/ε). The the verifier preprocessing time is e that of the encoded-witness IOP plus the time O(S) to compute ⟨C⟩ and the positions from ⟨C O ⟩. The verifier makes t = O(1/ε) oracle queries, and its online time is that of the IOP plus that of the decoder e e + m + 1/ε). plus O(|I|) to read the positions and form the queries, for a total of O(n
5
Relativizing Rewindable Interactive Proofs
In this section we formally define relativizing rewindable interactive proofs (Section 5.1), show how to turn any relativizing IOP into a relativizing RIP (Section 5.2), and define the efficiency that we aim for and prove our main theorem (Section 5.3); in Section A.1 we show that RIPs are as powerful as MIPs. 17
5.1
Definition
As mentioned in Section 1, when the prover is an AI model, the verifier can save a snapshot of the model’s state and later restore it. We capture this by letting the verifier query the prover on any history of its choice. Since the prover may be assumed deterministic (Remark 5.6), it is determined by its next-message function, which maps the common input and a sequence (ρ1, . . . , ρj ) of verifier messages to the prover’s reply after receiving these messages in this order; querying it on a history is the same as restoring the snapshot taken after that history and sending the last message.
x
Definition 5.1 (Rewindable interactive proof). A rewindable interactive proof (RIP) for a relation R is a pair (P, V) of a deterministic prover, given by its next-message function P( , ·), and a probabilistic polynomial-time verifier V with oracle access to P( , ·), which it may query adaptively on any sequence of messages. The parties receive a common input , and the honest prover additionally receives a witness with ( , ) ∈ R. At the end, the verifier accepts or rejects. The protocol satisfies the completeness and soundness properties defined below.
w
x
x x
xw
We write VP(x,·)( ) = 1 when the verifier accepts after interacting with the prover on common input . The probabilities below are over the verifier’s random bits.
x
x
xw
Definition 5.2 (Completeness). An RIP for R has perfect completeness if, for every ( , ) ∈ R, the honest prover satisfies h i Pr VP(x,w,·)( ) = 1 = 1.
x
Definition 5.3 (Soundness). An RIP for R has soundness error ϵRIP if, for every e from sequences of messages to replies, function P
x
x ∈/ L and every
x
h i e Pr VP( ) = 1 ≤ ϵRIP(| |). Definition 5.4 (Relativizing RIP). Fix an oracle O and a relativized relation RO as in Definition 3.5. A relativizing RIP for RO is an RIP for RO in which the verifier and the prover, including a cheating prover, have black-box access to the same oracle O. The protocol relativizes if its completeness, soundness, and efficiency guarantees hold for RO for every oracle O. Remark 5.5 (Preprocessing). As in Remark 3.22, an RIP with preprocessing for instances of the form = ( pre, post) has a verifier that is a pair V = (Vpre, Vpost). First Vpre receives pre and outputs a state stV . Then Vpost receives stV and post and queries the prover. Completeness and soundness are as in Definitions 5.2 and 5.3.
x x x
x
x
Remark 5.6 (Deterministic prover). Assuming a deterministic prover loses no generality. For completeness, the honest prover’s random tape can be fixed and included in its state. For soundness, a randomized cheating prover is a distribution over deterministic next-message functions, so its acceptance probability is at most that of the best of them, provided that a snapshot includes the prover’s random tape. We consider the following efficiency parameters of a (relativizing preprocessing) RIP, where each query to P( , ·) counts as one message from the verifier and one from the prover:
x
• Round complexity rRIP: the number of back-and-forth rounds between the verifier and the prover. Queries made in parallel count as one round. • Prover query complexity qP: the number of verifier queries to P( , ·). • Communication complexity cc: the total number of bits in the verifier’s queries and the prover’s answers.
x
18
• Verifier oracle query complexity qO : the number of verifier calls to an external oracle O, when present. • Verifier preprocessing time tVpre : for an RIP with preprocessing (Remark 5.5), the running time of Vpre, which bounds |stV |. • Verifier online time tV : the running time of Vpost, with random access to stV . • Prover running time tP: the honest prover’s total time to answer all queries. Saving and restoring a snapshot is not charged; the number of restores is at most the prover query complexity.
5.2
From IOPs to RIPs
The compilation is inspired by the standard one from an IOP to a two-prover protocol [BGKW88; FRS94], as applied to IOPs in [BCS16, Appendix A], in which one prover answers the verifier’s proof queries and a second, non-communicating prover answers one of them at random to bind the first to fixed proof strings, at the cost of dividing the rejection probability by the query count. With a rewindable prover the verifier binds the prover itself: it obtains each symbol of a proof string by restoring the prover to its state when that string was fixed, so the prover cannot answer adaptively and the compilation loses nothing in soundness. Lemma 5.7 (IOP-to-RIP transformation). Let (P, V) be a relativizing IOP (Definition 3.21) for a relativized relation RO with perfect completeness, soundness error ϵIOP, round complexity rIOP, and proof query complexity qπ . Then (P, V) can be transformed into a relativizing rewindable interactive proof (P, V) (Definition 5.4) for RO with the following properties. • Perfect completeness. • Soundness error: at most ϵIOP. • Round complexity: O(rIOP + qπ ). • Verifier oracle query complexity: the same as that of V. If (P, V) has preprocessing (Remark 3.22), then so does (P, V) (Remark 5.5), with the same verifier preprocessing. The verifier V runs V, and the honest prover runs P once, with additional work only to process the query addresses and replies.
x
w
Proof. The protocol. The parties receive , and the honest prover also receives . Query addresses are tagged so that a history ending in a query is distinguishable from one ending in a verifier message.
xw
• Prover P: runs P on ( , ). On receiving a verifier message ρ, it forwards ρ to P, which computes its next proof string, and replies with the empty message. On receiving a query q after j − 1 verifier messages, it replies with the symbol πj (q) of the j-th proof string. • Verifier V: runs V on and makes V’s oracle queries to O itself. Whenever V wishes to read position q of the j-th proof string, V queries P on the history (ρ1, . . . , ρj−1, q), where ρ1, . . . , ρj−1 are the messages that V sent before the j-th proof string, and hands the reply to V as that symbol. Queries that V makes at the same time are made in parallel, and a message that V reads in full is obtained by querying all of its positions. V accepts if and only if V accepts.
x
In the snapshot view of Definition 5.1, querying P on (ρ1, . . . , ρj−1, q) restores the prover to its state just after it fixed the j-th proof string and asks for one symbol of it, which is why the prover cannot answer adaptively.
19
Completeness. The honest prover’s replies are the symbols of P’s proof strings, so the simulated V sees exactly the honest IOP interaction and accepts with probability 1.
x
e which we may assume to be Soundness. Consider an instance ∈ / LRO and a cheating prover P, e deterministic (Remark 5.6). Define a cheating IOP prover P that, having received the verifier messages ρ1, . . . , ρj−1, sends the proof string e 1, . . . , ρj−1, q). sj (q) := P(ρ This is a valid IOP prover strategy, since sj depends only on messages available when string j is sent. e is the corresponding symbol of sj , so the view of the simulated Every symbol that V obtains from P e is exactly its view against P, e and V accepts with probability at most ϵIOP. V against P Efficiency. The simulation uses the rounds of the IOP, with the queries of each round made in parallel, plus at most one round per query for queries that V makes adaptively, for O(rIOP + qπ ) rounds in total. The verifier’s oracle queries are those of V. The verifier’s work beyond V’s is to form the query addresses and copy the message prefixes, and the honest prover’s work beyond P’s is to restore snapshots and read symbols. Preprocessing is preserved since V preprocesses exactly as V does, and the argument applies verbatim when all parties have access to an oracle O.
5.3
RIPs with linear-time provers and succinct verifiers
In our setting, the honest prover should take not much more time than evaluating the circuit, and the verifier should do substantially less work than evaluating the circuit itself. To verify the evaluation of an O oracle circuit C O , we use an RIP with preprocessing for the relation RCVAL of Definition 3.16: the parties O O receive the instance = (⟨C ⟩, x, a), where pre = ⟨C ⟩ and post = (x, a), the honest prover receives the transcript z, and the claim is that C O (x) = a. We now prove our main theorem by applying the transformation of Section 5.2 to the relativizing IOP of Section 4.
x
x
x
Theorem 5.8. Fix O : {0, 1}∗ → {0, 1} and 0 < ε ≤ 1, and let C O be an oracle circuit with an input of length n, an output of length m, and S gates, and let N ′ := S + n + m as in Theorem 4.1. Suppose O that the oracle queries of C O have length polylogarithmic in N ′. For every σ ≥ 1, RCVAL , for instances O O (⟨C ⟩, x, a) with this circuit such that C is ε-robust with respect to x, has a relativizing rewindable e hides factors interactive proof with preprocessing (Remark 5.5) with the following properties, where O(·) ′ polylogarithmic in N and running times count field operations. • Perfect completeness. • Soundness error: at most 2−σ . • Round complexity: O(σ log N ′). e • Communication complexity: O(σ/ε) field elements. • Verifier oracle query complexity: O(σ min{qC , 1/ε}). e ′). • Verifier preprocessing time: O(N e • Verifier online time: O(σ(n + m + 1/ε)). ′ e • Prover time: O(σN ) + O(σ/ε). In particular, for constant σ and 1/ε ≤ logO(1) N ′, the prover runs in time O(N ′), linear in the size of e the computation, and the verifier’s online time is O(n+m); the number of oracle queries, O(min{qC , 1/ε}), is sublinear in qC whenever εqC grows without bound. 20
The proof applies the transformation of Lemma 5.7 to the IOP of Theorem 4.1 and reduces the soundness error to 2−σ by sequential repetition, restoring the prover to its initial state before each run. We then remark on computing proof strings on demand (Remark 5.9). Proof. Apply Lemma 5.7 to the IOP of Theorem 4.1. The result is a relativizing rewindable interactive proof with preprocessing with soundness error at most 1/3, O(log N ′) rounds, O(min{qC , 1/ε}) verifier ore e e ′), acle queries, communication O(1/ε), verifier online time O(n+m+1/ε), verifier preprocessing time O(N e and prover time O(N ′) + O(1/ε). The verifier runs it R := ⌈σ/ log2 3⌉ times sequentially with fresh randomness, restoring the prover to its initial state before each run, and accepts if and only if every run accepts. e Perfect completeness is preserved. For soundness, fix a false instance and a deterministic cheating prover P. e Since each run queries P only on histories of that run, the runs are independent executions of the protocol against the same prover, each accepted with probability at most 1/3, so all are accepted with probability at most 3−R ≤ 2−σ . The round complexity, communication, oracle queries, online time, and prover time are R times those of one run, and the preprocessing is done once, which gives the stated parameters. Remark 5.9 (Computing proof strings on demand). Bitansky and Chiesa [BC12] observed that the provers of a multi-prover interactive proof [BGKW88] (Section A) need not store a proof: each only ever returns single symbols of proof strings, so it can compute each symbol when it is queried. Holmgren and e ) and space S + o(S) for RAM computations. Rothblum [HR18] sharpened this to provers with time O(T The same ability to compute symbols on demand is available to a rewindable prover, which also only returns single symbols: its state at the posting of a string already determines the answer at every position, and restoring that state before each query keeps the answer from depending on anything later, so the honest prover can fix a proof string without computing or storing it in full. This is an advantage over hash-based SNARGs: in a Merkle-based compilation of an IOP into a SNARG such as Flock’s [BRW26], the prover must compute every proof string in full in order to hash it. Computing on demand can be used to save prover time or prover space: • Prover time. Most known linear-time provers come from tensor and interleaved codes of linear-time encodable codes [BCG20; RR22; BCL22; BCGL22; XZS22; GLSTW23; BCFRRZ25; BFRW26], as does the prover of Theorem 5.8, which specifically uses TensorSwitch [BFRW26] (Lemma 3.31). The concretely fastest IOPs, including Flock’s, which our implementation builds on (Section 6), encode with Reed–Solomon codes instead, whose encoding relies on the fast Fourier transform (FFT) and makes their provers quasi-linear; the linear-time instantiation is at present a theoretical result. Computing on demand avoids part of the FFT: our compilation of Flock’s IOP applies only the first layers of the FFT to every row when it posts a proof string and finishes the remaining layers of a row only when the verifier asks for it. Together with the removal of the hash function and the smaller security parameter, this accounts for the speedup of our prover over Flock’s SNARG prover in Section 6.3. • Prover space. Theorem 5.8 bounds the prover’s time but not its space, and as described the e ′). Suppose that C O honest prover stores the encoding Enc(u) of its witness, which takes space O(N e ) and the computes the T -step execution of an oracle machine that uses space S, so that N ′ = O(T prover can regenerate u in space O(S) by running the machine again. Then, for the Reed–Solomon instantiation, each message of the prover can be computed in one pass over the regenerated u, as in the streaming prover of Cormode, Mitzenmacher, and Thaler [CMT12], so the prover runs in e + 1/ε) and in time O(σT e space O(S ), at the price of running the machine, and hence querying O, once per round. The verifier is unchanged. We do not work out the details here.
21
6
Implementation and Experiments
As a proof of concept, we implement our protocol and evaluate it on an MNIST task inspired by the AI debate experiment of Irving, Christiano, and Amodei [ICA18]. Briefly, in their experiment, there are two provers, or agents, and a judge which is trained to classify an MNIST image from a few nonzero pixels. A random MNIST image is shown to the agents but not to the judge. One agent claims the correct label and the other agent claims an incorrect label, e.g., the image contains a 5, and one claims 5 and the other claims 6. They take turns revealing a nonzero pixel in the image to the judge until four or six pixels are revealed. Then the judge chooses which agent wins based on which of their labels has the higher logit. Their experiment studies how often an honest agent wins against a dishonest one; we instead measure the cost of verifying a robust computation that uses their judge as its oracle. Following their experiment, we train a sparse MNIST classifier using the same architecture; it correctly classifies 59.4% of random six-pixel views. We use its predictions to define an oracle: given a sparse view and a candidate digit y, the oracle outputs 1 if the classifier predicts y and 0 otherwise. Our circuits query this oracle on many sparse views of an image and output whether a majority of the views vote for the candidate digit. We vary the number of sparse views to study how the cost of verification scales with the size of the circuit. We also compile an existing IOP for a standard, oracle-free computation, Flock’s IOP for BLAKE3 [BRW26], into an RIP and compare it with Flock’s own SNARG (Section 6.3).
6.1
Implementation
Our implementation is open source2 and written in Rust. It follows the construction of Section 5, building the encoded-witness IOP of Section 3.4 from components of Binius [DP25], Flock [BRW26], and Ligero [AHIV17], and compiling it into an RIP as in Lemma 5.7: the prover keeps each proof string it computes instead of sending it, and the verifier reads a symbol of a proof string by restoring the prover to its state at the moment that string was fixed and asking for that symbol, so that no answer can depend on anything the verifier sent later. The proof √ strings are opened in the layout of Ligero [AHIV17]: the encoded witness is arranged in rows of about N entries and the verifier reads 64 whole columns, which gives a proximity error below 2−42. Together with t sampled oracle gates, the smallest number with (1 − ε)t ≤ 2−41 for the circuit’s robustness parameter ε, a single execution of the protocol has soundness error at most 2−40.53 at every circuit size, against computationally unbounded provers; there are no repetitions. The majority circuit sums the oracle answers in a tree whose levels consist of identical blocks, so the verifier’s work for a level is that of one block and this circuit family needs no preprocessing; for a general circuit, the preprocessing of Remark 5.5 would take its place. The classifier’s answers are computed in advance, so both the protocol and direct evaluation of the circuit query the oracle by table lookup. All timings are from AWS Graviton4 instances, one single-threaded process per core, with transparent huge pages enabled. Absolute times are specific to that core; every ratio below is between measurements on the same core type.
6.2
MNIST experiments
Concretely, call an MNIST image with six nonzero pixels revealed a view. For each circuit, we fix an MNIST image together with qC randomly sampled views of the image; the image and views are hardwired into the description of the circuit. On input a candidate digit y, the circuit queries the oracle on each of its qC views and outputs 1 if more than half of the views vote for y. We can compute the robustness parameters for these circuits exactly: for each digit y, we compute the minimum number of oracle answers 2
https://github.com/ZiyiGuan/oversight-rip
22
that would need to be changed in order to flip the output of the circuit on y. Let m be the minimum of this quantity over all ten digits. Then changing at most m − 1 oracle answers cannot change the output of the circuit on any input, so the circuit is (m − 1)/qC -robust with respect to every input. To choose instances to run our circuit on, we scan the MNIST test set in order. For each image, we sample 28 random views and construct the corresponding circuit. We select the first 50 images for which this circuit accepts the correct digit and has robustness parameter at least 1/8. We use these same 50 images throughout the experiment, and consider qC ∈ {28, 210, 212, . . . , 226}, sampling additional views of each image as qC increases (one image has fewer than 224 distinct six-pixel views and three have fewer than 226; those images are omitted at those sizes). For each image and circuit size, we recompute the robustness parameter and run the complete protocol once, at soundness error 2−40. The median robustness parameter remains between 0.30 and 0.32 at every circuit size. All runs with the honest provers accepted, as expected from perfect completeness. Table 1 reports detailed costs, and Fig. 1 shows how the verifier scales relative to direct evaluation. All values are medians over the images. Since the robustness parameter remains nearly constant, the median number of oracle queries made by the verifier stays between 74 and 80 as qC grows from 28 to 226. At 226 views, the verifier makes 840,000× fewer oracle queries than the circuit. The verifier’s online time also grows much more slowly than direct evaluation: it grows from 0.45 ms to 1.9 ms, while direct evaluation grows from 0.06 µs to 16 ms. Because direct evaluation costs only about 0.23 ns per view, the two cross between 222 and 224 views, and at 226 the verifier takes 0.12× as long as direct evaluation. This baseline is pessimistic for the protocol: both direct evaluation and the protocol answer oracle queries by table lookup, whereas in the intended setting each query is a model evaluation and dominates everything else. With a costly oracle, direct evaluation pays qC evaluations while the verifier pays his 74 to 80, so the crossing would come at a far smaller circuit, and the prover’s overhead over direct evaluation would shrink toward the cost of its field arithmetic alone; the oracle-query counts in Table 1 are the measure that transfers. verifier online direct evaluation oracle queries
time (ms)
100
10−2
10−4
verifier direct evaluation
222 218 214 210 26
28
212
216 qC
220
224
28
212
216 qC
220
224
Figure 1: Verifier cost compared with direct circuit evaluation as the number qC of oracle gates increases, for one execution of the protocol at soundness error 2−40. Curves are medians over the selected MNIST images (50, or 49 and 47 at the two largest sizes). Left: verifier online time compared with one direct circuit evaluation. Right: verifier oracle queries compared with the qC queries made by direct evaluation. Both axes are logarithmic.
23
At small qC , the verifier is slower than direct evaluation because protocol overhead dominates: the verifier performs the IOP interaction and opening checks, whereas direct evaluation requires only qC table lookups. As qC grows, direct evaluation grows linearly, while the verifier’s time grows by a factor of 1.1 to 1.3 per fourfold increase in qC , so their ratio falls by a factor of 3.0 to 3.7 per step. The verifier time √ grows because our implementation uses the Ligero layout [AHIV17], whose openings have size about N, rather than the polylogarithmic cost in Theorem 5.8. The prover cost settles at a constant multiple of direct evaluation from qC = 220 on: the prover, which generates the witness and makes all qC oracle lookups, takes about 60× direct evaluation (0.9 s at 226 views); at the small sizes it is dominated by fixed costs. multiple of direct eval. qC
V oracle queries
direct eval.
V online
P
28 210 212 214 216 218 220 222 224 226
76 74 75 75 76 76 76 76 78 80
0.064 µs 0.238 µs 0.936 µs 3.73 µs 14.9 µs 59.6 µs 238.3 µs 953.1 µs 3.83 ms 15.51 ms
6,976× 2,081× 558× 172× 46.2× 13.4× 3.97× 1.17× 0.39× 0.12×
4,809× 1,635× 567× 237× 117× 79.5× 64.8× 60.9× 59.2× 58.8×
Table 1: Cost of the protocol on the MNIST circuits, one execution at soundness error 2−40 (Graviton 4, one core): medians over the 50 images, or over those with enough distinct views at the two largest sizes. “Direct eval.” is the time to evaluate the circuit directly, one table lookup per view and the majority. Verifier online time and prover time are reported as multiples of it; there is no preprocessing. P includes witness generation.
6.3
Comparison with a SNARG
In Section 1 we argued that rewinding brings efficiency gains over a SNARG. The relativizing protocols of Chen, Kalai, and Xi [CKX26] offer no comparison, since they have no implementation and their prover is only polynomial-time, so we compare prover time against the best known concretely efficient proof system for ordinary, oracle-free computations, Flock [BRW26], whose IOP proves batches of BLAKE3 compressions and whose SNARG, a succinct non-interactive argument, compiles it with Merkle commitments. A SNARG is how an IOP is made practical in the applications of proof systems to date, where the verifier has no control over the prover’s machine and so cannot rewind it: the IOP’s proof strings are committed to with a hash function and the interaction is removed. Rewinding is another way to make the same IOP practical, so comparing our compilation with Flock’s SNARG measures what each way costs. We compiled Flock’s IOP into an RIP, keeping its proof strings, queries, and checks: the prover runs Flock’s prover with the Merkle commitments removed, and the verifier rewinds it to its state at each proof string’s posting before every row query, as in the compilation of Lemma 5.7, so that its answers depend on the posting alone; the verifier runs Flock’s verifier on those rows. A false statement is then accepted with at most the IOP’s own error (Lemma 5.7). The RIP gains in three ways over the SNARG. It needs no hash function, since rewinding replaces the 24
Merkle commitment. Nor does it need to encode every proof string in full, since nothing is hashed: the prover applies only the first layers of the FFT when it posts a string and finishes a row only when it is queried (Remark 5.9). And it needs far fewer bits of security: a SNARG prover can retry offline until the hash-derived challenges are favorable, so Flock’s default configuration targets a 128-bit per-round work factor, whereas a cheating prover in the RIP gets one attempt per execution, which the verifier observes, so 40 bits suffice. We therefore run Flock’s IOP at its 40-bit interactive parameter setting and, since a smaller field suffices as well, over a 64-bit base field with a 128-bit extension for the challenges, which Flock’s release does not offer and which halves the field arithmetic. The error is 2−42.4 to 2−42.9 at these sizes, assuming that the IOP’s query and algebraic error terms compose statistically, as Flock’s parameter code assumes. Table 2 reports prover times at 222 to 234 witness bits (28 to 220 compressions) on one Graviton 4 core, medians of three executions. Our prover is 1.8 to 2.1× faster than Flock’s SNARG prover at every size. witness bits
Flock’s SNARG prover
our prover
speedup
22
89.9 ms 101.6 ms 153.9 ms 480.1 ms 1.23 s 4.81 s 19.8 s
46.7 ms 54.7 ms 86.9 ms 223.7 ms 694.2 ms 2.66 s 10.6 s
1.92× 1.86× 1.77× 2.15× 1.77× 1.81× 1.86×
2 224 226 228 230 232 234
Table 2: Prover time for Flock’s IOP for BLAKE3 compiled as Flock’s SNARG (default configuration, Merkle commitments, sound against bounded provers) and as our protocol over a 64-bit base field at the 40-bit interactive parameters, with the prover rewound before each query (sound against unbounded provers with the IOP’s own error, 2−42.4 to 2−42.9). The speedup is Flock’s SNARG prover’s time divided by ours. Medians of three executions on one Graviton 4 core, including witness generation.
6.4
Limitations
Our experiments are intended as a proof of concept rather than as a realistic scalable-oversight benchmark. The circuits are simple majority circuits over random sparse views, and the 50 images are selected so that their qC = 28 circuits have robustness parameter at least 1/8; thus, the experiments do not show that arbitrary MNIST instances or more complex oracle computations satisfy our robustness assumption. Moreover, unlike in the MNIST debate experiment, the sparse views are sampled randomly instead of chosen adversarially (by debating agents). The majority is also a statistical quantity: for a majority over hardwired views, the verifier could estimate the output himself by sampling about as many views as he queries in the protocol, with no prover at all. The protocol is needed for circuits that process the oracle answers further or choose later queries from earlier answers; our circuits do neither. Because the image and views are hardwired into the circuit, each image and circuit size is its own instance; the verifier needs no preprocessing here only because the majority circuit’s levels consist of identical blocks, and a general circuit would need the preprocessing of Remark 5.5, with its own amortization question. The verifier’s time grows with the square root of the trace, from the Ligero layout of the opening, rather than polylogarithmically as in Theorem 5.8. Even though the verifier becomes cheaper than direct evaluation on the largest circuits, the prover cost remains a constant factor over direct evaluation, about 60× at the largest sizes, where direct evaluation is qC table lookups and the prover performs field arithmetic over the entire encoded witness; on the BLAKE3 instances, where there is no 25
such gap to begin with, our prover is cheaper than the SNARG’s. The protocol also treats saving and restoring the prover’s state as free; for a real model each restore copies its state, and in both compilations the prover is restored before every query.
AI Disclosure We used generative AI tools to write large portions of the code for our implementation and experiments, draft and edit sections of this paper, proofread the paper to catch potential bugs and suggest writing improvements, do a literature review, and help with numerical calculations. All AI-generated text and code was manually reviewed and verified by the authors. For example, we tested AI-generated code and checked consistency against the theoretical protocol, and we did a manual literature survey. The theoretical model and construction were developed solely by the authors. We take full responsibility for the content of this work.
Acknowledgments The authors would like to acknowledge support provided by the UK AISI alignment project. Ziyi Guan thanks Benedikt Bünz, Alessandro Chiesa, Giacomo Fenzi, Christian Knabenhans, William Wang, and Andrew Zitek for helpful discussions on the implementations of the protocols.
References [ABHKNNTW26] Akshima, Renas Bacho, Yu-Hsuan Huang, Eike Kiltz, Aysan Nishaburi, Samin Nooripoor, Noah Tittelbach, and Emiel Wiedijk. A Subexponential Time Algorithm for Elliptic Curve Discrete Logarithm. Preprint, 28 October 2026. 2026. url: https: //github.com/bochum-crypto/subexponential-ecdl. [AGPR24]
Noga Amit, Shafi Goldwasser, Orr Paradise, and Guy Rothblum. “Models that prove their own correctness”. In: arXiv preprint arXiv:2405.15722 (2024).
[AHIV17]
Scott Ames, Carmit Hazay, Yuval Ishai, and Muthuramakrishnan Venkitasubramaniam. “Ligero: Lightweight Sublinear Arguments Without a Trusted Setup”. In: Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security. Association for Computing Machinery, 2017, pp. 2087–2104. doi: 10.1145/3133956.3134104. url: https://doi.org/10.1145/3133956.3134104.
[ALMSS98]
Sanjeev Arora, Carsten Lund, Rajeev Motwani, Madhu Sudan, and Mario Szegedy. “Proof verification and the hardness of approximation problems”. In: Journal of the ACM (JACM) 45.3 (1998), pp. 501–555.
[AS98]
Sanjeev Arora and Shmuel Safra. “Probabilistic checking of proofs: A new characterization of NP”. In: Journal of the ACM (JACM) 45.1 (1998), pp. 70–122.
[AW09]
Scott Aaronson and Avi Wigderson. “Algebrization: A New Barrier in Complexity Theory”. In: ACM Transactions on Computation Theory 1.1 (2009), 2:1–2:54. doi: 10.1145/1490270.1490272. url: https://www.scottaaronson.com/papers/alg. pdf.
26
[AZWG21]
Cem Anil, Guodong Zhang, Yuhuai Wu, and Roger Grosse. “Learning to give checkable answers with prover-verifier games”. In: arXiv preprint arXiv:2108.12099 (2021).
[Bab85]
László Babai. “Trading group theory for randomness”. In: Proceedings of the seventeenth annual ACM symposium on Theory of computing. 1985, pp. 421–429.
[Bar20]
Beth Barnes. Debate update: Obfuscated arguments problem. AI Alignment Forum post. 2020. url: https://www.alignmentforum.org/posts/PJLABqQ962hZEqhdB/ debate-update-obfuscated-arguments-problem (visited on 06/26/2025).
[BBHR18]
Eli Ben-Sasson, Iddo Bentov, Yinon Horesh, and Michael Riabzev. “Fast ReedSolomon Interactive Oracle Proofs of Proximity”. In: 45th International Colloquium on Automata, Languages, and Programming (ICALP 2018). Vol. 107. Leibniz International Proceedings in Informatics (LIPIcs). Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2018, 14:1–14:17. doi: 10.4230/LIPIcs.ICALP.2018.14. url: https: //drops.dagstuhl.de/entities/document/10.4230/LIPIcs.ICALP.2018.14.
[BC12]
Nir Bitansky and Alessandro Chiesa. “Succinct Arguments from Multi-prover Interactive Proofs and Their Efficiency Benefits”. In: Advances in Cryptology – CRYPTO 2012. Vol. 7417. Lecture Notes in Computer Science. Springer, 2012, pp. 255–272. doi: 10.1007/978-3-642-32009-5_16. url: https://www.iacr.org/archive/ crypto2012/74170253/74170253.pdf.
[BCFRRZ25]
Martijn Brehm, Binyi Chen, Ben Fisch, Nicolas Resch, Ron D. Rothblum, and Hadas Zeilberger. “Blaze: Fast SNARKs from Interleaved RAA Codes”. In: Advances in Cryptology – EUROCRYPT 2025. Vol. 15604. Lecture Notes in Computer Science. Springer, 2025, pp. 123–152. doi: 10.1007/978-3-031-91134-7_5. url: https: //link.springer.com/chapter/10.1007/978-3-031-91134-7_5.
[BCG20]
Jonathan Bootle, Alessandro Chiesa, and Jens Groth. “Linear-Time Arguments with Sublinear Verification from Tensor Codes”. In: Theory of Cryptography – TCC 2020. Vol. 12551. Lecture Notes in Computer Science. Springer, 2020, pp. 19–46. doi: 10.1007/978-3-030-64378-2_2. url: https://link.springer.com/chapter/ 10.1007/978-3-030-64378-2_2.
[BCG25]
Annalisa Barbara, Alessandro Chiesa, and Ziyi Guan. “Relativized Succinct Arguments in the ROM do not Exist”. In: TCC (1). Vol. 16268. Lecture Notes in Computer Science. Springer, 2025, pp. 400–416. doi: 10.1007/978-3-032-12287-2_14. url: https://eprint.iacr.org/2024/728.
[BCGL22]
Jonathan Bootle, Alessandro Chiesa, Ziyi Guan, and Siqi Liu. Linear-Time Probabilistic Proofs with Sublinear Verification for Algebraic Automata over Every Field. Cryptology ePrint Archive, Paper 2022/1056. 2022. url: https://eprint.iacr. org/2022/1056.
[BCL22]
Jonathan Bootle, Alessandro Chiesa, and Siqi Liu. “Zero-Knowledge IOPs with Linear-Time Prover and Polylogarithmic-Time Verifier”. In: Advances in Cryptology – EUROCRYPT 2022. Vol. 13276. Lecture Notes in Computer Science. Springer, 2022, pp. 275–304.
[BCS16]
Eli Ben-Sasson, Alessandro Chiesa, and Nicholas Spooner. “Interactive oracle proofs”. In: Theory of Cryptography Conference. Full version: Cryptology ePrint Archive, 27
Paper 2016/116, https://eprint.iacr.org/2016/116. Springer. 2016, pp. 31–60. [BFLS91]
László Babai, Lance Fortnow, Leonid A. Levin, and Mario Szegedy. “Checking computations in polylogarithmic time”. In: Proceedings of the 23rd Annual ACM Symposium on Theory of Computing. STOC ’91. 1991, pp. 21–31.
[BFRW26]
Benedikt Bünz, Giacomo Fenzi, Ron D. Rothblum, and William Wang. “TensorSwitch: Nearly Optimal Polynomial Commitments from Tensor Codes”. In: Advances in Cryptology – CRYPTO 2026. Vol. 16808. Lecture Notes in Computer Science. Springer, 2026, pp. 297–329. doi: 10.1007/978-3-032-35424-2_11. url: https: //eprint.iacr.org/2025/2065.
[BFS20]
Benedikt Bünz, Ben Fisch, and Alan Szepieniec. “Transparent SNARKs from DARK Compilers”. In: Advances in Cryptology – EUROCRYPT 2020. Vol. 12105. Lecture Notes in Computer Science. Springer, 2020, pp. 677–706. doi: 10.1007/978-3-03045721-1_24. url: https://link.springer.com/chapter/10.1007/978-3-03045721-1_24.
[BGHSV04]
Eli Ben-Sasson, Oded Goldreich, Prahladh Harsha, Madhu Sudan, and Salil Vadhan. “Robust PCPs of proximity, shorter PCPs and applications to coding”. In: Proceedings of the thirty-sixth annual ACM symposium on Theory of computing. 2004, pp. 1–10.
[BGKW88]
Michael Ben-Or, Shafi Goldwasser, Joe Kilian, and Avi Wigderson. “Multi-prover interactive proofs: how to remove intractability assumptions”. In: Proceedings of the Twentieth Annual ACM Symposium on Theory of Computing. Association for Computing Machinery, 1988, pp. 113–131.
[BIP24]
Jonah Brown-Cohen, Geoffrey Irving, and Georgios Piliouras. “Scalable AI safety via doubly-efficient debate”. In: Proceedings of the 41st International Conference on Machine Learning. 2024, pp. 4585–4602.
[BIP25]
Jonah Brown-Cohen, Geoffrey Irving, and Georgios Piliouras. “Avoiding Obfuscation with Prover-Estimator Debate”. In: arXiv preprint arXiv:2506.13609 (2025).
[BPHI25]
Marie Davidsen Buhl, Jacob Pfau, Benjamin Hilton, and Geoffrey Irving. “An alignment safety case sketch based on debate”. In: arXiv preprint arXiv:2505.03989 (2025).
[BRW26]
Benedikt Bünz, Ron D. Rothblum, and William Wang. Flock: Fast Proving for Batch Boolean Computations. Cryptology ePrint Archive, Paper 2026/1329. 2026. url: https://eprint.iacr.org/2026/1329.
[BSCGGMTV14]
Eli Ben-Sasson, Alessandro Chiesa, Christina Garman, Matthew Green, Ian Miers, Eran Tromer, and Madars Virza. “Zerocash: Decentralized Anonymous Payments from Bitcoin”. In: IEEE Symposium on Security and Privacy. 2014, pp. 459–474. doi: 10.1109/SP.2014.36.
[CBBZ23]
Binyi Chen, Benedikt Bünz, Dan Boneh, and Zhenfei Zhang. “HyperPlonk: Plonk with Linear-Time Prover and High-Degree Custom Gates”. In: Advances in Cryptology – EUROCRYPT 2023. Vol. 14005. Lecture Notes in Computer Science. Springer, 2023, pp. 499–530. doi: 10.1007/978-3-031-30617-4_17. url: https: //link.springer.com/chapter/10.1007/978-3-031-30617-4_17.
28
[CCGHHRR94]
Richard Chang, Benny Chor, Oded Goldreich, Juris Hartmanis, Johan Håstad, Desh Ranjan, and Pankaj Rohatgi. “The Random Oracle Hypothesis Is False”. In: Journal of Computer and System Sciences 49.1 (1994), pp. 24–39. doi: 10.1016/S00220000(05)80084-4. url: https://userpages.cs.umbc.edu/chang/papers/roh/.
[CCGOS23]
Megan Chen, Alessandro Chiesa, Tom Gur, Jack O’Connor, and Nicholas Spooner. “Proof-Carrying Data from Arithmetized Random Oracles”. In: Advances in Cryptology – EUROCRYPT 2023. Vol. 14005. Lecture Notes in Computer Science. Springer, 2023, pp. 379–404. doi: 10.1007/978-3-031-30617-4_13. url: https: //eprint.iacr.org/2023/587.
[CCS22]
Megan Chen, Alessandro Chiesa, and Nicholas Spooner. “On Succinct Non-Interactive Arguments in Relativized Worlds”. In: Advances in Cryptology – EUROCRYPT 2022. Vol. 13276. Lecture Notes in Computer Science. Springer, 2022, pp. 336–366. doi: 10.1007/978- 3- 031- 07085- 3_12. url: https://iacr.org/archive/ eurocrypt2022/132760105/132760105.pdf.
[CGSY24]
Alessandro Chiesa, Ziyi Guan, Shahar Samocha, and Eylon Yogev. “Security Bounds for Proof-Carrying Data from Straightline Extractors”. In: Theory of Cryptography – TCC 2024. Vol. 15365. Lecture Notes in Computer Science. Springer, 2024, pp. 464– 496. doi: 10.1007/978-3-031-78017-2_16. url: https://eprint.iacr.org/ 2023/1646.
[CHMMVW20]
Alessandro Chiesa, Yuncong Hu, Mary Maller, Pratyush Mishra, Psi Vesely, and Nicholas P. Ward. “Marlin: Preprocessing zkSNARKs with Universal and Updatable SRS”. In: Advances in Cryptology – EUROCRYPT 2020. Vol. 12105. Lecture Notes in Computer Science. Springer, 2020, pp. 738–768. doi: 10.1007/978-3-030-457211_26. url: https://eprint.iacr.org/2019/1047.
[CKX26]
Liyan Chen, Yael Tauman Kalai, and Zoe Xi. “How to Avoid Debate: Scalable AI Safety via Doubly-Efficient Interactive Proofs”. In: arXiv preprint arXiv:2607.03561 (2026).
[CL20]
Alessandro Chiesa and Siqi Liu. “On the Impossibility of Probabilistic Proofs in Relativized Worlds”. In: 11th Innovations in Theoretical Computer Science Conference (ITCS 2020). Vol. 151. Leibniz International Proceedings in Informatics (LIPIcs). Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2020, 57:1–57:30. doi: 10.4230/LIPIcs.ITCS.2020.57. url: https://drops.dagstuhl.de/entities/ document/10.4230/LIPIcs.ITCS.2020.57.
[Cla26]
Claude (Anthropic). A 2o(n) Time Algorithm for 3-SAT. Preprint, October 2026. 2026. url: https://github.com/anthropics/formal-math/tree/main/eth.
[CMT12]
Graham Cormode, Michael Mitzenmacher, and Justin Thaler. “Practical Verified Computation with Streaming Interactive Proofs”. In: Proceedings of the 3rd Innovations in Theoretical Computer Science Conference. 2012, pp. 90–112. doi: 10.1145/2090236.2090245. url: https://arxiv.org/abs/1105.2003.
[CSA18]
Paul Christiano, Buck Shlegeris, and Dario Amodei. “Supervising strong learners by amplifying weak experts”. In: arXiv preprint arXiv:1810.08575 (2018).
[CT10]
Alessandro Chiesa and Eran Tromer. “Proof-Carrying Data and Hearsay Arguments from Signature Cards”. In: Proceedings of the 1st Symposium on Innovations in 29
Computer Science. ICS ’10. 2010, pp. 310–331. [DP25]
Benjamin E. Diamond and Jim Posen. “Succinct Arguments over Towers of Binary Fields”. In: Advances in Cryptology – EUROCRYPT 2025. Vol. 15604. Lecture Notes in Computer Science. Springer, 2025, pp. 93–122. doi: 10.1007/978-3-031-911347_4. url: https://link.springer.com/chapter/10.1007/978-3-031-911347_4.
[FK97]
Uriel Feige and Joe Kilian. “Making games short”. In: Proceedings of the twenty-ninth annual ACM symposium on Theory of computing. 1997, pp. 506–516.
[For94]
Lance Fortnow. “The Role of Relativization in Complexity Theory”. In: Bulletin of the EATCS 52 (1994), pp. 229–243.
[FRS94]
Lance Fortnow, John Rompel, and Michael Sipser. “On the Power of Multi-Prover Interactive Protocols”. In: Theoretical Computer Science 134.2 (1994), pp. 545–557.
[FS88]
Lance Fortnow and Michael Sipser. “Are There Interactive Protocols for co-NP Languages?” In: Information Processing Letters 28.5 (1988), pp. 249–251.
[GKR15]
Shafi Goldwasser, Yael Tauman Kalai, and Guy N. Rothblum. “Delegating computation: interactive proofs for muggles”. In: Journal of the ACM (JACM) 62.4 (2015), 27:1–27:64.
[GLSTW23]
Alexander Golovnev, Jonathan Lee, Srinath Setty, Justin Thaler, and Riad S. Wahby. “Brakedown: Linear-Time and Field-Agnostic SNARKs for R1CS”. In: Advances in Cryptology – CRYPTO 2023. Vol. 14082. Lecture Notes in Computer Science. Springer, 2023, pp. 193–226. doi: 10.1007/978-3-031-38545-2_7. url: https: //link.springer.com/chapter/10.1007/978-3-031-38545-2_7.
[GMR19]
Shafi Goldwasser, Silvio Micali, and Charles Rackoff. “The knowledge complexity of interactive proof-systems”. In: Providing Sound Foundations for Cryptography: On the Work of Shafi Goldwasser and Silvio Micali. ACM, 2019, pp. 203–225.
[HAD24]
Lewis Hammond and Sam Adam-Day. “Neural interactive proofs”. In: arXiv preprint arXiv:2412.08897 (2024).
[HCCRR92]
Juris Hartmanis, Richard Chang, Suresh Chari, Desh Ranjan, and Pankaj Rohatgi. “Relativization: A Revisionistic Retrospective”. In: Bulletin of the EATCS 47 (1992), pp. 144–153.
[HR18]
Justin Holmgren and Ron D. Rothblum. “Delegating Computations with (Almost) Minimal Time and Space Overhead”. In: 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS). IEEE, 2018, pp. 124–135. doi: 10.1109/ FOCS.2018.00021. url: https://eprint.iacr.org/2018/861.
[ICA18]
Geoffrey Irving, Paul Christiano, and Dario Amodei. “AI safety via debate”. In: arXiv preprint arXiv:1805.00899 (2018).
[IM25]
Geoffrey Irving and Simon Marshall. The need to relativise in debate. AI Alignment Forum post. June 2025. url: https://www.alignmentforum.org/posts/ XycoFucvxAPhcgJQa/the-need-to-relativise-in-debate-1 (visited on 06/26/2025).
[KCELMB24]
Jan Hendrik Kirchner, Yining Chen, Harri Edwards, Jan Leike, Nat McAleese, and Yuri Burda. “Prover-verifier games improve legibility of llm outputs”. In: arXiv preprint arXiv:2407.13692 (2024). 30
[KT00]
Jonathan Katz and Luca Trevisan. “On the efficiency of local decoding procedures for error-correcting codes”. In: Proceedings of the thirty-second annual ACM symposium on Theory of computing. 2000, pp. 80–86.
[LKEMML18]
Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, and Shane Legg. “Scalable agent alignment via reward modeling: a research direction”. In: arXiv preprint arXiv:1811.07871 (2018).
[Ope26]
OpenAI. The Exponential Time Hypothesis is False. Preprint, 17 October 2026, revised 25 October 2026. 2026. url: https://github.com/openai/math.
[RR22]
Noga Ron-Zewi and Ron D. Rothblum. “Proving as Fast as Computing: Succinct Arguments with Constant Prover Overhead”. In: Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing. Association for Computing Machinery, 2022, pp. 1353–1363. doi: 10.1145/3519935.3519956. url: https: //doi.org/10.1145/3519935.3519956.
[RRR16]
Omer Reingold, Guy N. Rothblum, and Ron D. Rothblum. “Constant-round interactive proofs for delegating computation”. In: Proceedings of the forty-eighth annual ACM symposium on Theory of Computing. 2016, pp. 49–62.
[RVW13]
Guy N. Rothblum, Salil Vadhan, and Avi Wigderson. “Interactive proofs of proximity: delegating computation in sublinear time”. In: Proceedings of the forty-fifth annual ACM symposium on Theory of computing. 2013, pp. 793–802.
[Set20]
Srinath Setty. “Spartan: Efficient and General-Purpose zkSNARKs Without Trusted Setup”. In: Advances in Cryptology – CRYPTO 2020. Vol. 12172. Lecture Notes in Computer Science. Springer, 2020, pp. 704–737. doi: 10.1007/978-3-030-568771_25. url: https://link.springer.com/chapter/10.1007/978-3-030-568771_25.
[Spi96]
Daniel A. Spielman. “Linear-time encodable and decodable error-correcting codes”. In: IEEE Transactions on Information Theory 42.6 (1996), pp. 1723–1731.
[Tha13]
Justin Thaler. “Time-Optimal Interactive Proofs for Circuit Evaluation”. In: Advances in Cryptology – CRYPTO 2013, Part II. Vol. 8043. Lecture Notes in Computer Science. Springer, 2013, pp. 71–89. doi: 10.1007/978-3-642-40084-1_5. url: https://link.springer.com/chapter/10.1007/978-3-642-40084-1_5.
[Tha22]
Justin Thaler. “Proofs, Arguments, and Zero-Knowledge”. In: Found. Trends Priv. Secur. 4.2-4 (2022), pp. 117–660. doi: 10.1561/3300000030. url: https://doi. org/10.1561/3300000030.
[WSTZP24]
Stephan Wäldchen, Kartikey Sharma, Berkant Turan, Max Zimmer, and Sebastian Pokutta. Interpretability Guarantees with Merlin-Arthur Classifiers. 2024. arXiv: 2206.00759 [cs.LG]. url: https://arxiv.org/abs/2206.00759.
[XZS22]
Tiancheng Xie, Yupeng Zhang, and Dawn Song. “Orion: Zero Knowledge Proof with Linear Prover Time”. In: Advances in Cryptology – CRYPTO 2022. Vol. 13510. Lecture Notes in Computer Science. Springer, 2022, pp. 299–328. doi: 10.1007/9783-031-15985-5_11. url: https://link.springer.com/chapter/10.1007/9783-031-15985-5_11.
31
[XZZPS19]
A
Tiancheng Xie, Jiaheng Zhang, Yupeng Zhang, Charalampos Papamanthou, and Dawn Song. “Libra: Succinct Zero-Knowledge Proofs with Optimal Prover Computation”. In: Advances in Cryptology – CRYPTO 2019, Part III. Vol. 11694. Lecture Notes in Computer Science. Springer, 2019, pp. 733–764. doi: 10.1007/978-3-03026954-8_24. url: https://link.springer.com/chapter/10.1007/978-3-03026954-8_24.
Multi-prover interactive proofs
Rewindable interactive proofs are closely related to multi-prover interactive proofs (MIPs) [BGKW88]: a restored snapshot gives the verifier an interaction that the prover cannot connect to any other, much as a second non-communicating prover would. MIPs are in turn equivalent in power to probabilistically checkable proofs (PCPs) [FK97; AS98; ALMSS98], since two non-communicating provers can simulate a proof string, at a loss in soundness, and a proof string can hold the provers’ strategies [FRS94]; we therefore present only the equivalence of MIPs and RIPs. This appendix recalls the definition of MIPs and shows that the two models have the same power (Section A.1): every MIP is an RIP with the same soundness error, and every RIP whose verifier makes qP queries to the prover is a two-prover MIP with soundness error 1−(1−ϵRIP)/qP. A multi-prover interactive proof lets several powerful provers try to convince a weak verifier that an instance has a valid witness. Definition A.1 (Multi-prover interactive proof system). A p-prover interactive proof for a relation R is an interactive protocol between a probabilistic polynomial-time verifier V and p computationally unbounded provers P1, . . . , Pp. The parties receive a common input , and the honest provers additionally receive a witness with ( , ) ∈ R. The provers may agree on a strategy beforehand but cannot communicate during the protocol: each prover’s messages depend only on , its agreed strategy, and its own interaction with the verifier. At the end of the interaction, the verifier accepts or rejects. The protocol satisfies the completeness and soundness properties defined below.
w
x
xw
x
w x
w
x
We write ⟨P1( ), . . . , Pp( ), V⟩( ) = 1 when the verifier accepts after interacting with the provers on common input . The probabilities below are over the verifier’s private random bits (we assume without loss of generality that the provers are deterministic).
xw
Definition A.2 (Completeness). An MIP for R has perfect completeness if, for every ( , ) ∈ R, the honest provers satisfy Pr [⟨P1( ), . . . , Pp( ), V⟩( ) = 1] = 1.
w
w
x
Definition A.3 (Soundness). An MIP for R has soundness error ϵMIP if, for every e 1, . . . , P e p, tuple of possibly computationally unbounded cheating provers P h i e 1, . . . , P e p, V⟩( ) = 1 ≤ ϵMIP(| |). Pr ⟨P
x
x ∈/ L and every
x
Definition A.4 (Relativizing MIP). Fix an oracle O and a relativized relation RO as in Definition 3.5. A relativizing MIP for RO is an MIP for RO in which the verifier and all provers, including cheating provers, have black-box access to the same oracle O. The protocol relativizes if its completeness, soundness, and efficiency guarantees hold for RO for every oracle O. Remark A.5 (Preprocessing). As in Remark 3.22, an MIP with preprocessing for instances of the form = ( pre, post) has a verifier that is a pair V = (Vpre, Vpost). First Vpre receives pre and
x
x x
x
32
outputs a state stV . Then Vpost receives stV and soundness are as in Definitions A.2 and A.3.
x
post
and interacts with the provers. Completeness and
Efficiency parameters are as for RIPs (Section 5.1), with parallel exchanges with different provers counting as one round and the prover running time taken as the sum over the honest provers.
A.1
Relation to RIPs
Rewindable interactive proofs are as powerful as MIPs: every MIP is a rewindable interactive proof with the same soundness error, and two provers can simulate a rewindable prover at a loss in the soundness error. Lemma A.6 (MIP to RIP). Every p-prover interactive proof for R with perfect completeness and soundness error ϵMIP yields a rewindable interactive proof for R with perfect completeness and soundness error ϵRIP = ϵMIP, the same verifier complexity up to tagging each message with a prover index, and the same prover running time. If the MIP has preprocessing (Remark A.5), so does the RIP (Remark 5.5), with the same verifier preprocessing. The same holds for relativizing protocols. Proof. Let (P1, . . . , Pp, V) be the MIP. The new verifier runs V, and whenever V has sent messages ρ1, . . . , ρj to prover i, it obtains that prover’s reply by querying the rewindable prover on the history ((i, ρ1), . . . , (i, ρj )). The honest rewindable prover answers a history tagged with i as Pi would, so e define cheating MIP provers by completeness is preserved. For soundness, given any function P, e e e Pi(ρ1, . . . , ρj ) := P((i, ρ1), . . . , (i, ρj )). Each Pi depends only on its own history, so these are valid none is exactly that of V against P e 1, . . . , P e p. communicating MIP provers, and the new verifier’s view against P Hence the acceptance probability is at most ϵMIP, so ϵRIP ≤ ϵMIP. The new verifier preprocesses pre exactly as V does, and the same argument applies verbatim when all parties have access to an oracle O.
x
Lemma A.7 (RIP to MIP). Every rewindable interactive proof for R with perfect completeness and soundness error ϵRIP in which the verifier makes at most qP queries to the prover yields a two-prover interactive proof for R with perfect completeness and soundness error ϵMIP ≤ 1 − (1 − ϵRIP)/qP, with one additional round, in which the first prover answers the verifier’s queries and the second prover answers one query. The same holds for relativizing protocols and for protocols with preprocessing. Proof. The verifier runs the RIP, sending each query to the first prover, and at the end sends one of the queries, chosen uniformly at random, to the second prover and rejects if the two answers differ. With honest provers the answers always agree. For soundness, the second prover’s answers define a e Let C be the event that the first prover’s single next-message function, hence a cheating RIP prover P. e answers agree with P on every queried history. On C the simulated RIP verifier’s view is its view e so Pr [accept ∧ C] ≤ min{ϵRIP, Pr [C]}. Otherwise some answer disagrees, and the second against P, prover’s query, chosen independently of the transcript, lands on it with probability at least 1/qP, so Pr [accept ∧ ¬C] ≤ (1 − 1/qP)Pr [¬C]. Writing b := Pr [¬C], the acceptance probability is at most min{ϵRIP, 1 − b} + b(1 − 1/qP) ≤ 1 − (1 − ϵRIP)/qP, with the maximum at b = 1 − ϵRIP.
33
Related documents
- Efficient Scalable Oversight via Rewinding#1492143
- Growing an Agent/Prover Interface: Evolutionary Tool Design for Cost-Efficient Theorem Proving in Rocq and Lean#1144511
- A Verifier Can Leak the Answer: Diagnosability Before Optimization in Closed-Loop Agent Debugging#1154749
- Provenance Tracking in AI Compilers through the Lens of Coalgebra#271955
- Studying proof data with proof theory: the case of AI-generated mathematics#1400186
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive