Assumption comparator
These bounds look comparable and are not. Sekhari forbids storing the training set; Regehr grants it. Van Waerebeke's unlearner may only touch the retain set, so SCRUB and every other forget-set method falls outside its algorithm class. Each of those is a single sentence in its own paper. Together they decide whether a rate transfers.
Rows are ordered by year. A cell reading “not stated” means the paper is silent, not that we did not look.
| Paper | ConvexityWhat the loss must satisfy for the result to hold. | Applies toWhether assumptions bind per training example or only in aggregate. | Storage allowedWhat the unlearner may retain between training and the deletion request. | Forget-set accessWhether the unlearning algorithm may look at the data being deleted. | Dependence on dHow cost or quality scales with parameter count -- the barrier for a ResNet. | What is boundedThe quantity the result actually controls. These are not interchangeable. | Empirical scope |
|---|---|---|---|---|---|---|---|
| cao2015forget 2015 | None. Requires the algorithm be expressible as statistical queries. | Whole learning pipeline, including feature selection. | The summations; training data may be discarded. | Yes -- the deleted sample is subtracted from the summations. | Not analysed; cost is in the number of summations, not d. | Completeness and timeliness, defined operationally against their systems. | LensKit, Zozzle, an OSN spam filter, PJScan. No deep networks. |
| ginart2019deletion 2019 | None assumed; the case study is k-means. | Distributional -- equality in distribution between unlearned and retrained. | Arbitrary metadata permitted, including partial computations. | Yes -- deletion is by index into the training set. | Not the focus; the lower bound Omega(n/m) is in n and m. | Amortised computation time in an online deletion stream. | Quantized and Divide-and-Conquer k-means. No deep networks. |
| golatkar2020eternal 2020 | Quadratic loss and gradient-flow optimisation for the theory. The implemented method assumes only SGD stability. | Population-level; the forget set is assumed small. | The FIM diagonal. | Yes. | The full Newton step is unaffordable, which is why Section 4 sets h(w)=w and keeps only the noise. | KL between scrubbed and retrained weight distributions, via the Forgetting Lagrangian. | CIFAR-10, Lacuna, All-CNN and ResNet-18 -- the only theory-adjacent paper here that runs deep networks. |
| guo2020certified 2020 | Convex, everywhere differentiable, with lambda-strong regularisation and a unique minimiser. | Per-example bounds on gradient norm and a gamma-Lipschitz second derivative. | The Hessian, formed offline at O(d^2 n). | Yes -- the removed point's gradient drives the Newton step. | O(d^3) at removal time. Theorem 1's bound carries 1/lambda^2. | Max-divergence between the removal mechanism's output and retraining. | Linear models. For deep models the mechanism applies ONLY to a linear head over a frozen or DP-trained feature extractor. |
| izzo2021approximate 2021 | Linear regression; extended to logistic regression via IRLS. | Squared loss, so gradients are scalar multiples of the input. | The hat matrix, precomputed at O(n d^2). | Yes -- the update projects onto the span of the deleted points. | O(k^2 d) for the UPDATE ONLY. Precomputation remains O(n d^2). | Distance to the leave-k-out parameter, optimally among updates in that span. | Linear and logistic regression. No deep networks. |
| neel2021descent 2021 | m-strongly convex and M-smooth for the perfect-unlearning result. The authors state their techniques do not extend without strong convexity. | Per-example L-Lipschitz and m-strongly convex in Lemma 2.12. | Secret state permitted for ordinary unlearning; perfect unlearning may keep none. | Yes -- updates are (datapoint, add/delete) pairs. | Per-update runtime at least logarithmic in the dimension. | (alpha,beta)-accuracy across an UPDATE SEQUENCE, with cost growth in the number of requests. | None in the sections read. |
| sekhari2021remember 2021 | lambda-strongly convex, L-Lipschitz AND M-Hessian-Lipschitz. | Per-example -- all three conditions hold for every z. | T(S) explicitly excludes storing the training set or aggressive checkpointing. |T(S)| = O(d^2). | Yes, and centrally so -- hence the title. | O(d^2) storage, O(d^omega) time. Deletion capacity scales as n/d^(1/4). | Excess POPULATION risk, and deletion capacity against it. | None in the sections read. |
| vanwaerebeke2025whentoforget 2025 | Minimax over the strongly convex class; theta* assumed the unique minimiser. | Function-class level, not per-example. | Not the constraint; the algorithm class is defined by the update rule. | NO. Unlearning algorithms may only sample the RETAIN set. SCRUB, NegGrad+, Bad-T and SalUn all fall outside this class. | Upper bound carries sqrt(d); the authors note their lower bound does not match it. | Minimax COMPUTATION TIME to a target excess risk -- not forget quality. | Linear regression, synthetic worst-case objectives, and the Digit dataset. |
| xu2025infotheoretic 2025 | NONE in the sections read. The machinery is mutual information, Fano, data-processing and Pinsker. | Distributional, over model outputs rather than parameters. | Not a constraint; the criterion needs only output samples. | Not framed this way; the criterion is auditable from outputs alone. | The authors describe Theorem 2.1's bound as dimension- and output-space-agnostic. | Mutual information between model outputs and a latent source label, plus a utility budget. | Section 6 reportedly implements on tabular data and image classification. NOT READ. |
| regehr2026nearoptimal 2026 | Smooth strongly convex SCO. Unlike Sekhari, no Lipschitz-Hessian requirement. | Per-example -- Lipschitz, strongly convex and smooth for every z. | FULL storage granted: T(Z) = Z. The opposite of Sekhari's constraint. | Yes -- the unlearner sees the dataset, the deletion set and the learned model. | The gain factor is e^{-2 eps/(d+2)}; it only helps when eps >> d. | Excess population risk under PURE (delta = 0) eps-unlearning, with MATCHING upper and lower bounds. | None. Pure theory. |
No row matches that filter.