# Implicit Sheaf Operators for Effective and Efficient Cellular Sheaf Learning

- Authors: Gabriele Onorato, Dario Loi, Cristian Apostol, Nathaniel D. Bastian, Francesco Restuccia
- Venue: Preprint, August 2026
- Published: August 4, 2026
- Page: https://dario-loi.github.io/publications/implicit-sheaf-operators/
- Markdown: https://dario-loi.github.io/publications/implicit-sheaf-operators/index.md
- PDF: https://dario-loi.github.io/publications/implicit-sheaf-operators/implicit-sheaf-operators.pdf
- Related: Google Scholar (https://scholar.google.com/citations?view_op=view_citation&user=r0Ty-c8AAAAJ&citation_for_view=r0Ty-c8AAAAJ:zYLM7Y9cAGgC)
- Topics: Sheaf neural networks (https://dario-loi.github.io/publications/topics/sheaf-neural-networks/), Topological deep learning (https://dario-loi.github.io/publications/topics/topological-deep-learning/)
- Keywords: Graph neural networks, Efficient deep learning, Neural Sheaf Diffusion, Fast neural sheaf diffusion, Efficient sheaf neural networks, Sheaf Laplacian, Connection Laplacian, Cellular sheaves, Matrix-free message passing, Heterophily, Edge devices, Jetson Orin Nano
- How to cite: Gabriele Onorato, Dario Loi, Cristian Apostol, Nathaniel D. Bastian, and Francesco Restuccia (2026). Implicit Sheaf Operators for Effective and Efficient Cellular Sheaf Learning. Preprint. https://dario-loi.github.io/publications/implicit-sheaf-operators/

Summary: Implicit Sheaf Operators make sheaf neural networks fast. They apply sheaf diffusion and sheaf convolution locally at each node without building the sheaf Laplacian, which cuts time, memory, and energy. Built on them, Sheaf Convolutional Networks can be more accurate than Neural Sheaf Diffusion on node classification benchmarks.

Abstract: While Sheaf Neural Networks (SNNs) enrich $n$-node $m$-edge diffusion of $f$-dimensional node features with $d$-dimensional node and edge stalks, they require computing a sparse $nd \times nd$ sheaf Laplacian, whose computation is prohibitive on edge devices. This paper addresses this issue with Implicit Sheaf Operators (ISOs), a type of sheaf topological operators that leverage the topological structure of cellular sheaves to decompose the global diffusion process into local operator-vector products. We mathematically prove that ISO eliminates the $O(md^2 \log(md^2))$ sparse-coalescing term and reduces the space complexity by $O(\min(d, f))$ with respect to traditional Neural Sheaf Diffusion (NSD). Our experiments indicate that ISO-based operators achieve latency reduction of up to 4.87× and save up to 3.92× peak GPU memory. On real graph classification data, ISO uses up to 1.24× less energy and 3.08× less on-device memory as measured on a Jetson Orin Nano. Finally, to bring ISO to practice, we introduce Sheaf Convolutional Networks (SCNs), an ISO-based SNN attaining up to 3.93% higher accuracy compared to NSD-based SNNs on node classification benchmarks.

Key figure (Figure 2): (Left) The Sheaf Laplacian (SL) $L_{\mathcal{F}} \in \mathbb{R}^{nd \times nd}$ is explicitly computed before multiplying it with the sheaf node features $\mathbf{X}$. (Right) The proposed ISOs reformulate the computation as a purely local process. By leveraging the topological features of cellular sheaves, ISO computes the exact action of $L_{\mathcal{F}}\mathbf{X}$ independently at each single node $v$, bypassing the global matrix completely. Left, a 3 by 3 block sheaf Laplacian with d by d blocks multiplied by a stacked feature matrix X. Right, a triangle of nodes v, u, w with edges e1 and e2, where dashed arrows bring restriction-map terms from u and w, and a self term, into node v.

Graph neural networks (GNNs) that average over neighbors run into trouble in two familiar places: heterophilous graphs, where connected nodes tend to carry different labels, and deep stacks of layers, where node representations collapse toward each other (oversmoothing). Sheaf Neural Networks (SNNs) address both by letting every edge learn how the features of its two endpoints should be translated before they are compared, and Neural Sheaf Diffusion (NSD; Bodnar et al., 2022) is the best-known recipe for doing so. The obstacle is cost. The standard implementation builds a sparse sheaf Laplacian with *nd* rows and columns, where *n* is the number of nodes and *d* the stalk dimension, so a graph of 1,000 nodes with 8-dimensional stalks already yields an 8,000 by 8,000 operator that must be assembled from learned maps. This page is a companion to the paper.

## Why sheaf neural networks are expensive

In a GCN the propagation matrix is fixed by the graph, so it is built once. In an SNN each edge carries learned *d* by *d* restriction maps, which means the operator depends on the weights and has to be re-assembled at every gradient step, and again for every new input graph in inductive settings such as classifying many small molecules or networks. Assembly ends with sorting and merging the sparse entries, and the operator then sits in memory for the backward pass. In our measurements on random graphs with 1,000 nodes, this made NSD up to 39.2 times slower and 9.27 times more memory than a GCN, a gap that matters most on constrained hardware.

## A faster way to compute Neural Sheaf Diffusion and sheaf convolution

Implicit Sheaf Operators (ISOs) are a faster way to compute Neural Sheaf Diffusion. They apply equally to the sheaf convolution we introduce below. They are matrix-free: instead of materializing the sheaf Laplacian, an ISO evaluates its action node by node from the restriction maps, using two batched matrix multiplications per edge and a scatter-add. This is ordinary gather-scatter message passing. The result equals multiplying by the explicit Laplacian. A model keeps the same expressiveness, and only the way the operator is applied changes. The paper works one case end to end: three agents on a path, each holding a 2-dimensional measurement, reaching consensus through a local update at the middle node. Distributed coordination over cellular sheaves (Hanks et al., 2025) is a natural fit for this local formulation, although we did not test it.

## Comparison with connection Laplacians and other sheaf neural networks

Every sheaf variant we know of in this line needs the same explicit block matrix. Connection Laplacians (Barbero et al., 2022a) build it once, ahead of training, which helps only when the graph never changes. Neural Sheaf Propagation (Suk et al., 2022), Sheaf Attention Networks (Barbero et al., 2022b) and nonlinear sheaf diffusion (Zaghen et al., 2024) alter what happens inside the diffusion step, yet still assemble that matrix and share its time, memory and power cost. Deep Neural Sheaf Diffusion (Bourgerie et al., 2026) points to the adjacency form for deeper SNNs. ISOs target the shared bottleneck itself, so in our view they complement these designs: maps are still learned end to end, and the graph can differ from one input to the next.

## Speed and memory

On random graphs with 1,000 nodes, the best forward-pass speedup against an optimized explicit baseline is 4.87 times (37.78 ms down to 7.76 ms), and peak GPU memory falls up to 3.92 times (1816 MB to 463 MB). The two gains peak in different places. For general and bundle maps, time savings are largest for small stalks (the plot below), whereas memory savings grow with the stalk dimension and reach their maximum at *d* = 8. In practice, richer stalks, which give a sheaf its modeling power, become cheaper to afford. The gains matter most in inductive workloads, since a transductive model pays the assembly cost only once.

[Figure: Line chart of forward-time speedup against stalk dimension d of 2, 4 and 8, from the Sheaf Diffusion block of Table 2. Diagonal maps: 1.38, 1.34, 1.31. Bundle maps: 2.11, 1.74, 1.73. General maps: 4.87, 2.94, 1.71.]
Caption: Speedup in inductive forward time of Implicit Sheaf Operators over the optimized explicit implementation, Sheaf Diffusion, on Erdős-Rényi graphs.

## Sheaf neural networks on edge devices

We also ran graph classification inference on an NVIDIA Jetson Orin Nano, an embedded GPU board, using the PTC and Proteins datasets. Energy per graph dropped by up to 1.24 times and on-device memory by up to 3.08 times. The energy gain is modest and the memory gain is substantial, so we read this as a first sign that sheaf models can fit the budgets of on-board and low-power deployments.

## Sheaf Convolutional Networks for heterophily

Keeping only the adjacency term of the Laplacian, as GCNs do relative to graph diffusion, yields Sheaf Convolutional Networks (SCNs), evaluated by ISOs at the same cost. On the heterophily-oriented node classification benchmark of Pei et al. (2020), SCNs beat NSD variants by up to 3.93 points. On Squirrel, a general-map SCN reaches 60.27 against 56.34 for the best NSD. Open questions remain, including how far deeper SCNs can go (Bourgerie et al., 2026) and whether the matrix-free idea carries over to copresheaf networks (Hajij et al., 2025), which still use explicit block matrices.

References:

- Federico Barbero, Cristian Bodnar, Haitz Sáez de Ocáriz Borde, Michael Bronstein, Petar Veličković, and Pietro Liò (2022). Sheaf Neural Networks with Connection Laplacians. Proceedings of Topological, Algebraic, and Geometric Learning Workshops 2022, PMLR 196. https://proceedings.mlr.press/v196/barbero22a.html
- Federico Barbero, Cristian Bodnar, Haitz Sáez de Ocáriz Borde, and Pietro Liò (2022). Sheaf Attention Networks. NeurIPS 2022 Workshop on Symmetry and Geometry in Neural Representations. https://openreview.net/forum?id=LIDvgVjpkZr
- Cristian Bodnar, Francesco Di Giovanni, Benjamin Chamberlain, Pietro Liò, and Michael Bronstein (2022). Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs. Advances in Neural Information Processing Systems 35 (NeurIPS 2022). https://doi.org/10.52202/068431-1346
- Rémi Bourgerie, Šarūnas Girdzijauskas, and Viktoria Fodor (2026). Deep Neural Sheaf Diffusion. arXiv preprint arXiv:2605.19021. Presented at the ICML 2026 Workshop on Graph Foundation Models (GFM@ICML 2026). https://arxiv.org/abs/2605.19021
- Mustafa Hajij, Lennart Bastian, Sarah Osentoski, Hardik Kabaria, John Davenport, Sheik Dawood, et al. (2025). Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework. Advances in Neural Information Processing Systems 38 (NeurIPS 2025). https://doi.org/10.52202/085713-5009
- Tyler Hanks, Hans Riess, Samuel Cohen, Trevor Gross, Matthew Hale, and James Fairbanks (2025). Distributed Multi-Agent Coordination over Cellular Sheaves. 2025 IEEE 64th Conference on Decision and Control (CDC). https://doi.org/10.1109/cdc57313.2025.11312066
- Hongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei, and Bo Yang (2020). Geom-GCN: Geometric Graph Convolutional Networks. International Conference on Learning Representations (ICLR 2020). https://openreview.net/forum?id=S1e2agrFvS
- Julian Suk, Lorenzo Giusti, Tamir Hemo, Miguel Lopez, Konstantinos Barmpas, and Cristian Bodnar (2022). Surfing on the Neural Sheaf. NeurIPS 2022 Workshop on Symmetry and Geometry in Neural Representations. https://openreview.net/forum?id=xOXFkyRzTlu
- Olga Zaghen, Antonio Longa, Steve Azzolin, Lev Telyatnikov, Andrea Passerini, and Pietro Liò (2024). Sheaf Diffusion Goes Nonlinear: Enhancing GNNs with Adaptive Sheaf Laplacians. Proceedings of the Geometry-grounded Representation Learning and Generative Modeling Workshop (GRaM), PMLR 251. https://proceedings.mlr.press/v251/zaghen24a.html

BibTeX:

```bibtex
@misc{onorato2026implicit,
  title  = {Implicit Sheaf Operators for Effective and Efficient Cellular Sheaf Learning},
  author = {Gabriele Onorato and Dario Loi and Cristian Apostol and Nathaniel D. Bastian and Francesco Restuccia},
  year   = {2026},
  note   = {Preprint},
  url    = {https://mentis.info/wp-content/uploads/2026/08/SheafOperators.pdf}
}
```

---

From Dario Loi's site (https://dario-loi.github.io/). Index of all papers: https://dario-loi.github.io/llms.txt.
