MorphAtt: A Neuromorphic Accelerator for Efficient Multi-Head Attention Processing in Spiking Vision Transformers

arXiv:2609.33207 · cs.AR, cs.LG, cs.NE · Submitted 2026-09-27 · Read on arXiv

cs.AR, cs.LG, cs.NE

Submitted: 2026-09-27

Updated: 2026-09-27

Terminology

Transformer — 31× in this paper · explained in 2 episodes
Energy Efficiency — 9× in this paper · explained in 3 episodes
Core — 3× in this paper · explained in 2 episodes
Single-Head Self-Attention — 3× in this paper
Accuracy — 2× in this paper · explained in 1 episode
Alignment — 2× in this paper · explained in 1 episode
Leaky Integrate-and-Fire — 2× in this paper
Sparsity — 2× in this paper · explained in 4 episodes
Spiking Neural Networks (SNNs) — 2× in this paper · explained in 3 episodes
Distillation — 1× in this paper · explained in 2 episodes
Edge AI — 1× in this paper · explained in 2 episodes
In International Conference on Learning Representations — 1× in this paper
International Joint Conference on Neural Networks — 1× in this paper
New York University — 1× in this paper
Pruning — 1× in this paper · explained in 4 episodes

Sources

FireFly-T: High-Throughput Sparsity Exploitation for Spiking Transformer Acceleration with Dual-Engine Overlay Architecture

Related papers