Deconstructing recurrence, attention, and gating: Investigating the transferability of transformers and gated recurrent neural networks in forecasting of dynamical systems
Ablation study examining key architectural components of neural networks for spatiotemporal forecasting, finding that neural gating and attention …