Skip to main navigation Skip to search Skip to main content

Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting

  • Liran Nochumsohn
  • , Raz Marshanski
  • , Hedi Zisling
  • , Omri Azencot

Research output: Contribution to journal › Article › peer-review

Abstract

Time series forecasting (TSF) is critical in domains like energy, finance, healthcare, and logistics, requiring models that generalize across diverse datasets. Large pre-trained models such as Chronos and Time-MoE show strong zero-shot (ZS) performance but suffer from high computational costs. In this work, we introduce Super-Linear, a lightweight and scalable mixture-of-experts (MoE) model for general forecasting. It replaces deep architectures with simple frequency-specialized linear experts. A lightweight spectral gating mechanism dynamically selects relevant experts, enabling efficient, accurate forecasting. Crucially, resampling during training exposes the model to diverse frequency regimes, while a flexible input adaptation strategy allows it to handle varying inference lengths. Despite its simplicity, Super-Linear demonstrates strong performance across benchmarks, while substantially improving efficiency, robustness to sampling rates, and interpretability. The implementation of Super-Linear is publicly available at: https://github.com/azencot-group/SuperLinear.

Original languageEnglish
JournalTransactions on Machine Learning Research
Volume2026
Issue numberMay
StatePublished - 1 Jan 2026

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting'. Together they form a unique fingerprint.

Cite this