Article summary — original

IBM Releases Granite Time Series PatchTST-FM-r2 Under Permissive Open-Source Licenses IBM has launched Granite Time Series PatchTST-FM-r2, an updated ~385M-parameter foundation model for zero-shot time-series forecasting. The model achieves leading benchmark results among permissively licensed models and is released under dual Apache 2.0 and OpenMDW 1.0 licensing alongside its weights, architecture, and reproduction code. PatchTST-FM-r2 is an updated ~385M-parameter time-series model supporting contexts up to 8,192 steps, missing value imputation, and 99-quantile probabilistic forecasts. Dual-licensed under Apache 2.0 and OpenMDW 1.0, it is the top-performing permissively licensed zero-shot model on the GIFT-Eval leaderboard as of September 8, 2026. The architecture shifts from standard transformers to 30 conformer blocks combining multi-head self-attention with temporal convolution, alongside 50% overlapping patches and Hamming-window weighting. Pretraining used four documented data sources, avoiding benchmark evaluation sets, and the model family integrates into streaming architectures via Confluent Cloud and Apache Flink. GIFT-Eval Benchmark Results Evaluated on the GIFT-Eval benchmark without test leakage, PatchTST-FM-r2 ranks second overall among replicable zero-shot models, achieving a geometric-mean CRPS of 0.467 (immediately behind TimesFM-3) and a MASE of 0.6846 as of September 8, 2026. This performance places it first among models with permissive, commercial-friendly licenses. Even when compared against models allowed to include GIFT-Eval evaluation training splits, PatchTST-FM-r2 ranks third in CRPS and fourth in MASE, surpassing several larger pretrained models such as Chronos-2, Timer-S1, and Toto variants. Architectural Updates Moving from the architecture of PatchTST-FM-r1, the r2 release expands from 20 to 30 blocks and introduces conformer-style layers. Each block places two half-step feed-forward layers around multi-head self-attention and temporal convolution, utilizing alternating convolution kernel sizes of 3 and 5 in a repeating {5, 5, 3, 3} pattern. This structure delegates local temporal modeling to convolution, freeing self-attention to focus on long-range relationships. The model also incorporates 50% overlapping patches with Hamming-window weighting, overlap-and-add forecasting to smooth patch transitions, and additional normalization for training stability. Training Data and Commercial Licensing To prevent data leakage and provide transparency for enterprise adoption, the pretraining corpus was restricted to four documented datasets: selections from GiftEvalPretrain, custom KernelSynth synthetic data with modified periodic kernels, a TSMixup corpus excluding GIFT-Eval evaluation sets, and around 500,000 synthetic CauKer sequences of length 4,096. PatchTST-FM-r2 is dual-licensed under Apache 2.0 and the Linux Foundation's OpenMDW 1.0, enabling royalty-free commercial adoption, modification, and deployment. The architecture remains backward-compatible with PatchTST-FM-r1 checkpoints. Usage and Streaming Integrations Users can load and run the model zero-shot on time-series data without fine-tuning via the `granite-tsfm` Python library and Hugging Face Hub pipelines. For streaming environments, IBM has collaborated with Confluent to offer models from the Granite Time Series portfolio—such as PatchTST-FM-r1, FlowState-r1.1, TTM-r3, and TSPulse—in Early Access on Confluent Cloud, enabling foundation-model inference directly on live data streams using Apache Flink.

Article summary — zh

IBM发布开源时间序列基础模型Granite PatchTST-FM-r2 IBM发布了Granite时间序列家族最新基础模型PatchTST-FM-r2。该模型拥有约3.85亿参数,采用商用友好的Apache 2.0与OpenMDW 1.0双重许可,在GIFT-Eval基准中取得了领先的零样本预测成绩。 模型拥有约3.85亿参数,上下文长度最高可达8,192,支持99分位数的概率预测与缺失值插补。 在GIFT-Eval基准中,该模型在可复现零样本类别中CRPS排第2(几何平均值0.467),MASE排第2(几何平均值0.6846),在商用友好开源协议模型中位列第一。 架构由标准Transformer改用Conformer结构,结合多头自注意力与交替卷积(卷积核为5与3),并将层数从20层扩增至30层。 采用开源双许可(Apache-2.0与OpenMDW-1.0),训练数据透明无基准泄漏,并已支持通过Confluent Cloud在流式场景中推理。 GIFT-Eval基准表现与开源许可 截至2026年9月8日,PatchTST-FM-r2在GIFT-Eval可复现零样本预测模型中,CRPS几何平均值为0.467,MASE为0.6846,总排名仅次于TimesFM-3位居第二。在宽松商用开源协议类别中,该模型位列第一。即使对比包含预训练数据的模型,其CRPS和MASE也分别位居第三和第四,优于Chronos-2、Timer-S1等模型。模型以Apache 2.0与OpenMDW 1.0双重许可发布,开放权重、架构、推理管线与评测复现代码。 架构改进与Conformer结构 相较于r1版本,PatchTST-FM-r2引入了源自语音处理的Conformer结构,由两个半步前馈层包裹多头自注意力与时序卷积层,卷积核尺寸按{5, 5, 3, 3}交替配置。该机制由卷积捕捉局部时序偏置,使注意力集中于远距离依赖。模型还采用了50%重叠的Hamming窗加权以及重叠相加(overlap-and-add)预测平滑边缘,网络深度扩展至30个block,支持8,192步长上下文与99分位数输出。 训练数据与流式部署生态 模型的预训练数据包括GiftEvalPretrain选定数据集、基于KernelSynth的合成数据、不含GIFT-Eval评估集的TSMixup语料库,以及约50万条长度为4,096的CauKer序列。此外,IBM与Confluent合作在Confluent Cloud Early Access项目中支持了多款Granite时间序列模型,允许用户借助Apache Flink直接在实时流数据上执行推理与异常检测。

Saved original article

High-performance zero-shot forecasting with commercial-friendly open licensing Time-series foundation models are changing the way forecasting systems are built. Instead of training and maintaining a separate model for every dataset, users can use a pretrained model and generate forecasts zero-shot. IBM has released Granite Time Series PatchTST-FM-r2 , the latest model in the Granite TSFM family ( github , blog ). PatchTST-FM-r2, a new version of its predecessor PatchTST-FM-r1 , combines an updated architecture, a larger pretraining corpus, probabilistic forecasting, support for imputation of missing values, and strong zero-shot performance in a ~ 385M-parameter model. As of September 8, 2026, the model is the top performing zero-shot model released under a permissive, commercial-friendly open-source license (Apache 2.0 and OpenMDW 1.0) among replicable, zero-shot models on the GIFT-Eval leaderboard . GIFT-Eval is a comprehensive time series forecasting benchmark designed to evaluate models across diverse forecasting scenarios; the model ranks #2 overall among replicable, zero-shot models. The model weights, architecture, inference pipeline, and code needed to reproduce the benchmark results are all available. In this blog we describe the model, dive deeper into the benchmarking results and the model architecture, discuss the training data and licensing, and provide code examples illustrating how to use the model. Finally, we also highlight how the models from the Granite Time Series family can be used in streaming applications in production setting leveraging Confluent product . Ready to try it? Open Granite Time Series PatchTST-FM-r2 on Hugging Face TL;DR General-purpose zero-shot forecasting for demand, prices, energy loads, traffic, telemetry, and other time series. Approximately 385M parameters, context length up to 8,192, flexible forecast lengths, and probabilistic forecasts through a 99-quantile prediction head. The model backbone is constructed from conformer blocks that combine multi-head self-attention with temporal convolution to capture long- and short-range temporal structure. Permissively licensed model with top performance in the replicable zero-shot category of the GIFT-Eval benchmark (dual-licensed under Apache-2.0 and OpenMDW-1.0, users may select either license). Available open weights, architecture, inference pipeline, and code to reproduce the benchmark. Strong zero-shot forecasting on GIFT-Eval A foundation model is most useful when it generalizes to time series it has not been specifically trained on. For that reason, we focus first on zero-shot performance. GIFT-Eval provides a broad evaluation of forecasting models across heterogeneous datasets and forecasting scenarios. When restricting the leaderboard to models that are zero-shot, replicable, and evaluated without test leakage, PatchTST-FM-r2 ranks second for both CRPS and MASE as of September 8, 2026, as illustrated in Figures 1 and 2 (lower values are better for both metrics). Importantly, PatchTST-FM-r2 is the highest-performing model in the same category among models with permissive, commercial-friendly licensing. Figure 1. GIFT-Eval CRPS for leading replicable zero-shot models. PatchTST-FM-r2 achieves a geometric-mean CRPS of 0.467, placing it immediately behind TimesFM-3 in this comparison, and first among the models with permissive licenses. Figure 2. GIFT-Eval MASE for leading replicable zero-shot models. PatchTST-FM-r2 achieves a geometric-mean MASE of 0.6846. Blue bars denote models released by the IBM time-series foundation-model team. Competitive even against models allowed to use benchmark training data Some models on GIFT-Eval are categorized as pretrained rather than strictly zero-shot. These models are allowed to include the training portions of GIFT-Eval evaluation datasets in their pretraining corpora. Even when these pretrained models are added to the comparison, PatchTST-FM-r2 remains near the top as seen in Figures 3 and 4: 3rd for CRPS and 4th for MASE among the replicable models. It outperforms several pretrained models, including Chronos-2, Timer-S1, and Toto variants , despite some competing models being considerably larger. Figure 3. GIFT-Eval CRPS when both zero-shot and pretrained replicable models are considered. Figure 4. GIFT-Eval MASE when both zero-shot and pretrained replicable models are considered. Architecture: What changed from PatchTST-FM-r1? PatchTST-FM-r2 retains the patch-based representation that made the PatchTST family effective, but the internal architecture is redesigned to capture long- and short-term relationships efficiently and to smoothen inter-patch predictions — both of which substantially improve error measures. One change is the move from standard transformer layers to layers which incorporate convolution along with the multi-head self-attention. These layers are referred to as conformer layers and has its origin in speech processing applications. Figure 5. Architectural evolution from PatchTST-FM-r1 to the Conformer-based PatchTST-FM-r2. A PatchTST-FM-r1 block combines multi-head self-attention with a feed-forward network. In r2, we replaced this with a conformer-style block containing two half-step feed-forward layers surrounding multi-head self-attention and a temporal convolution layer. This gives the model two complementary mechanisms for reasoning over a time series. Self-attention can model long-range relationships between patches, while convolution provides an inductive bias toward local temporal structure. The convolution component can therefore capture shorter-term interactions while allowing attention to concentrate on relationships over longer horizons. This phenomenon is observable in attention patterns captured in the transformer and conformer versions (see example figure below using real samples from the ETTh1 dataset). While a significant portion of the transformer’s self-attention (left in the figure) concentrates near the diagonal, i.e., capturing local relationships, attentions in the conformer block (right in the figure) show long-distance (far-off-diagonal) focus, thanks to the convolution layer covering the short distances. The conformer blocks in the backbone use alternating convolution kernel sizes of 3 and 5, in a repeating pattern {5, 5, 3, 3}. Figure 6. Comparing attention patterns captured in the transformer (left) and conformer versions(right) using real samples from the ETTh1 dataset. Additionally, PatchTST-FM-r2 uses 50% overlapping patches with Hamming-window weighting and overlap-and-add forecasting to smooth patch boundaries and improve forecasting accuracy. Finally, the architecture adds normalization for stability and expands from 20 to 30 blocks. With these changes, the resulting model has approximately 385M parameters , supports very long contexts of up to 8,192 steps , and predicts 99 quantiles over flexible forecast lengths. The model provides both point forecasts and quantile outputs for forecasting distributions and uncertainty intervals. Training data For foundation models intended for real applications, model quality is only one consideration. Developers increasingly need to understand what data went into a model, whether benchmark data may have leaked into training, and what the implications are for deploying the model. PatchTST-FM-r2 uses a documented pretraining corpus consisting of four sources: selected datasets from GiftEvalPretrain; custom synthetic data based on KernelSynth with modified periodic kernels and limited augmentation; a TSMixup corpus generated using the approach described by Chronos but restricted to datasets outside the GIFT-Eval evaluation set; and approximately 500,000 synthetic CauKer sequences, each of length 4,096. For enterprise adopters, this kind of transparency can be as important as another few points on a leaderboard. This does not eliminate the need for an organization's own model-governance and licensing review, but it gives users considerably more information with which to perform that review than an opaque pretraining corpus would. Open for research experimentation — and for commercial use To provide greater choice for the community, Granite Time Series PatchTST-FM-r2 is dual licensed under Apache 2.0 and OpenMDW 1.0 . Users may select either license, both of which provide broad, permissive rights to use, modify, and distribute the models, with the Linux Foundation's OpenMDW offering a licensing framework specifically designed for AI models and related materials. By making the models available under permissive open-source licenses, IBM aims to reduce barriers to adoption and enable organizations, researchers, and developers to build on the technology with confidence that comes with licenses that don't restrict your use.The architecture implementation is also available through Granite-TSFM repository and is backward-compatible with PatchTST-FM-r1 checkpoints. Try PatchTST-FM-r2 in a few lines of Python The easiest way to evaluate a foundation model is on your own time series data. Install the Granite TSFM package: pip install "granite-tsfm>=0.3.9" Then load PatchTST-FM-r2 directly from the Hugging Face Hub: import pandas as pd from tsfm_public import PatchTSTFMForPrediction, TimeSeriesForecastingPipeline # Load model weights model = PatchTSTFMForPrediction.from_pretrained( "ibm-granite/granite-timeseries-patchtst-fm-r2" ) # Read some sample data from ETTh df = pd.read_csv( "https://raw.githubusercontent.com/zhouhaoyi/ETDataset/main/ETT-small/ETTh1.csv" , parse_dates=[ "date" ], ) # Set up the forecasting pipeline pipe = TimeSeriesForecastingPipeline( model=model, id_columns=[], timestamp_column= "date" , target_columns=[ "HUFL" ], max_context_length=model.config.context_length, context_length= 512 , prediction_length= 64 , impute_method= None , quantile_levels=[ 0.1 , 0.5 , 0.9 ], explode_forecasts= True , freq= "1h" , ) # Create a forecast from the last 512 samples of the input dataframe forecast = pipe(df.iloc[- 512 :]) As you can see, no fine-tuning and no task-specific model fitting is needed. The pipeline consumes just the recent history of the series and generates the future forecast, including the requested quantiles. The above is a simple example on publicly available data – you can replace the example input data with your own, including demand, sensor telemetry, CPU utilization, energy consumption, transaction volume, traffic, prices, or another regularly sampled time series. Try it on your own data: Open PatchTST-FM-r2 on the Hugging Face Hub From notebooks to streaming time series This release connects to a broader effort around IBM Granite Time Series models, adding a new model to the broader portfolio . For applications where data arrives continuously rather than in static DataFrames, IBM and Confluent recently made several Granite Time Series models available through an Early Access program in Confluent Cloud . The initial portfolio includes PatchTST-FM-r1, FlowState-r1.1, TTM-r3, and TSPulse. The integration brings foundation-model inference directly into streaming applications through Apache Flink on Confluent Cloud. Forecasts and anomaly-detection results can be generated from live streams rather than requiring teams to set up and move data to a separate ML environment. Read the IBM announcement or Enroll in Early Access .