example[Example][List of Examples]
marginparsep has been altered.
topmargin has been altered.
marginparpush has been altered.
The page layout violates the ICML style.
Please do not change the page layout, or include packages like geometry, savetrees, or fullpage, which change it for you.
We’re not able to reliably undo arbitrary changes to the style. Please remove the offending package(s), or layout-changing commands and try again.
Adaptive Time Series Reasoning via Segment Selection
Shvat Messica 1 Jiawen Zhang 2 Kevin Li 3 1 Theodoros Tsiligkaridis 4 Marinka Zitnik 1
Abstract
Time series reasoning tasks often start with a natural language question and require targeted analysis of a time series. Evidence may span the full series or appear in a few short intervals, so the model must decide what to inspect. Most existing approaches encode the entire time series into a fixed representation before inference, regardless of whether or not the entire sequence is relevant. We introduce ARTIST, which formulates time-series reasoning as a sequential decision problem. ARTIST interleaves reasoning with adaptive temporal segment selection. It adopts a controller-reasoner architecture and uses reinforcement learning to train the controller role to select informative segments and the reasoner role to generate segment-conditioned reasoning traces and final answers. During inference, the model actively acquires task-relevant information instead of relying on a static summary of the full sequence. We use a novel hierarchical policy optimization approach for post-training that allows the model to excel in both segment selection and question-answering behavior. We evaluate ARTIST on six time-series reasoning benchmarks and compare it with large language models, vision-language models, and prior time-series reasoning systems. ARTIST improves average accuracy by 6.46 absolute percentage points over the strongest baseline. The largest gains appear on rare event localization and multi-segment reasoning tasks. Supervised fine-tuning improves performance, and reinforcement learning provides additional gains by optimizing question-adaptive segment selection. These results show that selective data use drives effective time-series reasoning.
1 Introduction
Time-series modeling has long been shaped by tasks such as forecasting Das et al. (2024); He et al. (2025a); Yang et al. (2025b); Wang et al. (2025c), classification Liu et al. (2025f); Liu et al. (2025d); Tran et al. (2025), and anomaly detection Sun et al. (2025); Cai et al. (2025); Kim et al. (2025). Increasingly, however, real-world use cases begin with a natural-language question rather than a predefined label or prediction horizon. A clinician may ask why a patient’s vital signs deteriorated after a medication change, and an analyst may ask what triggered a regime shift in a market indicator. Answering these questions requires linking the question to patterns in the time series and grounding the answer in relevant segments. This emerging setting, known as time series reasoning Chow et al. (2024); Kong et al. (2025b), asks models to answer natural language questions by identifying and analyzing the task-relevant parts of a time series.
Recent work has examined how to interface time series with large language models (LLMs). As in Figure 1a, approaches mainly differ in how they convert a time series into an LLM input, including textual serialization Alnegheimish et al. (2024); Luo et al. (2025); Liu et al. (2025e), rendered plots Liu et al. (2025c); Zhang et al. (2025a), and learned embeddings Xie et al. (2024); Lei et al. (2025); Langer et al. (2025). These designs improve modality alignment but keep inference static: the model receives a fixed view of the full time series and must answer from that view. This is limiting for multi-step reasoning, where intermediate conclusions should change what the model inspects next. For example, a clinical deterioration query may first check for an abrupt spike, then shift to a different window or a narrower interval to test a hypothesis. More broadly, relevant temporal segments are query- and step-dependent. Figure 1b shows the desired behavior: reasoning interleaved with temporal segment selection, stopping when the model is ready to answer.
A key missing capability is question-adaptive information selection during inference. Time series inputs are long and temporally heterogeneous, and the same sequence can support many different questions that require different regions and different resolutions. As a result, forcing the model to process a fixed view of the full series can dilute salient local structure and, in long sequences, can degrade performance by mixing irrelevant context with task-relevant information. Related problems have been studied in text-vision reasoning, where models learn to search or zoom into regions conditioned on intermediate steps Wang et al. (2025a); Zhang et al. (2025c); Li et al. (2025). However, an analogous mechanism for time-series reasoning remains underexplored, despite the strong need for adaptive localization in long time series.
Two challenges make question-adaptive segment selection difficult in time series reasoning. First, unlike images, time series rarely include task-agnostic annotations that identify segments relevant to a given question. Relevant segments depend on the question, so the model must decide during inference which parts of time series to inspect. Second, many post-training methods use reinforcement learning to optimize sequential decision making at the level of output tokens (e.g., PPO Schulman et al. (2017), GRPO Shao et al. (2024b), DAPO Yu et al. (2025a)). Token-level optimization becomes difficult when a task requires multiple sub-tasks and the reasoning horizon is long. Credit assignment then becomes diffuse: key steps such as tool calls or information selection occupy only a small part of the token sequence, so their effect on final output is hard to isolate and optimize. Approaches that disentangle traces into components and optimize them with role-specific objectives can target these steps directly Klissarov et al. (2025). This motivates our present work on separating temporal segment acquisition from time series answer generation.
Present work. ARTIST (Adaptive Reasoning for TIme-Series via Temporal Selection) is a time-series reasoning approach where an LLM is trained to treat time series as an active resource during inference (Figure 1). It interleaves reasoning with temporal segment selection by training a single policy to operate in two roles. A high-level controller selects the next segment and decides when to stop, conditioned on the question and intermediate outputs. A low-level reasoner produces intermediate reasoning steps and the final answer conditioned on the selected segments. This separation explicitly decouples where to look from how to reason. ARTIST is trained in two stages. First, we apply supervised fine-tuning (SFT) on curated traces that interleave segment selection with natural language reasoning. Second, we use collaborative self-play reinforcement learning to jointly optimize both roles. The controller is trained with a reliability-based reward that measures answer consistency under repeated sampling, and the reasoner is trained for correctness and format compliance conditioned on controller-selected segments. Across six benchmarks in clinical, financial, environmental, and general domain time series reasoning, ARTIST outperforms large language models, vision-language models, and prior time-series reasoning systems. It achieves an average accuracy improvement of 6.46 percentage points over the strongest comparator, with gains of up to 12.5 points on datasets requiring localized or multi-segment reasoning. Supervised fine-tuning alone yields an average accuracy increase of 5.65 points over baselines, while reinforcement learning provides additional gains by optimizing question-adaptive segment selection. Further, ARTIST typically uses only 30-70% of the input time series sample per query, showing that selective temporal analysis improves accuracy without requiring full time series consumption.
Contributions. (1) We present adaptive segment selection for time series reasoning. The model iteratively chooses temporal segments to inspect and updates its reasoning based on the retrieved segments. This setting does not assume pre-defined segment labels. (2) We introduce a hierarchical, collaborative self-play RL post-training method that separates segment selection from answer generation and trains each role with learning signals aligned to its role. (3) On six benchmarks, ARTIST outperforms seven strong baselines. It improves average accuracy by 6.46 absolute percentage points over the strongest comparator while using a smaller fraction of the input time series.
2 Related Work
Time Series Reasoning. Motivated by the need to solve real-world questions that require reasoning over evolving signals, as well as by advances in multimodal LLMs capable of processing non-textual inputs, recent studies have begun to formalize time-series reasoning. Several benchmarks have been introduced to evaluate such capabilities by pairing time-series signals with natural-language queries, including ECG-QA Oh et al. (2023), TSQA Kong et al. (2025a), TRQA Jing et al. (2025), RCW Liu et al. (2025b), and related datasets Merrill et al. (2024). These resources frame temporal reasoning as question answering, explanation, or diagnostic inference over real or synthetic data, providing standardized settings for assessing LLM-based approaches. In parallel with benchmark development, several modeling strategies have emerged to support time-series reasoning in LLMs. One line of work treats time-series values as textual inputs, allowing standard text-only LLMs to process temporal data without architectural modification. A second line couples a time-series encoder with a language model, such as ChatTS Xie et al. (2024), OpenTSLM Langer et al. (2025), and ITFormer Lei et al. (2025), mapping numerical observations into learned embeddings that the LLM can condition on for reasoning. A third line of work encodes time series into visual representations. VL-Time Liu et al. (2025c) and TimeMaster Zhang et al. (2025a) render signals as plots and use vision-language models to interpret them. These methods improve performance on time-series reasoning tasks, but they mainly address representation and modality integration, that is, how temporal signals are encoded and adapted for LLM processing. In contrast, the problem of selecting and analyzing temporal information during reasoning remains underexplored.
Self-Play RL for Reasoning. Self-play originated in game theory and reinforcement learning as a mechanism for learning in adversarial multi-agent settings, where agents improve by interacting with copies of themselves or past versions of their policies rather than with a fixed opponent, and where outcomes depend directly on the evolving strategies of other agents, requiring continual adaptation instead of optimization against a static objective Zhang et al. (2025b). More recently, this paradigm has been adapted to LLMs, where self-play is used to generate training signals and improve reasoning without relying on human-labeled data Zhao et al. (2025); Fang et al. (2025); Liu et al. (2025a); Yang et al. (2025c); Huang et al. (2025); Chen et al. (2025); He et al. (2025b); Wang et al. (2025b); Yu et al. (2025b); Yue et al. (2026); Wang et al. (2026). In these studies, a single LLM assumes multiple roles within the same training loop, typically forming a difficulty-driven interaction. A proposer generates tasks that challenge the model’s current capabilities, while a solver attempts to solve them and is rewarded based on correctness. This alternation exploits the stateless nature of LLMs, allowing the same underlying model to perform distinct roles via prompting, thereby enabling data- and memory-efficient training without maintaining multiple separate models. As a result, self-play provides a mechanism for refining model behavior through role-based interaction and outcome evaluation, rather than reliance on external human annotations. This is important for time-series reasoning and adaptive segment selection, where annotations specifying which temporal segments are relevant to a given question are difficult to obtain.
In contrast to adversarial self-play, ARTIST uses collaborative self-play to separate time-series reasoning into distinct roles. ARTIST assigns adaptive segment selection to a controller and answer construction to a reasoner. The controller selects temporal segments. The reasoner produces intermediate reasoning steps and the final answer conditioned on the selected segments. This separation distinguishes evidence acquisition from answer generation and supports role-specific learning signals. Existing self-play methods, including AZR Zhao et al. (2025), SPICE Liu et al. (2025a), and SPELL Yang et al. (2025c), optimize each role with myopic objectives that reward the best immediate response within a single round. These objectives do not match temporal segment selection, where the model must build an informative set of segments across multiple rounds. ARTIST addresses this mismatch with hierarchical optimization. The controller receives trajectory-level supervision with credit assigned across interaction rounds, while the reasoner is optimized at the final round conditioned on the selected segments.
3 ARTIST
3.1 Problem Setup and Notation
We study time-series reasoning for a natural-language question paired with a time series , where is the sequence length and is the number of variables. A time-series large language model generates a textual response :
| (1) |
In this paper, we focus on the univariate setting ().
Time Series Reasoning. We view reasoning as searching for a high-probability inference path that links to a correct answer. Concretely, we introduce a latent sequence of intermediate steps and write:
| (2) |
where specifies how the model inspects and interprets the signal before producing .
Segments. A segment is a contiguous slice of the time series , denoted with . We maintain an accumulated segment list over multiple reasoning steps.
3.2 Controller-Reasoner Roles in ARTIST
ARTIST is a collaborative self-play model that equips a single policy model with both adaptive segment localization and segment-conditioned reasoning. The same underlying model is invoked in two roles via role-specific prompting, yielding controller and reasoner . The controller decides which temporal segments to inspect and when to terminate the interaction, while the reasoner generates a reasoning trace and a final answer conditioned on the accumulated segments.
3.3 Interaction Trajectory Rollout
For a given question-time series pair , an interaction trajectory is a sequence of Controller-Reasoner interaction rounds indexed by , where is the realized number of rounds until termination.
Controller Step. At round , the Controller receives the current state:
| (3) |
where are empty at initialization. In all subsequent interaction rounds , and are the reasoning trace and answer provided by the Reasoner in the previous round . The controller then outputs a reasoning trace and a termination decision . If , it additionally proposes a new segment :
| (4) |
and we append the new segment to the segment list . If , the interaction terminates and the answer outputted by the Reasoner step in the previous round, , is accepted as the final answer.
Reasoner Step. If , the Reasoner is invoked with the updated segment list and produces a reasoning trace and answer :
| (5) |
Formally, we define an interaction trajectory as:
| (6) |
We further define two sub-trajectories of an interaction trajectory: controller trajectory as , and the reasoner trajectory @ round as .
3.4 Reward Functions
We define rewards for the two roles based on answer correctness, reliability across repeated trials, and format compliance.
Correctness Reward. Given a question , gold answer , and prediction , we define the correctness reward as:
| (7) |
Reliability Reward. Given and a segment list , we define reliability as the expected correctness of the Reasoner under repeated sampling conditioned on . In practice, we estimate it with independent rollouts and then calculate:
| (8) |
A higher reliability reward indicates that the selected segments make the Reasoner consistently produce the correct answer under sampling noise, and we use it as the learning signal for the Controller.
Controller Format Score. Each controller step receives a per-step format score (see Appendix A.6). Given controller trajectory , and letting indicate whether contains any critical violation, we define:
| (9) |
Controller Reward. The controller reward is defined as:
| (10) |
where are tunable hyperparameters.
Reasoner Reward. Given a final-round reasoner trajectory with correctness ,
| (11) |
where scores format compliance (Appendix A.6) and are tunable hyperparameters.
3.5 Hierarchical Policy Optimization
As shown in Fig. 2(b), we use nested rollouts to obtain separate learning signals for the Controller and Reasoner behavior, and combine them into a joint update. Decomposing the parameter update in this way enables more precise credit assignment, as advantage signals are propagated only to the relevant tokens for each role.
Nested Rollouts. For each training example , we first sample interaction trajectories following Sec. 3.3. Let the terminating round of be , and let the final segment list be (Accept does not add a new segment). For each interaction trajectory , we then resample the Reasoner times conditioned on the same final segment list, and denote these final-round reasoner trajectories as .
We then compute the mean and variance correctness rewards for reasoner trajectories, i.e., and , where equals the reliability reward in Eq. (8) for the final segments produced in rollout .
Higher-Level Advantage Calculation for Controller. The Controller is optimized as a high-level policy that iteratively localizes segments across multiple interactions with the Reasoner and decides when the current information is sufficient. For each interaction rollout , we compute a Controller reward for controller trajectory . We then form group-relative advantages according to Appendix A.1.
Lower-Level Advantage Calculation for Reasoner. The Reasoner is optimized as a low-level policy that maximizes answer quality and formatting conditioned on the segments selected by the Controller. Unlike the Controller, the Reasoner update optimizes only the final-round rollouts under a fixed segment list, disentangling the optimization of Reasoner behavior from the variance in quality of the segments selected by the Controller. For each interaction rollout , we draw independent final-round Reasoner rollouts under the same .
Using all rollouts for every update can be memory-intensive, and many groups provide limited learning signal when their rewards are nearly identical. We therefore update the Reasoner using a single group selected by variance-guided sampling, which prioritizes interaction trajectory that induce diverse outcomes and thus yield a more informative within-group advantage signal:
| (12) |
where is the variance of correctness across the rollouts in group . For the sampled group , we compute a Reasoner reward for each trajectory :
| (13) |
and form group-relative advantages according to Appendix A.3.
Joint Update. Finally, we aggregate the Controller advantages and the Reasoner advantages into a joint update of the shared parameters of that maximizes the objectives in Appendix A. Crucially, our Controller advantage signals are propagated across the Controller outputs from all rounds in each interaction trajectory , optimizing the role’s behavior for incrementally choosing segments over multiple interactions that eventually result in the best segment set long-term. In contrast, the Reasoner advantage signals are propagated only to the Reasoner outputs from the last round in each , optimizing the role’s behavior myopically to encourage focused, granular reasoning during question-answering. This hierarchical optimization setup is advantageous compared to previous self-play approaches for reasoning-based post-training that optimize both roles myopically, which would not be compatible for iterative segment selection.
4 Experiments
Datasets. We evaluate on six time-series reasoning benchmarks spanning diverse domains and question formats: TSQA Kong et al. (2025a), RCW Liu et al. (2025b), ECG-QA Oh et al. (2023), Sleep-QA Langer et al. (2025), TRQA Jing et al. (2025), and Etiological Reasoning (ETI) Merrill et al. (2024). We follow each benchmark’s standard evaluation protocol, applying only minor restrictions for consistency (details in Appendix B). Dataset statistics are summarized in Table 4.
Baselines. We compare against three families of models that support time-series reasoning. (1) Text-based LLMs include GPT-5 Singh et al. (2025), LLaMA-3-8B Grattafiori and others (2024), Qwen-3-8B and Qwen-3-14B Yang et al. (2025a), which take serialized time series as input. (2) Fine-tuned time-series reasoning models include ChatTS Xie et al. (2024), OpenTSLM-Flamingo Langer et al. (2025), and ITFormer Lei et al. (2025), which pair a temporal encoder with an LLM backbone. (3) Vision-based baselines include Qwen2.5-VL-3B Bai et al. (2025), VL-Time Liu et al. (2025c), and TimeMaster Zhang et al. (2025a), which operate on plotted time series. We use Qwen2.5-VL-3B-Instruct as backbone for vision-based models.
Implementation & Evaluation. We demonstrate the ARTIST approach using a Qwen3-4B backbone and a 5-layer MLP that encodes patch-based time-series inputs. Segment selection is facilitated through a tool-calling mechanism that enables the model to iteratively retrieve temporal segments. Training proceeds in two stages: (1) SFT, utilizing LoRA-based fine-tuning on structured reasoning traces that interleave natural language with segment-selection calls (Appendix C); and (2) RL, employing full-parameter fine-tuning via our collaborative self-play algorithm. Performance is measured using average Accuracy and F1 scores across 8 independent runs per dataset. For ARTIST, we maintain fixed temperatures for the reasoner () and controller (). See Appendix E for comprehensive hyperparameter settings.
4.1 Benchmarking Results
| Model | ETI | RCW | ECG QA | SLEEP QA | TSQA | TRQA | Avg. | |||||||
| Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | |
| Random Guess | 25.00 | 25.00 | 50.00 | 50.00 | 50.00 | 50.00 | 16.67 | 16.67 | 29.67 | 29.67 | 37.13 | 37.13 | 34.74 | 34.74 |
| GPT-5 | ||||||||||||||
| w/o statistics | 29.50 | 27.90 | 34.07 | 34.88 | 51.98 | 51.78 | 0.49 | 1.77 | 30.92 | 27.22 | 21.50 | 21.67 | 28.08 | 27.54 |
| w/ statistics | 63.54 | 63.72 | 32.74 | 31.08 | 53.96 | 49.62 | 0.49 | 1.49 | 35.75 | 32.24 | 25.00 | 28.70 | 35.25 | 34.48 |
| Llama-3 8B | ||||||||||||||
| w/o statistics | 25.50 | 25.96 | 43.97 | 40.41 | 50.00 | 48.45 | 31.99 | 14.09 | 48.97 | 46.75 | 57.69 | 53.88 | 43.02 | 38.26 |
| w/ statistics | 35.50 | 34.39 | 62.83 | 45.82 | 50.00 | 48.90 | 22.06 | 13.34 | 44.93 | 44.12 | 55.50 | 53.02 | 45.14 | 39.93 |
| Qwen3-8B | ||||||||||||||
| w/o statistics | 25.25 | 24.61 | 0.001 | 0.001 | 50.62 | 48.46 | 4.90 | 6.71 | 11.35 | 11.02 | 14.63 | 15.2 | 17.88 | 17.87 |
| w/ statistics | 45.00 | 40.88 | 0.001 | 0.001 | 51.86 | 49.06 | 1.96 | 3.87 | 13.53 | 12.78 | 15.25 | 14.02 | 21.35 | 20.31 |
| Qwen3-14B | ||||||||||||||
| w/o statistics | 32.00 | 30.66 | 33.19 | 27.40 | 50.99 | 50.42 | 3.43 | 5.73 | 24.15 | 22.50 | 33.00 | 29.54 | 29.46 | 27.08 |
| w/ statistics | 42.00 | 47.34 | 22.57 | 22.91 | 54.58 | 51.79 | 3.43 | 4.48 | 24.15 | 22.20 | 29.00 | 30.32 | 29.29 | 29.84 |
| ChatTS-14B | ||||||||||||||
| Base Model | 31.00 | 21.87 | 69.91 | 30.24 | 48.02 | 32.07 | 17.65 | 13.19 | 43.48 | 30.72 | 57.50 | 42.12 | 44.59 | 28.37 |
| + SFT | 50.50 | 40.69 | 73.89 | 33.10 | 53.47 | 24.31 | 26.47 | 14.60 | 46.38 | 42.65 | 69.00 | 55.57 | 53.28 | 35.15 |
| OpenTSLM-4B | ||||||||||||||
| + SFT | 82.69 | 82.66 | 65.49 | 38.29 | 69.50 | 41.00 | 35.37 | 18.99 | 47.50 | 35.81 | 76.25 | 69.36 | 62.80 | 47.68 |
| ITFormer-4B | ||||||||||||||
| + SFT | 84.62 | 84.60 | 67.31 | 57.95 | 57.31 | 49.91 | 33.62 | 15.77 | 49.50 | 23.62 | 80.12 | 74.22 | 62.08 | 51.01 |
| ARTIST | ||||||||||||||
| + SFT | 85.12 | 85.11 | 69.75 | 61.46 | 56.31 | 55.68 | 28.13 | 17.94 | 60.06 | 57.13 | 82.26 | 62.32 | 63.61 | 56.61 |
| + SFT + RL | 87.03 | 87.10 | 77.00 | 50.00 | 69.81 | 52.67 | 36.63 | 19.21 | 62.00 | 58.66 | 83.06 | 78.02 | 69.26 | 57.61 |
| Improvement2 | +2.41 | +2.50 | +3.11 | +3.51 | +3.14 | +3.89 | +1.26 | +0.22 | +12.50 | +11.91 | +2.94 | +3.80 | +6.46 | +6.60 |
1 Model failed to produce the required answer template and often repeated the input prompt; scores are reported as 0.00.
2 Improvement denotes the performance gain over the strongest baseline for each dataset and metric.
Comparison with general LLMs and time-series reasoning models. Table 1 shows that ARTIST achieves the best overall performance across all benchmarks. Relative to the strongest baseline on each dataset and metric, ARTIST improves average accuracy by 6.46%. RL further improves performance beyond SFT. Compared with SFT, adding RL increases average accuracy from 63.61% to 69.26%. Comparison with vision–language reasoning models. Table 2 compares ARTIST with VLM baselines that operate on plotted time series. ARTIST is best on five of six datasets (ETI, RCW, ECG-QA, TSQA, TRQA), while TimeMaster+RL performs substantially better on Sleep-QA. We also observe that on ECG- and EEG-based datasets (ECG-QA and Sleep-QA), even VLMs without task-specific fine-tuning can be highly competitive, which may reflect stronger prior exposure to similar biomedical plots during pretraining.
4.2 Analysis of Time Series Data Utilization
Figure 3 examines how much of the time series ARTIST uses under RL and how this relates to accuracy on three datasets. Across datasets, greater coverage does not consistently improve performance. Instead, accuracy is highest when the model concentrates on a limited set of question-relevant segments, and it drops for questions that trigger near-complete sequence usage. For Sleep-QA and TRQA, the best accuracy occurs when the model uses roughly 30–50% of the signal, whereas questions that induce 90–100% utilization are substantially less accurate. TSQA exhibits a higher optimal range (about 70%), which is consistent with its shorter sequences and the need for proportionally broader coverage to capture relevant intervals.
4.3 Ablation Study
We conduct an ablation study to evaluate the core design choices of ARTIST, with results summarized in Table 3.
Efficacy of Adaptive Segment Selection. Removing the controller entirely, which processes the full time series as a static input, leads to a significant performance drop of 9.30% in average accuracy. This confirms that processing the entire sequence can be suboptimal, as irrelevant temporal noise may obscure salient evidence. In contrast, ARTIST’s adaptive selection directs attention to task-relevant regions, enabling more precise reasoning.
Joint Controller-Reasoner Optimization. Controller-only RL configuration, where the reasoner remains frozen, results in an 8.94% decrease in average accuracy compared to the full model. This degradation arises from a distribution shift: during RL, the reasoner is conditioned on a dynamically selected set of segments chosen by the controller, whereas in SFT it was trained under a different input regime, receiving the full time series followed by a small number of additional segments. Freezing the reasoner therefore prevents it from adapting to the controller’s evolving selection policy. Jointly updating both roles mitigates this mismatch and maintains alignment between segment selection and downstream reasoning.
Reliability Reward. The most substantial performance decline (21.44% average drop) occurs when removing the Reliability Reward. Relying on single-rollout accuracy is insufficient due to the inherent stochasticity of LLMs: a reasoner may produce a correct answer by chance even when the selected segments are incomplete or irrelevant. In these cases, a single successful rollout can mislead the controller during learning. Our reliability metric uses nested rollouts to measure answer consistency across repeated samples. This estimate reflects whether the selected segment set reliably supports correct reasoning, rather than producing an isolated correct outcome.
Hierarchical Policy Optimization and Variance-Guided Sampling. Replacing the trajectory-level objective with a myopic objective leads to a 12.28% performance drop. Here, the myopic objective refers to optimizing the controller based solely on the last interaction step, without propagating credit across the full interaction trajectory. With such an objective, the controller is encouraged to learn a greedy policy that is not optimized to make intermediate segment selections that lead to the best overarching segment set after multiple interactions. In contrast, our hierarchical objective trains the controller to optimize a sequence of segment selections that, together, forms an informative segment set. Replacing Variance-guided Sampling with standard stochastic sampling reduces average performance by 2.97%.
| Model | ETI | RCW | ECG QA | SLEEP QA | TSQA | TRQA |
| Base Model | 27.00 | 50.33 | 53.54 | 49.44 | 52.51 | 66.09 |
| VL-Time | 28.50 | 57.52 | 58.91 | 22.06 | 44.93 | 53.50 |
| + Few-shot | 22.00 | 48.67 | 64.36 | 23.53 | 38.16 | 58.50 |
| TimeMaster | 26.00 | 67.70 | 52.59 | 47.51 | 58.30 | 68.45 |
| + RL | 49.00 | 76.99 | 69.31 | 72.55 | 61.22 | 72.08 |
| ARTIST | ||||||
| + SFT | 85.12 | 69.75 | 56.31 | 28.13 | 60.06 | 82.26 |
| + RL + SFT | 87.03 | 77.00 | 69.81 | 36.63 | 62.00 | 83.34 |
| Method | ECG | RCW | Avg. |
| ARTIST | 69.81 | 77.00 | 73.41 |
| Reasoner Only | 65.33 | 62.88 | 64.11 |
| Controller-only RL | 60.81 | 68.13 | 64.47 |
| w/o Reliability Reward | 52.50 | 51.44 | 51.97 |
| w/o Trajectory-based Objective | 55.19 | 67.06 | 61.13 |
| w/o Variance-guided Sampling | 68.13 | 72.75 | 70.44 |
4.4 Illustration of Time Series Reasoning in ARTIST
Figure 4 illustrates how ARTIST addresses queries by selecting a targeted set of informative segments. In the apple sales case (Figure 4,left), the controller first retrieves an early segment to establish a baseline level. Guided by the initial hypothesis of a potential trend shift, it then queries a late-sequence segment to test whether the change persists. The retrieved segment reveals a sustained level increase with higher variability, allowing the model to confirm a seasonal harvest uplift rather than a transient spike. In the bird count example (Figure 4,right), the model begins with a full-span segment to establish the sampling horizon and flag suspicious intervals. It then requests a higher-resolution segment around the anomaly to determine its duration and whether the signal recovers. This second segment shows a contiguous dip on the scale of months followed by a return to the prior level, which supports a temporary external influence rather than a persistent regime change. Segment selection yields a verifiable evidence trail that ties the final answer to specific temporal segments.
5 Conclusion
ARTIST is an RL approach that trains models to select task-relevant temporal segments while they reason toward an answer. Unlike prior methods that encode the full time series into a fixed representation, ARTIST interleaves segment selection with multi-step reasoning at inference time. On six benchmarks, ARTIST improves over strong LLMs, vision-language models, and time-series reasoning models.
Limitations. ARTIST incurs an additional inference cost due to iterative segment selection during reasoning. Furthermore, our evaluation focuses on univariate time-series tasks. Extending the framework to multivariate signals and irregular sampling remains an important direction for future work.
Impact Statement
This paper presents work whose goal is to advance the field of machine learning. There are many potential societal consequences of our work, none of which we feel must be specifically highlighted here.
Acknowledgments
We gratefully acknowledge the support by NSF CAREER Award 2339524, ARPA-H Biomedical Data Fabric (BDF) Toolbox Program, Amazon Faculty Research, Google Research Scholar Program, AstraZeneca Research, GlaxoSmithKline Award, Roche Alliance with Distinguished Scientists (ROADS) Program, Sanofi iDEA-iTECH Award, Boehringer Ingelheim Award, Merck Award, Optum AI Research Collaboration Award, Pfizer Research, Gates Foundation (INV-079038), Chan Zuckerberg Initiative, John and Virginia Kaneb Fellowship at Harvard Medical School, Biswas Computational Biology Initiative in partnership with the Milken Institute, Harvard Medical School Dean’s Innovation Fund for the Use of Artificial Intelligence, and the Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University.
DISTRIBUTION STATEMENT A. Approved for public release. Distribution is unlimited. This material is based upon work supported by the Under Secretary of War for Research and Engineering under Air Force Contract No. FA8702-15-D-0001 or FA8702-25-D-B002.
Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Under Secretary of War for Research and Engineering.
References
- Large language models can be zero-shot anomaly detectors for time series?. arXiv preprint arXiv:2405.14755. Cited by: §1.
- Qwen2. 5-vl technical report. arXiv preprint arXiv:2502.13923. Cited by: §4.
- Self-perturbed anomaly-aware graph dynamics for multivariate time-series anomaly detection. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
- Self-questioning language models. arXiv preprint arXiv:2508.03682. Cited by: §2.
- Towards time series reasoning with llms. arXiv preprint arXiv:2409.11376. Cited by: §1.
- A decoder-only foundation model for time-series forecasting. In Forty-first International Conference on Machine Learning, Cited by: §1.
- SeRL: self-play reinforcement learning for large language models with limited data. arXiv preprint arXiv:2505.20347. Cited by: §2.
- The llama 3 herd of models. External Links: 2407.21783, Link Cited by: §4.
- SEMPO: lightweight foundation models for time series forecasting. arXiv preprint arXiv:2510.19710. Cited by: §1.
- Visplay: self-evolving vision-language models from images. arXiv preprint arXiv:2511.15661. Cited by: §2.
- R-zero: self-evolving reasoning llm from zero data. arXiv preprint arXiv:2508.05004. Cited by: §2.
- TRQA: time series reasoning question and answering benchmark. Note: https://openreview.net/forum?id=ULQt51DRugOpenReview dataset Cited by: Appendix B, §2, §4.
- Causality-aware contrastive learning for robust multivariate time-series anomaly detection. In International Conference on Machine Learning, Cited by: §1.
- Discovering temporal structure: an overview of hierarchical reinforcement learning. arXiv preprint arXiv:2506.14045. Cited by: §1.
- Time-mqa: time series multi-task question answering with context enhancement. arXiv preprint arXiv:2503.01875. Cited by: Appendix B, §2, §4.
- Position: empowering time series reasoning with multimodal llms. arXiv preprint arXiv:2502.01477. Cited by: §1.
- Opentslm: time-series language models for reasoning over multivariate medical text-and time-series data. arXiv preprint arXiv:2510.02410. Cited by: Appendix B, §1, §2, §4, §4.
- ITFormer: bridging time series and natural language for multi-modal qa with large-scale multitask dataset. In Forty-second International Conference on Machine Learning, Cited by: §1, §2, §4.
- Imagine while reasoning in space: multimodal visualization-of-thought. arXiv preprint arXiv:2501.07542. Cited by: §1.
- Spice: self-play in corpus environments improves reasoning. arXiv preprint arXiv:2510.24684. Cited by: §2, §2.
- A picture is worth a thousand numbers: enabling llms reason about time series via visualization. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 7486–7518. Cited by: Appendix B, §2, §4.
- A picture is worth a thousand numbers: enabling llms reason about time series via visualization. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 7486–7518. Cited by: §1, §2, §4.
- Spectral-aware reservoir computing for fast and accurate time series classification. In International Conference on Machine Learning, Cited by: §1.
- Can large language models adequately perform symbolic reasoning over time series?. arXiv preprint arXiv:2508.03963. Cited by: §1.
- Learning soft sparse shapes for efficient time-series classification. In Proceedings of the 42nd International Conference on Machine Learning, pp. 39032–39059. Cited by: §1.
- Time series forecasting as reasoning: a slow-thinking approach with reinforced llms. arXiv preprint arXiv:2506.10630. Cited by: §1.
- Language models still struggle to zero-shot reason about time series. arXiv preprint arXiv:2404.11757. Cited by: Appendix B, §2, §4.
- Ecg-qa: a comprehensive question answering dataset combined with electrocardiogram. Advances in Neural Information Processing Systems 36, pp. 66277–66288. Cited by: Appendix B, §2, §4.
- A new approach for sleep stage identification combining hidden markov models and eeg signal processing. Journal of Medical and Biological Engineering, pp. 1–12. Cited by: Appendix B.
- Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347. Cited by: §1.
- Deepseekmath: pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300. Cited by: §A.1.
- Deepseekmath: pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300. Cited by: §1.
- OpenAI gpt-5 system card. arXiv preprint arXiv:2601.03267. Cited by: §4.
- Multivariate time series anomaly detection with idempotent reconstruction. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
- MIX: a multi-view time-frequency interactive explanation framework for time series classification. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
- V-zero: self-improving multimodal reasoning with zero annotation. arXiv preprint arXiv:2601.10094. Cited by: §2.
- Pixel reasoner: incentivizing pixel-space reasoning with curiosity-driven reinforcement learning. arXiv preprint arXiv:2505.15966. Cited by: §1.
- Vision-zero: scalable vlm self-improvement via strategic gamified self-play. arXiv preprint arXiv:2509.25541. Cited by: §2.
- Towards a general time series forecasting model with unified representation and adaptive transfer. In Proceedings of the 42nd International Conference on Machine Learning, Vol. 267, pp. 64127–64151. Cited by: §1.
- Chatts: aligning time series with llms via synthetic data for enhanced understanding and reasoning. arXiv preprint arXiv:2412.03104. Cited by: Appendix D, §1, §2, §4.
- Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §4.
- Not all data are good labels: on the self-supervised labeling for time series forecasting. arXiv preprint arXiv:2502.14704. Cited by: §1.
- Spell: self-play reinforcement learning for evolving long-context language models. arXiv preprint arXiv:2509.23863. Cited by: §2, §2.
- Dapo: an open-source llm reinforcement learning system at scale. arXiv preprint arXiv:2503.14476. Cited by: §1.
- Guided self-evolving llms with minimal human supervision. arXiv preprint arXiv:2512.02472. Cited by: §2.
- Dr. zero: self-evolving search agents without training data. arXiv preprint arXiv:2601.07055. Cited by: §2.
- TimeMaster: training time-series multimodal llms to reason via reinforcement learning. arXiv preprint arXiv:2506.13705. Cited by: §1, §2, §4.
- A survey on self-play methods in reinforcement learning. arXiv preprint arXiv:2408.01072. Cited by: §2.
- Chain-of-focus: adaptive visual search and zooming for multimodal reasoning via rl. arXiv preprint arXiv:2505.15436. Cited by: §1.
- Absolute zero: reinforced self-play reasoning with zero data, 2025. URL https://arxiv. org/abs/2505.03335. Cited by: §2, §2.
Appendix A Controller and Reasoner Objectives and Rewards
A.1 Controller Advantages
We form group-relative advantages Shao et al. (2024a) as:
| (14) |
| (15) |
where is a small constant for numerical stability.
A.2 Controller Objective
Let be the sequence of the total tokens in the Controller output at round of interaction trajectory . For a batch of questions, the Controller objective function is defined as
| (16) |
A.3 Reasoner Advantages
We form group-relative advantages as:
| (17) |
| (18) |
A.4 Reasoner Objective
Let be the sequence of the total tokens in the Reasoner output at round of Reasoner trajectory . For a batch of questions, the Reasoner objective function is defined as
| (19) |
where the reference policy is the reasoning model policy after SFT but before RL post-training.
A.5 Combined Objective
The two objectives above are aggregated into a joint objective, which is maximized via gradient ascent:
| (20) |
A.6 Format Reward
We introduce a format reward to ensure that both the Controller and the Reasoner produce well-structured outputs that follow the required interaction protocol. The format reward penalizes malformed, ambiguous, or incomplete responses and assigns a hard failure to critical violations.
Reasoner Format Reward.
Given a reasoner completion , we compute a scalar format score between -1 and 1. The score starts from 1 and is reduced according to the following cases:
- •
Reasoning block: The completion must contain exactly one <think> block. Missing or multiple reasoning blocks incur a penalty.
- •
Answer block: The completion must contain exactly one non-empty <answer> block. Missing answers constitute a critical violation.
- •
Separation: The <answer> block must not appear inside the <think> block; violations are penalized.
If a critical violation occurs (for example, missing answer), the format score becomes negative, triggering a hard failure.
Controller Format Reward.
Let the controller produce a sequence of responses where the final response must terminate the interaction. Each controller iteration receives a per-step format score.
The trajectory level controller format score is computed by averaging the per iteration scores, unless a critical violation occurs. Specifically, the controller must satisfy the following rules:
- •
Decision exclusivity: Each step must contain exactly one decision: either a segment selection or an acceptance.
- •
Iteration structure: All non-final steps must issue a valid segment selection call, while the final step must accepts the reasoner’s answer as final.
- •
segment selection validity: segment selections must be valid JSON and specify a time-series segment with valid bounds.
If any step violates these constraints, a violation indicator is triggered and the controller format score is set to .
Hard Format Failure.
For both roles, any negative format score results in a hard penalty (-1).
Appendix B Datasets
| Dataset | Task | # Train | # Val | # Test | TS Len. () | Domain | |
| RCW | Binary Choice | 19,135 | 4,405 | 226 | Nature | ||
| ECG QA | Binary Choice | 16,663 | 1,999 | 202 | ECG | ||
| SLEEP QA | Multi Choice | 7,268 | 1,817 | 204 | EEG | ||
| TSQA | Multi Choice | 7,243 | 1,811 | 207 | Web/Nature/Healthcare/Energy | ||
| TRQA | Mixed (T/F, Multi Choice) | 17,241 | 2,487 | 200 | Web/Transport/Finance/Energy/Sales/Nature | ||
| ETI | Multi Choice | 11,778 | 1,000 | 200 |
|
We follow each benchmark’s standard evaluation protocol, with minor restrictions for consistency across datasets.
TSQA Kong et al. (2025a) is a large-scale time-series question answering dataset composed of real and synthetic data, designed to evaluate models’ ability to understand and reason about temporal patterns beyond numeric prediction. We use its multiple-choice questions defined over univariate time series.
RCW is a univariate acoustic time-series dataset within the TimerBed benchmark Liu et al. (2025b) that evaluates simple deterministic reasoning by requiring models to infer the presence of a North Atlantic right whale call from temporal–spectral structure in the signal.
ECG-QA Oh et al. (2023) is a clinical time-series question answering dataset designed to evaluate medical reasoning over ECG signals, consisting of 10-second 12-lead ECG recordings paired with clinical context. In this work, we only use binary (true/false) questions involving a single lead, requiring models to reason over univariate cardiac time series.
Sleep-QA Langer et al. (2025) is a clinical time-series question answering dataset designed to evaluate reasoning over sleep-stage dynamics, consisting of 30-second single-channel electroencephalogram (EEG) recordings annotated with sleep stages. Following prior workPouliou et al. (2025); Langer et al. (2025), non-REM stages 3 and 4 are merged, yielding five classes: Wake, REM, Non-REM1, Non-REM2, and Non-REM3.
TRQA Jing et al. (2025) is a large-scale time-series reasoning benchmark; we use its characterization task, which evaluates reasoning about intrinsic properties of univariate time series through true/false and multiple-choice questions.
Etiological Reasoning (ETI) Merrill et al. (2024) is a time-series reasoning dataset that evaluates causal interpretation by requiring models to identify the most plausible generative scenario for a given univariate time series via multiple-choice questions. The original dataset consists of 6,978 synthetic time series; to obtain sufficient data for both RL and SFT, we additionally use a subset of the single–time-series (1TS) dataset released by the authors and adapt it to the etiological reasoning format using their provided code.
Appendix C SFT CoT Data Creation
Supervised fine-tuning reasoning traces follow a structured, interleaved format that alternates between natural-language reasoning and explicit time-series segment selection. Each trace consists of multiple reasoning steps, where intermediate reasoning motivates the selection of informative temporal segments, followed by a final answer. To construct these traces, we prompted GPT-5 to answer time-series questions conditioned on rendered visualizations. The resulting responses were then transformed into structured reasoning traces with explicit segment-selection steps and post-processed to ensure correctness, structural consistency, and adherence to the template. A simplified example is shown in Figure C. Figure C presents the prompt used to generate the raw responses from which the structured reasoning traces were derived.
Appendix D Supervised Fine-Tuning Configuration
Prior to reinforcement learning, we train ARTIST through large-scale pretraining following the procedure described in Xie et al. (2024), enabling joint modeling of time-series representations and natural language inputs. For each benchmark, we then independently perform supervised fine-tuning using LoRA adapters (rank 8, ) for up to 5 epochs, with early stopping based on validation performance.
Appendix E RL Training Configuration
We train ARTIST using fully on-policy reinforcement learning with full-parameter fine-tuning. Optimization is performed using AdamW with learning rate . Each update processes a batch of 64 question and time-series pairs. For each pair, interaction trajectories are sampled for the controller, and for each trajectory, final-round reasoner rollouts are generated. During rollout generation, we use a controller temperature of , a reasoner temperature of , and top- sampling with . We apply KL regularization only to the reasoner objective with a fixed coefficient , using the SFT-initialized model as the reference policy . Training runs for one epoch over the dataset, and experiments are conducted on four NVIDIA H100 GPUs.