Skip to main content
Why HTML? Back to Abstract Download PDF
License: CC BY 4.0
arXiv:2602.18645v1 [cs.LG] 20 Feb 2026
\DeclareCaptionType

example[Example][List of Examples] marginparsep has been altered.
topmargin has been altered.
marginparpush has been altered.

The page layout violates the ICML style.

Please do not change the page layout, or include packages like geometry, savetrees, or fullpage, which change it for you.

We’re not able to reliably undo arbitrary changes to the style. Please remove the offending package(s), or layout-changing commands and try again.

 

Adaptive Time Series Reasoning via Segment Selection

 

Shvat Messica 1  Jiawen Zhang 2  Kevin Li 3 1  Theodoros Tsiligkaridis 4  Marinka Zitnik 1 

††footnotetext: 1Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA 2The Hong Kong University of Science and Technology (Guangzhou) 3Massachusetts Institute of Technology 4MIT Lincoln Laboratory. Correspondence to: Shvat Messica and Marinka Zitnik <shvat.messica@fas.harvard.edu, marinka@hms.harvard.edu>.
Abstract

Time series reasoning tasks often start with a natural language question and require targeted analysis of a time series. Evidence may span the full series or appear in a few short intervals, so the model must decide what to inspect. Most existing approaches encode the entire time series into a fixed representation before inference, regardless of whether or not the entire sequence is relevant. We introduce ARTIST, which formulates time-series reasoning as a sequential decision problem. ARTIST interleaves reasoning with adaptive temporal segment selection. It adopts a controller-reasoner architecture and uses reinforcement learning to train the controller role to select informative segments and the reasoner role to generate segment-conditioned reasoning traces and final answers. During inference, the model actively acquires task-relevant information instead of relying on a static summary of the full sequence. We use a novel hierarchical policy optimization approach for post-training that allows the model to excel in both segment selection and question-answering behavior. We evaluate ARTIST on six time-series reasoning benchmarks and compare it with large language models, vision-language models, and prior time-series reasoning systems. ARTIST improves average accuracy by 6.46 absolute percentage points over the strongest baseline. The largest gains appear on rare event localization and multi-segment reasoning tasks. Supervised fine-tuning improves performance, and reinforcement learning provides additional gains by optimizing question-adaptive segment selection. These results show that selective data use drives effective time-series reasoning.

1 Introduction

Figure 1: (a) Time-series reasoning: answering a natural language question given a time series. (b) ARTIST alternates between reasoning and adaptive segment selection, choosing the next segment based on the question and intermediate outputs, and stopping once it can produce the final answer.

Time-series modeling has long been shaped by tasks such as forecasting Das et al. (2024); He et al. (2025a); Yang et al. (2025b); Wang et al. (2025c), classification Liu et al. (2025f); Liu et al. (2025d); Tran et al. (2025), and anomaly detection Sun et al. (2025); Cai et al. (2025); Kim et al. (2025). Increasingly, however, real-world use cases begin with a natural-language question rather than a predefined label or prediction horizon. A clinician may ask why a patient’s vital signs deteriorated after a medication change, and an analyst may ask what triggered a regime shift in a market indicator. Answering these questions requires linking the question to patterns in the time series and grounding the answer in relevant segments. This emerging setting, known as time series reasoning Chow et al. (2024); Kong et al. (2025b), asks models to answer natural language questions by identifying and analyzing the task-relevant parts of a time series.

Recent work has examined how to interface time series with large language models (LLMs). As in Figure 1a, approaches mainly differ in how they convert a time series into an LLM input, including textual serialization Alnegheimish et al. (2024); Luo et al. (2025); Liu et al. (2025e), rendered plots Liu et al. (2025c); Zhang et al. (2025a), and learned embeddings Xie et al. (2024); Lei et al. (2025); Langer et al. (2025). These designs improve modality alignment but keep inference static: the model receives a fixed view of the full time series and must answer from that view. This is limiting for multi-step reasoning, where intermediate conclusions should change what the model inspects next. For example, a clinical deterioration query may first check for an abrupt spike, then shift to a different window or a narrower interval to test a hypothesis. More broadly, relevant temporal segments are query- and step-dependent. Figure 1b shows the desired behavior: reasoning interleaved with temporal segment selection, stopping when the model is ready to answer.

A key missing capability is question-adaptive information selection during inference. Time series inputs are long and temporally heterogeneous, and the same sequence can support many different questions that require different regions and different resolutions. As a result, forcing the model to process a fixed view of the full series can dilute salient local structure and, in long sequences, can degrade performance by mixing irrelevant context with task-relevant information. Related problems have been studied in text-vision reasoning, where models learn to search or zoom into regions conditioned on intermediate steps Wang et al. (2025a); Zhang et al. (2025c); Li et al. (2025). However, an analogous mechanism for time-series reasoning remains underexplored, despite the strong need for adaptive localization in long time series.

Two challenges make question-adaptive segment selection difficult in time series reasoning. First, unlike images, time series rarely include task-agnostic annotations that identify segments relevant to a given question. Relevant segments depend on the question, so the model must decide during inference which parts of time series to inspect. Second, many post-training methods use reinforcement learning to optimize sequential decision making at the level of output tokens (e.g., PPO Schulman et al. (2017), GRPO Shao et al. (2024b), DAPO Yu et al. (2025a)). Token-level optimization becomes difficult when a task requires multiple sub-tasks and the reasoning horizon is long. Credit assignment then becomes diffuse: key steps such as tool calls or information selection occupy only a small part of the token sequence, so their effect on final output is hard to isolate and optimize. Approaches that disentangle traces into components and optimize them with role-specific objectives can target these steps directly Klissarov et al. (2025). This motivates our present work on separating temporal segment acquisition from time series answer generation.

Present work. ARTIST (Adaptive Reasoning for TIme-Series via Temporal Selection) is a time-series reasoning approach where an LLM is trained to treat time series as an active resource during inference (Figure 1). It interleaves reasoning with temporal segment selection by training a single policy to operate in two roles. A high-level controller selects the next segment and decides when to stop, conditioned on the question and intermediate outputs. A low-level reasoner produces intermediate reasoning steps and the final answer conditioned on the selected segments. This separation explicitly decouples where to look from how to reason. ARTIST is trained in two stages. First, we apply supervised fine-tuning (SFT) on curated traces that interleave segment selection with natural language reasoning. Second, we use collaborative self-play reinforcement learning to jointly optimize both roles. The controller is trained with a reliability-based reward that measures answer consistency under repeated sampling, and the reasoner is trained for correctness and format compliance conditioned on controller-selected segments. Across six benchmarks in clinical, financial, environmental, and general domain time series reasoning, ARTIST outperforms large language models, vision-language models, and prior time-series reasoning systems. It achieves an average accuracy improvement of 6.46 percentage points over the strongest comparator, with gains of up to 12.5 points on datasets requiring localized or multi-segment reasoning. Supervised fine-tuning alone yields an average accuracy increase of 5.65 points over baselines, while reinforcement learning provides additional gains by optimizing question-adaptive segment selection. Further, ARTIST typically uses only 30-70% of the input time series sample per query, showing that selective temporal analysis improves accuracy without requiring full time series consumption.

Contributions. (1) We present adaptive segment selection for time series reasoning. The model iteratively chooses temporal segments to inspect and updates its reasoning based on the retrieved segments. This setting does not assume pre-defined segment labels. (2) We introduce a hierarchical, collaborative self-play RL post-training method that separates segment selection from answer generation and trains each role with learning signals aligned to its role. (3) On six benchmarks, ARTIST outperforms seven strong baselines. It improves average accuracy by 6.46 absolute percentage points over the strongest comparator while using a smaller fraction of the input time series.

2 Related Work

Time Series Reasoning. Motivated by the need to solve real-world questions that require reasoning over evolving signals, as well as by advances in multimodal LLMs capable of processing non-textual inputs, recent studies have begun to formalize time-series reasoning. Several benchmarks have been introduced to evaluate such capabilities by pairing time-series signals with natural-language queries, including ECG-QA Oh et al. (2023), TSQA Kong et al. (2025a), TRQA Jing et al. (2025), RCW Liu et al. (2025b), and related datasets Merrill et al. (2024). These resources frame temporal reasoning as question answering, explanation, or diagnostic inference over real or synthetic data, providing standardized settings for assessing LLM-based approaches. In parallel with benchmark development, several modeling strategies have emerged to support time-series reasoning in LLMs. One line of work treats time-series values as textual inputs, allowing standard text-only LLMs to process temporal data without architectural modification. A second line couples a time-series encoder with a language model, such as ChatTS Xie et al. (2024), OpenTSLM Langer et al. (2025), and ITFormer Lei et al. (2025), mapping numerical observations into learned embeddings that the LLM can condition on for reasoning. A third line of work encodes time series into visual representations. VL-Time Liu et al. (2025c) and TimeMaster Zhang et al. (2025a) render signals as plots and use vision-language models to interpret them. These methods improve performance on time-series reasoning tasks, but they mainly address representation and modality integration, that is, how temporal signals are encoded and adapted for LLM processing. In contrast, the problem of selecting and analyzing temporal information during reasoning remains underexplored.

Self-Play RL for Reasoning. Self-play originated in game theory and reinforcement learning as a mechanism for learning in adversarial multi-agent settings, where agents improve by interacting with copies of themselves or past versions of their policies rather than with a fixed opponent, and where outcomes depend directly on the evolving strategies of other agents, requiring continual adaptation instead of optimization against a static objective  Zhang et al. (2025b). More recently, this paradigm has been adapted to LLMs, where self-play is used to generate training signals and improve reasoning without relying on human-labeled data Zhao et al. (2025); Fang et al. (2025); Liu et al. (2025a); Yang et al. (2025c); Huang et al. (2025); Chen et al. (2025); He et al. (2025b); Wang et al. (2025b); Yu et al. (2025b); Yue et al. (2026); Wang et al. (2026). In these studies, a single LLM assumes multiple roles within the same training loop, typically forming a difficulty-driven interaction. A proposer generates tasks that challenge the model’s current capabilities, while a solver attempts to solve them and is rewarded based on correctness. This alternation exploits the stateless nature of LLMs, allowing the same underlying model to perform distinct roles via prompting, thereby enabling data- and memory-efficient training without maintaining multiple separate models. As a result, self-play provides a mechanism for refining model behavior through role-based interaction and outcome evaluation, rather than reliance on external human annotations. This is important for time-series reasoning and adaptive segment selection, where annotations specifying which temporal segments are relevant to a given question are difficult to obtain.

In contrast to adversarial self-play, ARTIST uses collaborative self-play to separate time-series reasoning into distinct roles. ARTIST assigns adaptive segment selection to a controller and answer construction to a reasoner. The controller selects temporal segments. The reasoner produces intermediate reasoning steps and the final answer conditioned on the selected segments. This separation distinguishes evidence acquisition from answer generation and supports role-specific learning signals. Existing self-play methods, including AZR Zhao et al. (2025), SPICE Liu et al. (2025a), and SPELL Yang et al. (2025c), optimize each role with myopic objectives that reward the best immediate response within a single round. These objectives do not match temporal segment selection, where the model must build an informative set of segments across multiple rounds. ARTIST addresses this mismatch with hierarchical optimization. The controller receives trajectory-level supervision with credit assigned across interaction rounds, while the reasoner is optimized at the final round conditioned on the selected segments.

(a) Interaction Trajectory Rollout (Generation).
(b) Unified Policy Update (Optimization).
Figure 2: Overview of ARTIST. (a) Given a question and a time series, a high-level controller iteratively selects informative temporal segments, while a low-level reasoner produces intermediate reasoning traces and answers conditioned on the accumulated segment set. The controller decides whether to continue selecting or accept it as a final answer and segment list. (b) For each training example, multiple reasoning rollouts are generated per controller trajectory. Reasoner rewards are group-normalized across reasoning rollouts, while controller rewards are computed using the associated reasoning outcomes and normalized across controller trajectories. Both signals are used for a joint policy update.

3 ARTIST

3.1 Problem Setup and Notation

We study time-series reasoning for a natural-language question qq paired with a time series T∈ℝH×VT\in\mathbb{R}^{H\times V}, where HH is the sequence length and VV is the number of variables. A time-series large language model πθ\pi_{\theta} generates a textual response YY:

πθ​(q,T)→Y.\pi_{\theta}(q,T)\to Y. (1)

In this paper, we focus on the univariate setting (V=1V=1).

Time Series Reasoning. We view reasoning as searching for a high-probability inference path that links (q,T)(q,T) to a correct answer. Concretely, we introduce a latent sequence of intermediate steps z=(z1,…,zL)z=(z_{1},\dots,z_{L}) and write:

pθ​(Y∣q,T)=∑z∈𝒵pθ​(Y∣z,q)​pθ​(z∣q,T),p_{\theta}(Y\mid q,T)\;=\;\sum_{z\in\mathcal{Z}}p_{\theta}(Y\mid z,q)\,p_{\theta}(z\mid q,T), (2)

where zz specifies how the model inspects and interprets the signal before producing YY.

Segments. A segment is a contiguous slice of the time series TT, denoted s=Ttstart:tends=T_{t_{\text{start}}:t_{\text{end}}} with 0≤tstart<tend≤H0\leq t_{\text{start}}<t_{\text{end}}\leq H. We maintain an accumulated segment list 𝒮=[s1,…,sK]\mathcal{S}=[s^{1},\dots,s^{K}] over multiple reasoning steps.

3.2 Controller-Reasoner Roles in ARTIST

ARTIST is a collaborative self-play model that equips a single policy model πθ\pi_{\theta} with both adaptive segment localization and segment-conditioned reasoning. The same underlying model is invoked in two roles via role-specific prompting, yielding controller πθctl\pi_{\theta}^{\text{ctl}} and reasoner πθrsn\pi_{\theta}^{\text{rsn}}. The controller decides which temporal segments to inspect and when to terminate the interaction, while the reasoner generates a reasoning trace and a final answer conditioned on the accumulated segments.

Each training iteration consists of (i) generating rollouts through Controller-Reasoner interaction and (ii) computing a joint policy update. Figure 2 illustrates the rollout and update structure, and Algorithm 1 summarizes the optimization process.

3.3 Interaction Trajectory Rollout

For a given question-time series pair (q,T)(q,T), an interaction trajectory τ\tau is a sequence of Controller-Reasoner interaction rounds indexed by i=1,2,…,Li=1,2,\dots,L, where LL is the realized number of rounds until termination.

Controller Step. At round ii, the Controller receives the current state:

xictl=(q,T,𝒮i−1,ai−1,y^i−1),x_{i}^{\text{ctl}}=\bigl(q,T,\mathcal{S}_{i-1},a_{i-1},\hat{y}_{i-1}\bigr), (3)

where (𝒮0,a0,y^0)(\mathcal{S}_{0},a_{0},\hat{y}_{0}) are empty at initialization. In all subsequent interaction rounds i>1i>1, ai−1a_{i-1} and y^i−1\hat{y}_{i-1} are the reasoning trace and answer provided by the Reasoner in the previous round i−1i-1. The controller then outputs a reasoning trace uiu_{i} and a termination decision di∈{Continue,Accept}d_{i}\in\{\textsc{Continue},\textsc{Accept}\}. If di=Continued_{i}=\textsc{Continue}, it additionally proposes a new segment sis_{i}:

(ui,di,si)∼πθctl(⋅∣xictl),(u_{i},d_{i},s_{i})\sim\pi^{\text{ctl}}_{\theta}(\cdot\mid x_{i}^{\text{ctl}}), (4)

and we append the new segment to the segment list 𝒮(i)←𝒮i−1∪{si}\mathcal{S}_{(i)}\leftarrow\mathcal{S}_{i-1}\cup\{s_{i}\}. If di=Acceptd_{i}=\textsc{Accept}, the interaction terminates and the answer outputted by the Reasoner step in the previous round, y^i−1\hat{y}_{i-1}, is accepted as the final answer.

Reasoner Step. If di=Continued_{i}=\textsc{Continue}, the Reasoner is invoked with the updated segment list 𝒮i\mathcal{S}_{i} and produces a reasoning trace aia_{i} and answer y^i\hat{y}_{i}:

(ai,y^i)∼πθrsn(⋅∣q,𝒮i).(a_{i},\hat{y}_{i})\sim\pi^{\text{rsn}}_{\theta}(\cdot\mid q,\mathcal{S}_{i}). (5)

Formally, we define an interaction trajectory as:

τ={(ui,si,di,ai,y^i)}i=1L,dL=Accept.\tau=\bigl\{(u_{i},s_{i},d_{i},a_{i},\hat{y}_{i})\bigr\}_{i=1}^{L},\qquad d_{L}=\textsc{Accept}. (6)

We further define two sub-trajectories of an interaction trajectory: controller trajectory as τctl={(ui,si,di)}i=1L\tau_{\text{ctl}}=\{(u_{i},s_{i},d_{i})\}_{i=1}^{L}, and the reasoner trajectory @ round ii as τrsn, i=(ai,y^i)\tau_{\text{rsn, i}}=(a_{i},\hat{y}_{i}).

3.4 Reward Functions

We define rewards for the two roles based on answer correctness, reliability across repeated trials, and format compliance.

Correctness Reward. Given a question qq, gold answer y∗y^{*}, and prediction y^\hat{y}, we define the correctness reward as:

C(q,y∗,y^)=[y^=y∗].C(q,y^{*},\hat{y})=\mathbf{1}\!\left[\hat{y}=y^{*}\right]. (7)

Reliability Reward. Given qq and a segment list 𝒮\mathcal{S}, we define reliability as the expected correctness of the Reasoner under repeated sampling conditioned on (q,𝒮)(q,\mathcal{S}). In practice, we estimate it with NN independent rollouts y^(n)∼πθrsn(⋅∣q,𝒮),n=1,…,N\hat{y}^{(n)}\sim\pi_{\theta}^{\text{rsn}}(\cdot\mid q,\mathcal{S}),n=1,\dots,N and then calculate:

D(q,𝒮,y∗)=1N∑n=1N[y^(n)=y∗]=1N​∑n=1NC⁡(q,y∗,y^(n)).\begin{split}D(q,\mathcal{S},y^{*})=\frac{1}{N}\sum_{n=1}^{N}\mathbf{1}\!\left[\hat{y}^{(n)}=y^{*}\right]\\ =\frac{1}{N}\sum_{n=1}^{N}C(q,y^{*},\hat{y}^{(n)}).\end{split} (8)

A higher reliability reward indicates that the selected segments 𝒮\mathcal{S} make the Reasoner consistently produce the correct answer under sampling noise, and we use it as the learning signal for the Controller.

Controller Format Score. Each controller step receives a per-step format score fif_{i} (see Appendix A.6). Given controller trajectory τctl={(ui,di,si)}\tau_{\text{ctl}}=\{(u^{i},d^{i},s^{i})\}, and letting 𝕀viol​(τctl)∈{0,1}\mathbb{I}_{\text{viol}}(\tau_{\text{ctl}})\in\{0,1\} indicate whether τctl\tau_{\text{ctl}} contains any critical violation, we define:

Fctl(τctl)=(1−𝕀viol(τctl))⋅1L∑i=1Lfi−𝕀viol(τctl).F_{\text{ctl}}(\tau_{\text{ctl}})=\bigl(1-\mathbb{I}_{\text{viol}}(\tau_{\text{ctl}})\bigr)\cdot\frac{1}{L}\sum_{i=1}^{L}f_{i}\;-\;\mathbb{I}_{\text{viol}}(\tau_{\text{ctl}}). (9)

Controller Reward. The controller reward is defined as:

Rctl​(τctl,D)={−1if ​Fctl​(τctl)<0,wD​D+wf​Fctl​(τctl)otherwise,R_{\text{ctl}}(\tau_{\text{ctl}},D)=\begin{cases}-1&\text{if }F_{\text{ctl}}(\tau_{\text{ctl}})<0,\\[4.0pt] w_{D}\,D+w_{f}\,F_{\text{ctl}}(\tau_{\text{ctl}})&\text{otherwise},\end{cases} (10)

where wD,wfw_{D},w_{f} are tunable hyperparameters.

Reasoner Reward. Given a final-round reasoner trajectory τrsn=(a,y^)\tau_{\text{rsn}}=(a,\hat{y}) with correctness c=C⁡(q,y∗,y^)c=C(q,y^{*},\hat{y}),

Rrsn​(τrsn,c)=wc​c+we​Frsn​(τrsn),R_{\text{rsn}}(\tau_{\text{rsn}},c)=w_{c}\,c+w_{e}\,F_{\text{rsn}}(\tau_{\text{rsn}}), (11)

where FrsnF_{\text{rsn}} scores format compliance (Appendix A.6) and wc,wew_{c},w_{e} are tunable hyperparameters.

3.5 Hierarchical Policy Optimization

As shown in Fig. 2(b), we use nested rollouts to obtain separate learning signals for the Controller and Reasoner behavior, and combine them into a joint update. Decomposing the parameter update in this way enables more precise credit assignment, as advantage signals are propagated only to the relevant tokens for each role.

Nested Rollouts. For each training example (q,T,y∗)(q,T,y^{*}), we first sample GG interaction trajectories {τ(g)}g=1G\{\tau^{(g)}\}_{g=1}^{G} following Sec. 3.3. Let the terminating round of τ(g)\tau^{(g)} be L(g)L^{(g)}, and let the final segment list be 𝒮L(g)(g)\mathcal{S}^{(g)}_{L^{(g)}} (Accept does not add a new segment). For each interaction trajectory gg, we then resample the Reasoner NN times conditioned on the same final segment list, and denote these final-round reasoner trajectories as τrsn,L(g)(g,n)=(aL(g)(g,n),y^L(g)(g,n)),n=1,…,N\tau_{\text{rsn},L^{(g)}}^{(g,n)}=(a_{L^{(g)}}^{(g,n)},\hat{y}_{L^{(g)}}^{(g,n)}),n=1,\dots,N.

We then compute the mean and variance correctness rewards for reasoner trajectories, i.e., rμ(g)r_{\mu}^{(g)} and rσ(g)r_{\sigma}^{(g)}, where rμ(g)r_{\mu}^{(g)} equals the reliability reward in Eq. (8) for the final segments 𝒮L(g)(g)\mathcal{S}^{(g)}_{L^{(g)}} produced in rollout gg.

Higher-Level Advantage Calculation for Controller. The Controller is optimized as a high-level policy that iteratively localizes segments across multiple interactions with the Reasoner and decides when the current information is sufficient. For each interaction rollout g∈{1,…,G}g\in\{1,\dots,G\}, we compute a Controller reward rctl(g)=Rctl​(τctl(g),rμ(g))r_{\text{ctl}}^{(g)}=R_{\text{ctl}}\!\bigl(\tau_{\text{ctl}}^{(g)},\,r_{\mu}^{(g)}\bigr) for controller trajectory τctl(g)\tau_{\text{ctl}}^{(g)}. We then form group-relative advantages {A^ctl(g)}g=1G\{\hat{A}_{\text{ctl}}^{(g)}\}_{g=1}^{G} according to Appendix A.1.

Lower-Level Advantage Calculation for Reasoner. The Reasoner is optimized as a low-level policy that maximizes answer quality and formatting conditioned on the segments selected by the Controller. Unlike the Controller, the Reasoner update optimizes only the final-round rollouts under a fixed segment list, disentangling the optimization of Reasoner behavior from the variance in quality of the segments selected by the Controller. For each interaction rollout gg, we draw NN independent final-round Reasoner rollouts {τrsn,L(g)(g,n)}n=1N\{\tau_{\text{rsn},L^{(g)}}^{(g,n)}\}_{n=1}^{N} under the same 𝒮\mathcal{S}.

Using all G×NG\times N rollouts for every update can be memory-intensive, and many groups provide limited learning signal when their rewards are nearly identical. We therefore update the Reasoner using a single group g∗g^{*} selected by variance-guided sampling, which prioritizes interaction trajectory that induce diverse outcomes and thus yield a more informative within-group advantage signal:

p⁡(g)∝rσ(g),p(g)\;\propto\;r_{\sigma}^{(g)}, (12)

where rσ(g)r_{\sigma}^{(g)} is the variance of correctness across the NN rollouts in group gg. For the sampled group g∗g^{*}, we compute a Reasoner reward for each trajectory τrsn(g∗,n)\tau_{\text{rsn}}^{(g^{*},n)}:

rrsn(g∗,n)=Rrsn(τrsn,L(g)(g∗,n),C(q,y∗,y^L(g)(g∗,n))),r_{\text{rsn}}^{(g*,n)}\;=\;R_{\text{rsn}}\!\Bigl(\tau_{\text{rsn},L^{(g)}}^{(g^{*},n)},\,C\bigl(q,y^{*},\hat{y}_{L^{(g)}}^{(g^{*},n)}\bigr)\Bigr), (13)

and form group-relative advantages {A^rsn(g∗,n)}n=1N\{\hat{A}_{\text{rsn}}^{(g^{*},n)}\}_{n=1}^{N} according to Appendix A.3.

Joint Update. Finally, we aggregate the Controller advantages {A^ctl(g)}g=1G\{\hat{A}_{\text{ctl}}^{(g)}\}_{g=1}^{G} and the Reasoner advantages {A^rsn(g∗,n)}\{\hat{A}_{\text{rsn}}^{(g^{*},n)}\} into a joint update of the shared parameters θ\theta of πθ\pi_{\theta} that maximizes the objectives in Appendix A. Crucially, our Controller advantage signals are propagated across the Controller outputs from all rounds i∈{1,…,L(g)}i\in\{1,...,L^{(g)}\} in each interaction trajectory τ(g)\tau^{(g)}, optimizing the role’s behavior for incrementally choosing segments over multiple interactions that eventually result in the best segment set long-term. In contrast, the Reasoner advantage signals are propagated only to the Reasoner outputs from the last round L(g)L^{(g)} in each τ(g)\tau^{(g)}, optimizing the role’s behavior myopically to encourage focused, granular reasoning during question-answering. This hierarchical optimization setup is advantageous compared to previous self-play approaches for reasoning-based post-training that optimize both roles myopically, which would not be compatible for iterative segment selection.

Algorithm 1 Hierarchical Policy Optimization
0:  initial policy model πθinit\pi_{\theta_{\text{init}}}, question qq
 πθ←πθinit\pi_{\theta}\leftarrow\pi_{\theta_{\text{init}}}
 for g=1,2,…,Gg=1,2,...,G do
  τ(g)←\tau^{(g)}\leftarrow interaction rollout of length L(g)L^{(g)} using πθ\pi_{\theta}
  for n=1,2,…,Nn=1,2,...,N do
   τr​s​n,L(g)(g,n)←(aL(g)(g,n),y^L(g)(g,n))\tau_{rsn,L^{(g)}}^{(g,n)}\leftarrow(a_{L^{(g)}}^{(g,n)},\hat{y}_{L^{(g)}}^{(g,n)}) (resampled reasoner rollout @ iter. L(g)L^{(g)})
   rrsn(g,n)←Rrsn​(τrsn(g,n),C⁡(q,y,y^(g,n)))r_{\text{rsn}}^{(g,n)}\leftarrow R_{\text{rsn}}\!\Bigl(\tau_{\text{rsn}}^{(g,n)},\,C\bigl(q,y,\hat{y}^{(g,n)}\bigr)\Bigr)
  end for
  rμ(g)←Mean({C(q,y,y^L(g)(g,n)))}n=1N)r_{\mu}^{(g)}\leftarrow\text{Mean}(\{C\bigl(q,y,\hat{y}_{L^{(g)}}^{(g,n)}\bigr)\Bigr)\}_{n=1}^{N})
  rσ(g)←Var({C(q,y,y^L(g)(g,n)))}n=1N)r_{\sigma}^{(g)}\leftarrow\text{Var}(\{C\bigl(q,y,\hat{y}_{L^{(g)}}^{(g,n)}\bigr)\Bigr)\}_{n=1}^{N})
  rctl(g)←Rctl​(τctl(g),rμ(g))r_{\text{ctl}}^{(g)}\leftarrow R_{\text{ctl}}\!\bigl(\tau_{\text{ctl}}^{(g)},\,r_{\mu}^{(g)}\bigr)
 end for
 Calculate advantages A^ctl(g)\hat{A}_{\text{ctl}}^{(g)} using {rμ(g)}g=1G\{r_{\mu}^{(g)}\}_{g=1}^{G}
 Sample g∗∼{1,2,…,G}:p⁡(g)∝rσ(g)g^{*}\sim\{1,2,...,G\}:p(g)\propto r_{\sigma}^{(g)}
 Calculate advantages A^rsn(g∗,n)\hat{A}_{\text{rsn}}^{(g^{*},n)} using {rrsn(g∗,n)}n=1N\{r_{\text{rsn}}^{(g^{*},n)}\}_{n=1}^{N}
 Joint update using A^ctl(g)\hat{A}_{\text{ctl}}^{(g)} and A^rsn(g∗,n)\hat{A}_{\text{rsn}}^{(g^{*},n)}

4 Experiments

Datasets. We evaluate on six time-series reasoning benchmarks spanning diverse domains and question formats: TSQA Kong et al. (2025a), RCW Liu et al. (2025b), ECG-QA Oh et al. (2023), Sleep-QA Langer et al. (2025), TRQA Jing et al. (2025), and Etiological Reasoning (ETI) Merrill et al. (2024). We follow each benchmark’s standard evaluation protocol, applying only minor restrictions for consistency (details in Appendix B). Dataset statistics are summarized in Table 4.

Baselines. We compare against three families of models that support time-series reasoning. (1) Text-based LLMs include GPT-5 Singh et al. (2025), LLaMA-3-8B Grattafiori and others (2024), Qwen-3-8B and Qwen-3-14B Yang et al. (2025a), which take serialized time series as input. (2) Fine-tuned time-series reasoning models include ChatTS Xie et al. (2024), OpenTSLM-Flamingo Langer et al. (2025), and ITFormer Lei et al. (2025), which pair a temporal encoder with an LLM backbone. (3) Vision-based baselines include Qwen2.5-VL-3B Bai et al. (2025), VL-Time Liu et al. (2025c), and TimeMaster Zhang et al. (2025a), which operate on plotted time series. We use Qwen2.5-VL-3B-Instruct as backbone for vision-based models.

Implementation & Evaluation. We demonstrate the ARTIST approach using a Qwen3-4B backbone and a 5-layer MLP that encodes patch-based time-series inputs. Segment selection is facilitated through a tool-calling mechanism that enables the model to iteratively retrieve temporal segments. Training proceeds in two stages: (1) SFT, utilizing LoRA-based fine-tuning on structured reasoning traces that interleave natural language with segment-selection calls (Appendix C); and (2) RL, employing full-parameter fine-tuning via our collaborative self-play algorithm. Performance is measured using average Accuracy and F1 scores across 8 independent runs per dataset. For ARTIST, we maintain fixed temperatures for the reasoner (0.70.7) and controller (1.01.0). See Appendix E for comprehensive hyperparameter settings.

4.1 Benchmarking Results

Table 1: Accuracy (%) and F1-score (%) comparisons with general LLMs and TS-based encoder baselines.
Model ETI RCW ECG QA SLEEP QA TSQA TRQA Avg.
Acc F1 Acc F1 Acc F1 Acc F1 Acc F1 Acc F1 Acc F1
Random Guess 25.00 25.00 50.00 50.00 50.00 50.00 16.67 16.67 29.67 29.67 37.13 37.13 34.74 34.74
GPT-5
w/o statistics 29.50 27.90 34.07 34.88 51.98 51.78 0.49 1.77 30.92 27.22 21.50 21.67 28.08 27.54
w/ statistics 63.54 63.72 32.74 31.08 53.96 49.62 0.49 1.49 35.75 32.24 25.00 28.70 35.25 34.48
Llama-3 8B
w/o statistics 25.50 25.96 43.97 40.41 50.00 48.45 31.99 14.09 48.97 46.75 57.69 53.88 43.02 38.26
w/ statistics 35.50 34.39 62.83 45.82 50.00 48.90 22.06 13.34 44.93 44.12 55.50 53.02 45.14 39.93
Qwen3-8B
w/o statistics 25.25 24.61 0.001 0.001 50.62 48.46 4.90 6.71 11.35 11.02 14.63 15.2 17.88 17.87
w/ statistics 45.00 40.88 0.001 0.001 51.86 49.06 1.96 3.87 13.53 12.78 15.25 14.02 21.35 20.31
Qwen3-14B
w/o statistics 32.00 30.66 33.19 27.40 50.99 50.42 3.43 5.73 24.15 22.50 33.00 29.54 29.46 27.08
w/ statistics 42.00 47.34 22.57 22.91 54.58 51.79 3.43 4.48 24.15 22.20 29.00 30.32 29.29 29.84
ChatTS-14B
Base Model 31.00 21.87 69.91 30.24 48.02 32.07 17.65 13.19 43.48 30.72 57.50 42.12 44.59 28.37
+ SFT 50.50 40.69 73.89 33.10 53.47 24.31 26.47 14.60 46.38 42.65 69.00 55.57 53.28 35.15
OpenTSLM-4B
+ SFT 82.69 82.66 65.49 38.29 69.50 41.00 35.37 18.99 47.50 35.81 76.25 69.36 62.80 47.68
ITFormer-4B
+ SFT 84.62 84.60 67.31 57.95 57.31 49.91 33.62 15.77 49.50 23.62 80.12 74.22 62.08 51.01
ARTIST
+ SFT 85.12 85.11 69.75 61.46 56.31 55.68 28.13 17.94 60.06 57.13 82.26 62.32 63.61 56.61
+ SFT + RL 87.03 87.10 77.00 50.00 69.81 52.67 36.63 19.21 62.00 58.66 83.06 78.02 69.26 57.61
Improvement2 +2.41 +2.50 +3.11 +3.51 +3.14 +3.89 +1.26 +0.22 +12.50 +11.91 +2.94 +3.80 +6.46 +6.60

1  Model failed to produce the required answer template and often repeated the input prompt; scores are reported as 0.00.

2  Improvement denotes the performance gain over the strongest baseline for each dataset and metric.

Refer to caption
(a) TSQA.
Refer to caption
(b) TRQA.
Refer to caption
(c) SLEEP QA.
Figure 3: Performance and question distribution across time-series usage levels. Bars (left axis) show the percentage of questions falling into each usage-percentage bin, and the line (right axis) shows accuracy for questions in that bin.

Comparison with general LLMs and time-series reasoning models. Table 1 shows that ARTIST achieves the best overall performance across all benchmarks. Relative to the strongest baseline on each dataset and metric, ARTIST improves average accuracy by 6.46%. RL further improves performance beyond SFT. Compared with SFT, adding RL increases average accuracy from 63.61% to 69.26%. Comparison with vision–language reasoning models. Table 2 compares ARTIST with VLM baselines that operate on plotted time series. ARTIST is best on five of six datasets (ETI, RCW, ECG-QA, TSQA, TRQA), while TimeMaster+RL performs substantially better on Sleep-QA. We also observe that on ECG- and EEG-based datasets (ECG-QA and Sleep-QA), even VLMs without task-specific fine-tuning can be highly competitive, which may reflect stronger prior exposure to similar biomedical plots during pretraining.

4.2 Analysis of Time Series Data Utilization

Figure 3 examines how much of the time series ARTIST uses under RL and how this relates to accuracy on three datasets. Across datasets, greater coverage does not consistently improve performance. Instead, accuracy is highest when the model concentrates on a limited set of question-relevant segments, and it drops for questions that trigger near-complete sequence usage. For Sleep-QA and TRQA, the best accuracy occurs when the model uses roughly 30–50% of the signal, whereas questions that induce 90–100% utilization are substantially less accurate. TSQA exhibits a higher optimal range (about 70%), which is consistent with its shorter sequences and the need for proportionally broader coverage to capture relevant intervals.

4.3 Ablation Study

We conduct an ablation study to evaluate the core design choices of ARTIST, with results summarized in Table 3.

Efficacy of Adaptive Segment Selection. Removing the controller entirely, which processes the full time series as a static input, leads to a significant performance drop of 9.30% in average accuracy. This confirms that processing the entire sequence can be suboptimal, as irrelevant temporal noise may obscure salient evidence. In contrast, ARTIST’s adaptive selection directs attention to task-relevant regions, enabling more precise reasoning.

Joint Controller-Reasoner Optimization. Controller-only RL configuration, where the reasoner remains frozen, results in an 8.94% decrease in average accuracy compared to the full model. This degradation arises from a distribution shift: during RL, the reasoner is conditioned on a dynamically selected set of segments chosen by the controller, whereas in SFT it was trained under a different input regime, receiving the full time series followed by a small number of additional segments. Freezing the reasoner therefore prevents it from adapting to the controller’s evolving selection policy. Jointly updating both roles mitigates this mismatch and maintains alignment between segment selection and downstream reasoning.

Reliability Reward. The most substantial performance decline (21.44% average drop) occurs when removing the Reliability Reward. Relying on single-rollout accuracy is insufficient due to the inherent stochasticity of LLMs: a reasoner may produce a correct answer by chance even when the selected segments are incomplete or irrelevant. In these cases, a single successful rollout can mislead the controller during learning. Our reliability metric uses nested rollouts to measure answer consistency across repeated samples. This estimate reflects whether the selected segment set reliably supports correct reasoning, rather than producing an isolated correct outcome.

Hierarchical Policy Optimization and Variance-Guided Sampling. Replacing the trajectory-level objective with a myopic objective leads to a 12.28% performance drop. Here, the myopic objective refers to optimizing the controller based solely on the last interaction step, without propagating credit across the full interaction trajectory. With such an objective, the controller is encouraged to learn a greedy policy that is not optimized to make intermediate segment selections that lead to the best overarching segment set after multiple interactions. In contrast, our hierarchical objective trains the controller to optimize a sequence of segment selections that, together, forms an informative segment set. Replacing Variance-guided Sampling with standard stochastic sampling reduces average performance by 2.97%.

Table 2: Accuracy (%) comparisons with vision models.
Model ETI RCW ECG QA SLEEP QA TSQA TRQA
Base Model 27.00 50.33 53.54 49.44 52.51 66.09
VL-Time 28.50 57.52 58.91 22.06 44.93 53.50
+ Few-shot 22.00 48.67 64.36 23.53 38.16 58.50
TimeMaster 26.00 67.70 52.59 47.51 58.30 68.45
+ RL 49.00 76.99 69.31 72.55 61.22 72.08
ARTIST
+ SFT 85.12 69.75 56.31 28.13 60.06 82.26
+ RL + SFT 87.03 77.00 69.81 36.63 62.00 83.34
Figure 4: Examples of using ARTIST for reasoning with time series. Source: Etiological time series reasoning bechmark.
Table 3: Ablation on ECG-QA and RCW accuracy (%).
Method ECG RCW Avg.
ARTIST 69.81 77.00 73.41
Reasoner Only 65.33 62.88 64.11
Controller-only RL 60.81 68.13 64.47
w/o Reliability Reward 52.50 51.44 51.97
w/o Trajectory-based Objective 55.19 67.06 61.13
w/o Variance-guided Sampling 68.13 72.75 70.44

4.4 Illustration of Time Series Reasoning in ARTIST

Figure 4 illustrates how ARTIST addresses queries by selecting a targeted set of informative segments. In the apple sales case (Figure 4,left), the controller first retrieves an early segment to establish a baseline level. Guided by the initial hypothesis of a potential trend shift, it then queries a late-sequence segment to test whether the change persists. The retrieved segment reveals a sustained level increase with higher variability, allowing the model to confirm a seasonal harvest uplift rather than a transient spike. In the bird count example (Figure 4,right), the model begins with a full-span segment to establish the sampling horizon and flag suspicious intervals. It then requests a higher-resolution segment around the anomaly to determine its duration and whether the signal recovers. This second segment shows a contiguous dip on the scale of months followed by a return to the prior level, which supports a temporary external influence rather than a persistent regime change. Segment selection yields a verifiable evidence trail that ties the final answer to specific temporal segments.

5 Conclusion

ARTIST is an RL approach that trains models to select task-relevant temporal segments while they reason toward an answer. Unlike prior methods that encode the full time series into a fixed representation, ARTIST interleaves segment selection with multi-step reasoning at inference time. On six benchmarks, ARTIST improves over strong LLMs, vision-language models, and time-series reasoning models.

Limitations. ARTIST incurs an additional inference cost due to iterative segment selection during reasoning. Furthermore, our evaluation focuses on univariate time-series tasks. Extending the framework to multivariate signals and irregular sampling remains an important direction for future work.

Impact Statement

This paper presents work whose goal is to advance the field of machine learning. There are many potential societal consequences of our work, none of which we feel must be specifically highlighted here.

Acknowledgments

We gratefully acknowledge the support by NSF CAREER Award 2339524, ARPA-H Biomedical Data Fabric (BDF) Toolbox Program, Amazon Faculty Research, Google Research Scholar Program, AstraZeneca Research, GlaxoSmithKline Award, Roche Alliance with Distinguished Scientists (ROADS) Program, Sanofi iDEA-iTECH Award, Boehringer Ingelheim Award, Merck Award, Optum AI Research Collaboration Award, Pfizer Research, Gates Foundation (INV-079038), Chan Zuckerberg Initiative, John and Virginia Kaneb Fellowship at Harvard Medical School, Biswas Computational Biology Initiative in partnership with the Milken Institute, Harvard Medical School Dean’s Innovation Fund for the Use of Artificial Intelligence, and the Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University.

DISTRIBUTION STATEMENT A. Approved for public release. Distribution is unlimited. This material is based upon work supported by the Under Secretary of War for Research and Engineering under Air Force Contract No. FA8702-15-D-0001 or FA8702-25-D-B002.

Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Under Secretary of War for Research and Engineering.

References

  • Alnegheimish et al. (2024) S. Alnegheimish, L. Nguyen, L. Berti-Equille, and K. Veeramachaneni Large language models can be zero-shot anomaly detectors for time series?. arXiv preprint arXiv:2405.14755. Cited by: §1.
  • Bai et al. (2025) S. Bai, K. Chen, X. Liu, J. Wang, W. Ge, S. Song, K. Dang, P. Wang, S. Wang, J. Tang, et al. Qwen2. 5-vl technical report. arXiv preprint arXiv:2502.13923. Cited by: §4.
  • Cai et al. (2025) J. Cai, Y. Xie, G. Lim, Y. Yin, R. Zimmermann, and S. Ng Self-perturbed anomaly-aware graph dynamics for multivariate time-series anomaly detection. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
  • Chen et al. (2025) L. Chen, M. Prabhudesai, K. Fragkiadaki, H. Liu, and D. Pathak Self-questioning language models. arXiv preprint arXiv:2508.03682. Cited by: §2.
  • Chow et al. (2024) W. Chow, L. Gardiner, H. T. Hallgrímsson, M. A. Xu, and S. Y. Ren Towards time series reasoning with llms. arXiv preprint arXiv:2409.11376. Cited by: §1.
  • Das et al. (2024) A. Das, W. Kong, R. Sen, and Y. Zhou A decoder-only foundation model for time-series forecasting. In Forty-first International Conference on Machine Learning, Cited by: §1.
  • Fang et al. (2025) W. Fang, S. Liu, Y. Zhou, K. Zhang, T. Zheng, K. Chen, M. Song, and D. Tao SeRL: self-play reinforcement learning for large language models with limited data. arXiv preprint arXiv:2505.20347. Cited by: §2.
  • Grattafiori et al. (2024) A. Grattafiori et al. The llama 3 herd of models. External Links: 2407.21783, Link Cited by: §4.
  • He et al. (2025a) H. He, K. Yi, Y. Ma, Q. Zhang, Z. Niu, and G. Pang SEMPO: lightweight foundation models for time series forecasting. arXiv preprint arXiv:2510.19710. Cited by: §1.
  • He et al. (2025b) Y. He, C. Huang, Z. Li, J. Huang, and Y. Yang Visplay: self-evolving vision-language models from images. arXiv preprint arXiv:2511.15661. Cited by: §2.
  • Huang et al. (2025) C. Huang, W. Yu, X. Wang, H. Zhang, Z. Li, R. Li, J. Huang, H. Mi, and D. Yu R-zero: self-evolving reasoning llm from zero data. arXiv preprint arXiv:2508.05004. Cited by: §2.
  • Jing et al. (2025) B. Jing, S. Chen, L. Zheng, B. Liu, Z. Li, J. Zou, T. Wei, Z. Liu, Z. Zeng, R. Qiu, X. Lin, Y. Yan, Q. Yu, D. Fu, J. He, and H. Tong TRQA: time series reasoning question and answering benchmark. Note: https://openreview.net/forum?id=ULQt51DRugOpenReview dataset Cited by: Appendix B, §2, §4.
  • Kim et al. (2025) H. Kim, J. Mok, D. Lee, J. Lew, S. Kim, and S. Yoon Causality-aware contrastive learning for robust multivariate time-series anomaly detection. In International Conference on Machine Learning, Cited by: §1.
  • Klissarov et al. (2025) M. Klissarov, A. Bagaria, Z. Luo, G. Konidaris, D. Precup, and M. C. Machado Discovering temporal structure: an overview of hierarchical reinforcement learning. arXiv preprint arXiv:2506.14045. Cited by: §1.
  • Kong et al. (2025a) Y. Kong, Y. Yang, Y. Hwang, W. Du, S. Zohren, Z. Wang, M. Jin, and Q. Wen Time-mqa: time series multi-task question answering with context enhancement. arXiv preprint arXiv:2503.01875. Cited by: Appendix B, §2, §4.
  • Kong et al. (2025b) Y. Kong, Y. Yang, S. Wang, C. Liu, Y. Liang, M. Jin, S. Zohren, D. Pei, Y. Liu, and Q. Wen Position: empowering time series reasoning with multimodal llms. arXiv preprint arXiv:2502.01477. Cited by: §1.
  • Langer et al. (2025) P. Langer, T. Kaar, M. Rosenblattl, M. A. Xu, W. Chow, M. Maritsch, A. Verma, B. Han, D. S. Kim, H. Chubb, et al. Opentslm: time-series language models for reasoning over multivariate medical text-and time-series data. arXiv preprint arXiv:2510.02410. Cited by: Appendix B, §1, §2, §4, §4.
  • Lei et al. (2025) P. Lei, J. Song, Y. Hao, T. Chen, Y. Zhang, L. JIA, Y. Li, et al. ITFormer: bridging time series and natural language for multi-modal qa with large-scale multitask dataset. In Forty-second International Conference on Machine Learning, Cited by: §1, §2, §4.
  • Li et al. (2025) C. Li, W. Wu, H. Zhang, Y. Xia, S. Mao, L. Dong, I. Vulić, and F. Wei Imagine while reasoning in space: multimodal visualization-of-thought. arXiv preprint arXiv:2501.07542. Cited by: §1.
  • Liu et al. (2025a) B. Liu, C. Jin, S. Kim, W. Yuan, W. Zhao, I. Kulikov, X. Li, S. Sukhbaatar, J. Lanchantin, and J. Weston Spice: self-play in corpus environments improves reasoning. arXiv preprint arXiv:2510.24684. Cited by: §2, §2.
  • Liu et al. (2025b) H. Liu, C. Liu, and B. A. Prakash A picture is worth a thousand numbers: enabling llms reason about time series via visualization. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 7486–7518. Cited by: Appendix B, §2, §4.
  • Liu et al. (2025c) H. Liu, C. Liu, and B. A. Prakash A picture is worth a thousand numbers: enabling llms reason about time series via visualization. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 7486–7518. Cited by: §1, §2, §4.
  • Liu et al. (2025d) S. Liu, C. Wei, X. Zhou, and H. Chen Spectral-aware reservoir computing for fast and accurate time series classification. In International Conference on Machine Learning, Cited by: §1.
  • Liu et al. (2025e) Z. Liu, J. Ni, X. Tang, M. S. Lau, W. Yin, and W. Jin Can large language models adequately perform symbolic reasoning over time series?. arXiv preprint arXiv:2508.03963. Cited by: §1.
  • Liu et al. (2025f) Z. Liu, Y. Luo, B. Li, E. Eldele, M. Wu, and Q. Ma Learning soft sparse shapes for efficient time-series classification. In Proceedings of the 42nd International Conference on Machine Learning, pp. 39032–39059. Cited by: §1.
  • Luo et al. (2025) Y. Luo, Y. Zhou, M. Cheng, J. Wang, D. Wang, T. Pan, and J. Zhang Time series forecasting as reasoning: a slow-thinking approach with reinforced llms. arXiv preprint arXiv:2506.10630. Cited by: §1.
  • Merrill et al. (2024) M. A. Merrill, M. Tan, V. Gupta, T. Hartvigsen, and T. Althoff Language models still struggle to zero-shot reason about time series. arXiv preprint arXiv:2404.11757. Cited by: Appendix B, §2, §4.
  • Oh et al. (2023) J. Oh, G. Lee, S. Bae, J. Kwon, and E. Choi Ecg-qa: a comprehensive question answering dataset combined with electrocardiogram. Advances in Neural Information Processing Systems 36, pp. 66277–66288. Cited by: Appendix B, §2, §4.
  • Pouliou et al. (2025) A. Pouliou, V. E. Papageorgiou, G. Petmezas, D. Pessoa, R. P. Paiva, N. Maglaveras, and G. Tsaklidis A new approach for sleep stage identification combining hidden markov models and eeg signal processing. Journal of Medical and Biological Engineering, pp. 1–12. Cited by: Appendix B.
  • Schulman et al. (2017) J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347. Cited by: §1.
  • Shao et al. (2024a) Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu, et al. Deepseekmath: pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300. Cited by: §A.1.
  • Shao et al. (2024b) Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu, et al. Deepseekmath: pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300. Cited by: §1.
  • Singh et al. (2025) A. Singh, A. Fry, A. Perelman, A. Tart, A. Ganesh, A. El-Kishky, A. McLaughlin, A. Low, A. Ostrow, A. Ananthram, et al. OpenAI gpt-5 system card. arXiv preprint arXiv:2601.03267. Cited by: §4.
  • Sun et al. (2025) X. Sun, H. Zhou, and C. Li Multivariate time series anomaly detection with idempotent reconstruction. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
  • Tran et al. (2025) V. Tran, N. P. Doan, Z. Zhang, T. D. Pham, P. H. Nguyen, X. H. Nguyen, H. Vandierendonck, I. Assent, and S. T. Mai MIX: a multi-view time-frequency interactive explanation framework for time series classification. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §1.
  • Wang et al. (2026) H. Wang, Y. Yang, J. Hu, M. Zhu, and W. Chen V-zero: self-improving multimodal reasoning with zero annotation. arXiv preprint arXiv:2601.10094. Cited by: §2.
  • Wang et al. (2025a) H. Wang, A. Su, W. Ren, F. Lin, and W. Chen Pixel reasoner: incentivizing pixel-space reasoning with curiosity-driven reinforcement learning. arXiv preprint arXiv:2505.15966. Cited by: §1.
  • Wang et al. (2025b) Q. Wang, B. Liu, T. Zhou, J. Shi, Y. Lin, Y. Chen, H. H. Li, K. Wan, and W. Zhao Vision-zero: scalable vlm self-improvement via strategic gamified self-play. arXiv preprint arXiv:2509.25541. Cited by: §2.
  • Wang et al. (2025c) Y. Wang, Y. Qiu, P. Chen, K. Zhao, Y. Shu, Z. Rao, L. Pan, B. Yang, and C. Guo Towards a general time series forecasting model with unified representation and adaptive transfer. In Proceedings of the 42nd International Conference on Machine Learning, Vol. 267, pp. 64127–64151. Cited by: §1.
  • Xie et al. (2024) Z. Xie, Z. Li, X. He, L. Xu, X. Wen, T. Zhang, J. Chen, R. Shi, and D. Pei Chatts: aligning time series with llms via synthetic data for enhanced understanding and reasoning. arXiv preprint arXiv:2412.03104. Cited by: Appendix D, §1, §2, §4.
  • Yang et al. (2025a) A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §4.
  • Yang et al. (2025b) Y. Yang, D. Zhang, Y. Liang, H. Lu, G. Chen, and H. Li Not all data are good labels: on the self-supervised labeling for time series forecasting. arXiv preprint arXiv:2502.14704. Cited by: §1.
  • Yang et al. (2025c) Z. Yang, W. Shen, C. Li, R. Chen, F. Wan, M. Yan, X. Quan, and F. Huang Spell: self-play reinforcement learning for evolving long-context language models. arXiv preprint arXiv:2509.23863. Cited by: §2, §2.
  • Yu et al. (2025a) Q. Yu, Z. Zhang, R. Zhu, Y. Yuan, X. Zuo, Y. Yue, W. Dai, T. Fan, G. Liu, L. Liu, et al. Dapo: an open-source llm reinforcement learning system at scale. arXiv preprint arXiv:2503.14476. Cited by: §1.
  • Yu et al. (2025b) W. Yu, Z. Liang, C. Huang, K. Panaganti, T. Fang, H. Mi, and D. Yu Guided self-evolving llms with minimal human supervision. arXiv preprint arXiv:2512.02472. Cited by: §2.
  • Yue et al. (2026) Z. Yue, K. Upasani, X. Yang, S. Ge, S. Nie, Y. Mao, Z. Liu, and D. Wang Dr. zero: self-evolving search agents without training data. arXiv preprint arXiv:2601.07055. Cited by: §2.
  • Zhang et al. (2025a) J. Zhang, L. Feng, X. Guo, Y. Wu, Y. Dong, and D. Xu TimeMaster: training time-series multimodal llms to reason via reinforcement learning. arXiv preprint arXiv:2506.13705. Cited by: §1, §2, §4.
  • Zhang et al. (2025b) R. Zhang, Z. Xu, C. Ma, C. Yu, W. Tu, W. Tang, S. Huang, D. Ye, W. Ding, Y. Yang, et al. A survey on self-play methods in reinforcement learning. arXiv preprint arXiv:2408.01072. Cited by: §2.
  • Zhang et al. (2025c) X. Zhang, Z. Gao, B. Zhang, P. Li, X. Zhang, Y. Liu, T. Yuan, Y. Wu, Y. Jia, S. Zhu, et al. Chain-of-focus: adaptive visual search and zooming for multimodal reasoning via rl. arXiv preprint arXiv:2505.15436. Cited by: §1.
  • Zhao et al. (2025) A. Zhao, Y. Wu, Y. Yue, T. Wu, Q. Xu, M. Lin, S. Wang, Q. Wu, Z. Zheng, and G. Huang Absolute zero: reinforced self-play reasoning with zero data, 2025. URL https://arxiv. org/abs/2505.03335. Cited by: §2, §2.

Appendix A Controller and Reasoner Objectives and Rewards

A.1 Controller Advantages

We form group-relative advantages Shao et al. (2024a) {A^ctl(g)}g=1G\{\hat{A}_{\text{ctl}}^{(g)}\}_{g=1}^{G} as:

μctl=1G​∑g=1Grctl(g),σctl=1G​∑g=1G(rctl(g)−μctl)2,\mu_{\text{ctl}}=\frac{1}{G}\sum_{g=1}^{G}r_{\text{ctl}}^{(g)},\qquad\sigma_{\text{ctl}}=\sqrt{\frac{1}{G}\sum_{g=1}^{G}(r_{\text{ctl}}^{(g)}-\mu_{\text{ctl}})^{2}}, (14)
A^ctl(g)={0,σctl<ϵ,rctl(g)−μctlσctl+ϵ,otherwise,\hat{A}_{\text{ctl}}^{(g)}=\begin{cases}0,&\sigma_{\text{ctl}}<\epsilon,\\[4.0pt] \dfrac{r_{\text{ctl}}^{(g)}-\mu_{\text{ctl}}}{\sigma_{\text{ctl}}+\epsilon},&\text{otherwise,}\end{cases} (15)

where ϵ\epsilon is a small constant for numerical stability.

A.2 Controller Objective

Let {octl,i,t(g)}t=1Ti(g)\{o_{\text{ctl},i,t}^{(g)}\}_{t=1}^{T^{(g)}_{i}} be the sequence of the Ti(g)T^{(g)}_{i} total tokens in the Controller output (ui(g),di(g),si(g))(u_{i}^{(g)},d_{i}^{(g)},s_{i}^{(g)}) at round ii of interaction trajectory τ(g)\tau^{(g)}. For a batch of BB questions, the Controller objective function is defined as

𝒥ctl​(θ)=1B​∑b=1B1G​∑g=1G1L(g)​∑i=1L(g)1Ti(g)​∑t=1Ti(g)A^ctl(g)​log⁡πθ​(octl,i,t(g)∣qb,{octl,i,j(g)}j=1t−1)\mathcal{J}_{\text{ctl}}(\theta)=\frac{1}{B}\sum_{b=1}^{B}\frac{1}{G}\sum_{g=1}^{G}\frac{1}{L^{(g)}}\sum_{i=1}^{L^{(g)}}\frac{1}{T_{i}^{(g)}}\sum_{t=1}^{T_{i}^{(g)}}\hat{A}_{\text{ctl}}^{(g)}\log\pi_{\theta}\Big(o_{\text{ctl},i,t}^{(g)}\mid q_{b},\{o_{\text{ctl},i,j}^{(g)}\}_{j=1}^{t-1}\Big) (16)

A.3 Reasoner Advantages

We form group-relative advantages {A^rsn(g∗,n)}n=1N\{\hat{A}_{\text{rsn}}^{(g^{*},n)}\}_{n=1}^{N} as:

μrsn=1N​∑n=1Nrrsn(g∗,n),σrsn=1N​∑n=1N(rrsn(g∗,n)−μrsn)2,\mu_{\text{rsn}}=\frac{1}{N}\sum_{n=1}^{N}r_{\text{rsn}}^{(g^{*},n)},\qquad\sigma_{\text{rsn}}=\sqrt{\frac{1}{N}\sum_{n=1}^{N}(r_{\text{rsn}}^{(g^{*},n)}-\mu_{\text{rsn}})^{2}}, (17)
A^rsn(g∗,n)={0,σrsn<ϵ,rrsn(g∗,n)−μrsnσrsn+ϵ,otherwise.\hat{A}_{\text{rsn}}^{(g^{*},n)}=\begin{cases}0,&\sigma_{\text{rsn}}<\epsilon,\\[4.0pt] \dfrac{r_{\text{rsn}}^{(g^{*},n)}-\mu_{\text{rsn}}}{\sigma_{\text{rsn}}+\epsilon},&\text{otherwise.}\end{cases} (18)

A.4 Reasoner Objective

Let {orsn,t(n)}t=1T(n)\{o_{\text{rsn},t}^{(n)}\}_{t=1}^{T^{(n)}} be the sequence of the T(n)T^{(n)} total tokens in the Reasoner output (aL(g∗)(g∗,n),y^L(g∗)(g∗,n))(a^{(g^{*},n)}_{L^{(g^{*})}},\hat{y}^{(g^{*},n)}_{L^{(g^{*})}}) at round L(g∗)L^{(g^{*})} of Reasoner trajectory τrsn(g∗,n)\tau_{\text{rsn}}^{(g^{*},n)}. For a batch of BB questions, the Reasoner objective function is defined as

𝒥rsn(θ)=1B∑b=1B1N∑n=1N1T(n)∑t=1T(n)A^rsn(n)logπθ(orsn,t(n)∣qb,{orsn,j(n)}j=1t−1)−DK​L(πθ||πref)\mathcal{J}_{\text{rsn}}(\theta)=\frac{1}{B}\sum_{b=1}^{B}\frac{1}{N}\sum_{n=1}^{N}\frac{1}{T^{(n)}}\sum_{t=1}^{T^{(n)}}\hat{A}_{\text{rsn}}^{(n)}\log\pi_{\theta}\Big(o_{\text{rsn},t}^{(n)}\mid q_{b},\{o_{\text{rsn},j}^{(n)}\}_{j=1}^{t-1}\Big)-D_{KL}(\pi_{\theta}||\pi_{\text{ref}}) (19)

where the reference policy πref\pi_{\text{ref}} is the reasoning model policy after SFT but before RL post-training.

A.5 Combined Objective

The two objectives above are aggregated into a joint objective, which is maximized via gradient ascent:

𝒥=𝒥ctl+𝒥rsn.\mathcal{J}=\mathcal{J}_{\text{ctl}}+\mathcal{J}_{\text{rsn}}. (20)

A.6 Format Reward

We introduce a format reward to ensure that both the Controller and the Reasoner produce well-structured outputs that follow the required interaction protocol. The format reward penalizes malformed, ambiguous, or incomplete responses and assigns a hard failure to critical violations.

Reasoner Format Reward.

Given a reasoner completion cc, we compute a scalar format score between -1 and 1. The score starts from 1 and is reduced according to the following cases:

  • •

    Reasoning block: The completion must contain exactly one <think> block. Missing or multiple reasoning blocks incur a penalty.

  • •

    Answer block: The completion must contain exactly one non-empty <answer> block. Missing answers constitute a critical violation.

  • •

    Separation: The <answer> block must not appear inside the <think> block; violations are penalized.

If a critical violation occurs (for example, missing answer), the format score becomes negative, triggering a hard failure.

Controller Format Reward.

Let the controller produce a sequence of responses where the final response must terminate the interaction. Each controller iteration receives a per-step format score.

The trajectory level controller format score is computed by averaging the per iteration scores, unless a critical violation occurs. Specifically, the controller must satisfy the following rules:

  • •

    Decision exclusivity: Each step must contain exactly one decision: either a segment selection or an acceptance.

  • •

    Iteration structure: All non-final steps must issue a valid segment selection call, while the final step must accepts the reasoner’s answer as final.

  • •

    segment selection validity: segment selections must be valid JSON and specify a time-series segment with valid bounds.

If any step violates these constraints, a violation indicator is triggered and the controller format score is set to −1-1.

Hard Format Failure.

For both roles, any negative format score results in a hard penalty (-1).

Appendix B Datasets

Table 4: Overview of datasets.
Dataset Task # Train # Val # Test TS Len. (μ±σ\mu\pm\sigma) Domain
RCW Binary Choice 19,135 4,405 226 4000±04000\pm 0 Nature
ECG QA Binary Choice 16,663 1,999 202 1000±01000\pm 0 ECG
SLEEP QA Multi Choice 7,268 1,817 204 1500±01500\pm 0 EEG
TSQA Multi Choice 7,243 1,811 207 22±522\pm 5 Web/Nature/Healthcare/Energy
TRQA Mixed (T/F, Multi Choice) 17,241 2,487 200 136±65136\pm 65 Web/Transport/Finance/Energy/Sales/Nature
ETI Multi Choice 11,778 1,000 200 407±353407\pm 353
Sales/Energy/Entertainment/Tech/Transport/Health/Nature/Education

We follow each benchmark’s standard evaluation protocol, with minor restrictions for consistency across datasets.

TSQA Kong et al. (2025a) is a large-scale time-series question answering dataset composed of real and synthetic data, designed to evaluate models’ ability to understand and reason about temporal patterns beyond numeric prediction. We use its multiple-choice questions defined over univariate time series.

RCW is a univariate acoustic time-series dataset within the TimerBed benchmark Liu et al. (2025b) that evaluates simple deterministic reasoning by requiring models to infer the presence of a North Atlantic right whale call from temporal–spectral structure in the signal.

ECG-QA Oh et al. (2023) is a clinical time-series question answering dataset designed to evaluate medical reasoning over ECG signals, consisting of 10-second 12-lead ECG recordings paired with clinical context. In this work, we only use binary (true/false) questions involving a single lead, requiring models to reason over univariate cardiac time series.

Sleep-QA Langer et al. (2025) is a clinical time-series question answering dataset designed to evaluate reasoning over sleep-stage dynamics, consisting of 30-second single-channel electroencephalogram (EEG) recordings annotated with sleep stages. Following prior workPouliou et al. (2025); Langer et al. (2025), non-REM stages 3 and 4 are merged, yielding five classes: Wake, REM, Non-REM1, Non-REM2, and Non-REM3.

TRQA Jing et al. (2025) is a large-scale time-series reasoning benchmark; we use its characterization task, which evaluates reasoning about intrinsic properties of univariate time series through true/false and multiple-choice questions.

Etiological Reasoning (ETI) Merrill et al. (2024) is a time-series reasoning dataset that evaluates causal interpretation by requiring models to identify the most plausible generative scenario for a given univariate time series via multiple-choice questions. The original dataset consists of 6,978 synthetic time series; to obtain sufficient data for both RL and SFT, we additionally use a subset of the single–time-series (1TS) dataset released by the authors and adapt it to the etiological reasoning format using their provided code.

Appendix C SFT CoT Data Creation

Supervised fine-tuning reasoning traces follow a structured, interleaved format that alternates between natural-language reasoning and explicit time-series segment selection. Each trace consists of multiple reasoning steps, where intermediate reasoning motivates the selection of informative temporal segments, followed by a final answer. To construct these traces, we prompted GPT-5 to answer time-series questions conditioned on rendered visualizations. The resulting responses were then transformed into structured reasoning traces with explicit segment-selection steps and post-processed to ensure correctness, structural consistency, and adherence to the template. A simplified example is shown in Figure C. Figure C presents the prompt used to generate the raw responses from which the structured reasoning traces were derived.

\theexample SFT reasoning trace template.
<think> reasoning ... </think> <timeseries_selection_tool> [x1, y1] </timeseries_selection_tool> <think> reasoning ... </think> <timeseries_selection_tool> [x2, y2] </timeseries_selection_tool> <think> reasoning ... </think> <answer> A / B / C / D / E </answer>
\theexample SFT CoT curation example.
You are a world-class expert in time-series reasoning and analysis. You are given: - A time series (indexed from 0 to {ts_len - 1}) - A question about the time series - Statistics about the time series - The correct answer. Your task has two parts: (1) Identify the specific contiguous segments of the time series that are essential for solving the question. - You may choose at most 3 segments. - Each segment must be at least 8 time steps long (inclusive). - Segment boundaries must lie within [0, {ts_len - 1}]. - Only include segments that are strictly necessary. If the entire series is needed, use a single segment [0, {ts_len - 1}]. (2) Using only the identified segments and the metadata, provide a concise, step-by-step explanation that leads to the correct answer. Critical explanation constraint: - For each segment, you MUST separate: (a) The reasoning objective for selecting the segment, and (b) The analysis of what the segment reveals. - The sentence explaining why a segment is chosen MUST NOT describe, summarize, or analyze the values, patterns, trends, or variability within that segment, but explain the rationale and how to approach the question correctly. - All observations and analyses of the segment MUST appear only in the subsequent sentence. Important constraints: - Base all explanations strictly on the observable behavior and statistical properties of the time series. - Do NOT use external context, prior knowledge of labels, or textual descriptions of answer options. - Do NOT mention or allude to any answer option or class label until the final answer line. Your response MUST follow exactly the structure below, with no additional sections or deviations: Important segments: Segment 1: [x1, y1] Explanation: First, to solve the question, I need to <state the reasoning objective>. For this purpose, I’m choosing segment [x1, y1] because it is required to <state the logical purpose this segment serves, without describing what is observed>. From this segment, I conclude that <state the key insight derived from analyzing this segment>. (If needed) Segment 2: [x2, y2] Explanation: Next, I need to <state the reasoning objective>. For this purpose, I’m choosing segment [x2, y2] is chosen because it is required to <state the logical purpose this segment serves, without describing what is observed>. From this segment, I conclude that <state the key insight derived from analyzing this segment>. (If needed) Segment 3: [x3, y3] Explanation: Finally, I need to <state the reasoning objective>. For this purpose, I’m choosing segment [x3, y3] is chosen because it is required to <state the logical purpose this segment serves, without describing what is observed>. From this segment, I conclude that <state the key insight derived from analyzing this segment>. Final conclusion: One or two sentences that combine the insights from the selected segments to justify the correct answer, expressed purely in terms of time-series behavior. Answer: X Answer formatting rules: - The final line must be exactly: "Answer: X" - X must be a single capital letter: - A/B/C/D for multiple-choice questions - A/B for true/false questions - The final line must contain nothing except the letter. Question: {question} {option_block} Additional data you may use (metadata): Summary statistics: - Mean: {mean} - Min: {min_ts} - Max: {max_ts} - Std: {std} Time series length: {ts_len} Correct answer: {correct_ans}

Appendix D Supervised Fine-Tuning Configuration

Prior to reinforcement learning, we train ARTIST through large-scale pretraining following the procedure described in Xie et al. (2024), enabling joint modeling of time-series representations and natural language inputs. For each benchmark, we then independently perform supervised fine-tuning using LoRA adapters (rank 8, α=16\alpha=16) for up to 5 epochs, with early stopping based on validation performance.

Appendix E RL Training Configuration

We train ARTIST using fully on-policy reinforcement learning with full-parameter fine-tuning. Optimization is performed using AdamW with learning rate 1×10−61\times 10^{-6}. Each update processes a batch of 64 question and time-series pairs. For each pair, G=6G=6 interaction trajectories are sampled for the controller, and for each trajectory, N=6N=6 final-round reasoner rollouts are generated. During rollout generation, we use a controller temperature of 1.01.0, a reasoner temperature of 0.70.7, and top-pp sampling with p=0.95p=0.95. We apply KL regularization only to the reasoner objective with a fixed coefficient β=0.002\beta=0.002, using the SFT-initialized model as the reference policy πref\pi_{\mathrm{ref}}. Training runs for one epoch over the dataset, and experiments are conducted on four NVIDIA H100 GPUs.

Appendix F Prompts

\theexample SFT Prompt.
You are a time series expert. Analyze ONLY the given time series data and answer the question. # Output Schema <think> your reasoning and how you came to the answer.</think> <answer> [Direct answer ONLY - the first line must be exactly one letter from the set of available options.] </answer> # Rules (MANDATORY) - No text outside <think> and <answer>. - In <think>, explain your reasoning and reference the time series. - In <answer>, the first line must be exactly one letter from the set of available options. # Time Series ### Segment 0: Timesteps [0, {ts_len}] <TS_DATA> # Question {context}
\theexample Reasoner Prompt.
You are a time series expert. Analyze ONLY the given time series data and answer the question. # Output Schema <think>One-two sentences describing your reasoning and how you came to the answer.</think> <answer> [Direct answer ONLY - the first line must be exactly one letter. </answer> # Rules (MANDATORY) - No text outside <think> and <answer>. - In <think>, explain you reasoning, how you came to the answer, and reference segments by number (e.g., "Seg 2 rises ~0.3 at t=150-200"). - if evidence is insufficient, state the most likely answer and reflect uncertainty (consicely. i.e I’m not sure about the answer because...). - In <answer>: - first line is exactly A, B, C, or D. # Time Series Segments {segments_section} # Question {question}
\theexample Controller Prompt.
You are a time series analysis expert. Your task is to decide which time series segments an LLM needs to accurately answer a question related to a time series. ## Instructions 1. You receive the FULL time series embedding, the question, the segments that were given to the LLM so far, and the LLM’s answer. 2. Review the question and the LLM’s answer, and analyze the full time series embedding. 3. Evaluate if the LLM’s answer is accurate and if the available segments provide sufficient information to answer the question accurately - you can try answering the question yourself to understand what is missing. 4. Make ONE of two decisions: - Retrieve an additional segment: If you think that the answer is not accurate and/or there is critical information missing, use the tool to get an additional segment of time series data for the LLM. - Accept the LLM’s answer as final: If you think the LLM’s answer is accurate and the information provided is sufficient. ## Full Time Series Embedding <TS_DATA> ## Current Status - Time series length: X timesteps - Question: {question} - Segments provided to the LLM so far: {CURR_SEG_LIST_TEXT} LLM’s PREVIOUS ANSWER: {REASONER_ANS} ## Output Format You MUST respond in ONE of the following two formats: Option 1: Retrieve an additional segment Make a tool call asking for a specific segment of the time series data: <think> includes your concise reasoning for why you are retrieving this segment and what information is missing </think> <tool_call> {{"name": "timeseries_selection_tool", "arguments": {{"ts_seg": [start, end]}}}} </tool_call> Option 2: Accept the LLM’s answer as final You should answer with the following format: <think> includes your concise reasoning for why you are accepting the answer </think> <answer>ACCEPT</answer> ## Important Rules 1. You can only call ’timeseries_selection_tool’ ONCE per turn 2. Specify segments as integers: [100, 200] means timesteps 100 to 200 inclusive 4. Do NOT request segments outside valid range [0, {ts_len - 1}] 5. If you output "ACCEPT", the process will immediately conclude with the LLM’s current answer Make your decision now: