THUML @ Tsinghua University ORG

A Library for Advanced Deep Time Series Models for General Time Series Analysis.

A Python benchmark library for researchers to compare dozens of published deep learning models on time-series forecasting, anomaly detection, imputation, and classification tasks.

Transfer Learning Library for Domain Adaptation, Task Adaptation, and Domain Generalization

About Code release for "Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting" (NeurIPS 2021), https://arxiv.org/abs/2106.13008

Official implementation for "iTransformer: Inverted Transformers Are Effective for Time Series Forecasting" (ICLR 2024 Spotlight)

About Code release for "TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis" (ICLR 2023), https://openreview.net/pdf?id=ju_Uqw384Oq

About Code release for "Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy" (ICLR 2022 Spotlight), https://openreview.net/forum?id=LzQQ89U1qm_

Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024) and subsequent works

A curated list of DATASETS, CODEBASES and PAPERS on Multi-Task Learning (MTL), from Machine Learning perspective.

depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.

Code release for "Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting" (NeurIPS 2022), https://arxiv.org/abs/2205.14415

Implementations, Pre-training Code and Datasets of Large Time-Series Models

Official implementation for NIPS'17 paper: PredRNN: Recurrent Neural Networks for Predictive Learning Using Spatiotemporal LSTMs.

Official implementation for "TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variables" (NeurIPS 2024)

Transfer Learning Library

Code release for "Conditional Adversarial Domain Adaptation" (NIPS 2018)

About code release of "Transolver: A Fast Transformer Solver for PDEs on General Geometries", ICML 2024 Spotlight. https://arxiv.org/abs/2402.02366

About Code release for "Flowformer: Linearizing Transformers with Conservation Flows" (ICML 2022), https://arxiv.org/pdf/2202.06258.pdf

A Library for Advanced Neural PDE Solvers.

Code release for Universal Domain Adaptation(CVPR 2019)

Official implementation for "AutoTimes: Autoregressive Time Series Forecasters via Large Language Models"

Official repository for "RLVR-World: Training World Models with Reinforcement Learning" (NeurIPS 2025), https://arxiv.org/abs/2505.13934

Code release for "HashNet: Deep Learning to Hash by Continuation" (ICCV 2017)

Code release for "Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors" (NeurIPS 2023), https://arxiv.org/abs/2305.18803

Thinking with Videos from Open-Source Priors. We reproduce chain-of-frames visual reasoning by fine-tuning open-source video models. Give it a star 🌟 if you find it useful.

About model release for "Sundial: A Family of Highly Capable Time Series Foundation Models" (ICML 2025 Oral)

Code release for "LogME: Practical Assessment of Pre-trained Models for Transfer Learning" (ICML 2021) and Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs (JMLR 2022)

About code release of "Interpretable Weather Forecasting for Worldwide Stations with a Unified Deep Model", Nature Machine Intelligence, 2023. https://www.nature.com/articles/s42256-023-00667-9

Official repository for "iVideoGPT: Interactive VideoGPTs are Scalable World Models" (NeurIPS 2024), https://arxiv.org/abs/2405.15223

No description.

Code release of "Learning Transferable Features with Deep Adaptation Networks" (ICML 2015)

About Code release for "SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling" (NeurIPS 2023 Spotlight), https://arxiv.org/abs/2302.00861

About model release for "Timer-XL: Long-Context Transformers for Unified Time Series Forecasting"

Code released for ICML 2019 paper "Bridging Theory and Algorithm for Domain Adaptation".

Code release for "Self-Tuning for Data-Efficient Deep Learning" (ICML 2021)

Code release for "Partial Adversarial Domain Adaptation" (ECCV 2018)

Official repository for "Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models", https://arxiv.org/abs/2601.19834

Code release for Transferability vs. Discriminability: Batch Spectral Penalization for Adversarial Domain Adaptation (ICML 2019)

Code release for Representation Subspace Distance for Domain Adaptation Regression (ICML 2021)

About Code Release for "Solving High-Dimensional PDEs with Latent Spectral Models" (ICML 2023), https://arxiv.org/abs/2301.12664

Code release for Transferable Adversarial Training: A General Approach to Adapting Deep Classifiers (ICML2019)

Code release for "Transferable Normalization: Towards Improving Transferability of Deep Neural Networks" (NeurIPS 2019)

No description.

Code release for "Learning Multiple Tasks with Multilinear Relationship Networks" (NIPS 2017)

About Code Release for "CLIPood: Generalizing CLIP to Out-of-Distributions" (ICML 2023), https://arxiv.org/abs/2302.00864

Code release for "Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning" (NeurIPS 2023), https://arxiv.org/abs/2305.18499

HashGAN: Deep Learning to Hash with Pair Conditional Wasserstein GAN

Code release for "Partial Transfer Learning with Selective Adversarial Networks" (CVPR 2018)

Official repository for "Vid2World: Crafting Video Diffusion Models to Interactive World Models" (ICLR 2026), https://arxiv.org/abs/2505.14357

Code release for Towards Accurate Model Selection in Deep Unsupervised Domain Adaptation (ICML 2019)

About Code release for “RoPINN: Region Optimized Physics-Informed Neural Networks” (NeurIPS 2024), https://arxiv.org/abs/2405.14369

Code release for Separate to Adapt: Open Set Domain Adaptation via Progressive Separation (CVPR 2019)

Code release for "Multi-Adversarial Domain Adaptation" (AAAI 2018)

About Code release for "MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions" (CVPR 2021) https://arxiv.org/abs/2103.02243

Code Release for "Minimum Class Confusion for Versatile Domain Adaptation"(ECCV2020)

Code release for "HarmonyDream: Task Harmonization Inside World Models" (ICML 2024), https://arxiv.org/abs/2310.00344

Code release of paper Debiased Self-Training for Semi-Supervised Learning (NeurIPS 2022 Oral)

Code released for CVPR 2019 paper "Learning to Transfer Examples for Partial Domain Adaptation"

No description.

Code release for NeurIPS 2020 paper "Co-Tuning for Transfer Learning"

Code release for Open Domain Generalization with Domain-Augmented Meta-Learning (CVPR2021)

About Code release for "Dynamical Diffusion: Learning Temporal Dynamics with Diffusion Models" (ICLR 2025)

Code for ICLR2022 Decoupled Adaptation for Cross-Domain Object Detection (D-adapt) https://arxiv.org/abs/2110.02578

Code Release for "Learning to Detect Open Classes for Universal Domain Adaptation"(ECCV2020)

About Code release for "FlashBias: Fast Computation of Attention with Bias" (NeurIPS 2025), https://arxiv.org/abs/2505.12044

About Code Release for "On the Embedding Collapse When Scaling Up Recommendation Models" (ICML 2024)

About code release for "PhySense: Sensor Placement Optimization for Accurate Physics Sensing" (NeurIPS 2025 oral)

Code release for "Long-Sequence Recommendation Models Need Decoupled Embeddings" (ICLR 2025), https://arxiv.org/abs/2410.02604

A lightweight library that implements state-of-the-art few-shot learning algorithms.

Code Release for "Transferable Query Selection for Active Domain Adaptation"(CVPR2021)

No description.

Code release for Catastrophic Forgetting Meets Negative Transfer: Batch Spectral Shrinkage for Safe Transfer Learning (NeurIPS 2019)

Code release of "Deep Hashing Network for Efficient Similarity Retrieval" (AAAI 16)

About Code release for “DeepLag: Discovering Deep Lagrangian Dynamics for Intuitive Fluid Prediction” (NeurIPS 2024), https://arxiv.org/abs/2402.02425

Code release for "Supported Policy Optimization for Offline Reinforcement Learning" (NeurIPS 2022), https://arxiv.org/abs/2202.06239

About code release of "HelmFluid: Learning Helmholtz Dynamics for Interpretable Fluid Prediction", ICML 2024. https://arxiv.org/pdf/2310.10565

Code release for NeurIPS 2020 paper "Stochastic Normalization"

No description.

No description.

Official repository for "Trajectory World Models for Heterogeneous Environments" (ICML 2025), https://arxiv.org/abs/2502.01366

torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile

Code release for Transferable Curriculum for Weakly-Supervised Domain Adaptation (AAAI2019)

Code release for "Deep Priority Hashing" (ACMMM 2018)

See the official code and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models"

Code release of paper "ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning" (NeurIPS 2023)

Official repository for "ProPINN: Demystifying Propagation Failures in Physics-Informed Neural Networks", https://arxiv.org/abs/2502.00803

No description.

No description.

Deep Calibration Network

No description.

No description.

No description.

Code release for "Transfer Adversarial Hashing for Hamming Space Retrieval" (AAAI 2018)

Official repository for "CompilerDream: Learning a Compiler World Model for General Code Optimization" (KDD 2025), https://arxiv.org/abs/2404.16077

Code release of "Deep Visual-Semantic Quantization of Efficient Image Retrieval" (CVPR 17)

Official implementation of "Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers in PyTorch". To run the code, you can refer to https://github.com/thuml/Flowformer.

Official repository for "Thoth: Mid-Training Bridges LLMs to Time Series Understanding"

Code release for "PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning" (ICML 2018)

Code release of "Collective Deep Quantization of Efficient Cross-modal Retrieval" (AAAI 17)

Code for CVPR 2021 Regressive Domain Adaptation for Unsupervised Keypoint Detection (RegDA) https://arxiv.org/abs/2103.06175

Code release for "PredCNN: Predictive Learning with Cascade Convolutions" (IJCAI 2018)

Code release for Zoo-Tuning: Adaptive Transfer from A Zoo of Models (ICML2021)

No description.

About Code Release for "Estimating Heterogeneous Treatment Effects: Mutual Information Bounds and Learning Algorithms" (ICML 2023)

No description.

About Code release for “Diffusion Tuning: Transferring Diffusion Models via Chain of Forgetting” (NeurIPS 2024)

No description.

No description.

No description.