4-day longest streak
Hi, welcome to my Github 👋 <!-- --> I am Xiao Liu, a PhD student in Tsinghua University since 2021. 🔭 Interested in Machine Learning, Natural Language Processing, and Foundation…
Hi, welcome to my Github 👋
<!-- !visitors -->
I am Xiao Liu, a PhD student in Tsinghua University since 2021.
- 🔭 Interested in Machine Learning, Natural Language Processing, and Foundation Models.
- 🌱 Find my up-to-date publication list in Google Scholar! Some of my proud works as lead authors:
Alignment and Scalable Oversights over LLMs and Diffusers
* ImageReward (NeurIPS'23): the first general-purpose text-to-image human preference reward model (RM) for RLHF, outperforming CLIP/BLIP/Aesthetic by 30% in terms of human preference prediction.
* BPO (Black-box Prompt Optimization, ACL'24): a novel direction to align LLMs via preference-aware prompt optimization. Improving ChatGPT, Claude, LLaMA on human preference's win rates by 20%+ without training them.
* AlignBench (ACL'24): the first comprehensive benchmark on evaluating LLMs' Chinese alignment, deriving from ChatGLM's online real scenarios. Adopted by top Chinese LLMs (ChatGLM, Qwen, DeepSeek, Yi, Baichuan, Abab, and etc.)
* SPaR (ICLR'25): Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
Self-supervised Learning and Reasoning
* Self-supervised Learning: Generative or Contrastive (TKDE'21): one of the most cited survey on self-supervised learning
* SelfKG (WWW'22): self-supervised alignment can be comparable to supervised ones, *Best Paper Nominee* in WWW 2022.
* kgTransformer (KDD'22): pre-training knowledge graph transformers with mixture-of-experts (MoE) for complex logical reasoning
- 🤔 Dedicated to building next-generation of AI systems via both Large Pre-trained Model and Symbolic Agent Reasoning.
- 💬 Feel free to drop me an email for:
* Any issue about my works or code
* Interesting ideas to discuss or just chatting
-
GLM-130B ★ PINNED ⑂
GLM-130B: An Open Bilingual Pre-Trained Model
★ 0 3y agoExplain → -
P-tuning-v2 ★ PINNED ⑂
An optimized prompt tuning strategy comparable to fine-tuning across model scales and tasks.
Python ★ 0 4y agoExplain → -
AutoGLM
No description.
JavaScript ★ 85 7mo agoExplain → -
OAG_know
codes for OAG_know and GloMoCo: Unsupervised Embedding Training for Concept Linking
Python ★ 7 4y agoExplain → -
Xiao9905
No description.
★ 4 2mo agoExplain → -
nanoGPT ⑂
The simplest, fastest repository for training/finetuning medium-sized GPTs.
★ 2 3y agoExplain → -
REKCARC-TSC-UHT ⑂
清华大学计算机系课程攻略 Guidance for courses in Department of Computer Science and Technology, Tsinghua University
C++ ★ 2 7y agoExplain → -
FasterTransformer ⑂
Transformer related optimization, including BERT, GPT
★ 2 3y agoExplain → -
datasets ⑂
🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools
★ 1 5y agoExplain → -
xiao9905.github.io ⑂
A beautiful, simple, clean, and responsive Jekyll theme for academics
JavaScript ★ 1 5y agoExplain → -
PromptPapers ⑂
Must-read papers on prompt-based tuning for pre-trained language models.
★ 1 4y agoExplain → -
KDD-2019-Hands-on ⑂
DGL tutorial in KDD 2019
Jupyter Notebook ★ 1 7y agoExplain → -
AcademicShare191015
A document share for 学术新星计划2020分享会
★ 1 6y agoExplain → -
SeeAct ⑂
SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).
★ 0 2y agoExplain → -
summarize-from-feedback ⑂
Code for "Learning to summarize from human feedback"
★ 0 4y agoExplain → -
BIG-bench ⑂
Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
★ 0 4y agoExplain → -
Instructdial ⑂
No description.
★ 0 4y agoExplain → -
KnowledGPT ⑂
No description.
★ 0 5y agoExplain → -
promptsource ⑂
Toolkit for creating, sharing and using natural language prompts.
★ 0 4y agoExplain → -
GraphMAE ⑂
GraphMAE: Self-supervised Masked Graph Autoencoders
★ 0 4y agoExplain → -
awesome-self-supervised-learning ⑂
A curated list of awesome self-supervised methods
★ 0 4y agoExplain → -
awesome-self-supervised-gnn ⑂
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
★ 0 4y agoExplain → -
awesome-graph-self-supervised-learning ⑂
Awesome Graph Self-Supervised Learning
★ 0 4y agoExplain → -
GLM ⑂
GLM (General Language Model)
Python ★ 0 5y agoExplain → -
awesome-bert ⑂
bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目
★ 0 5y agoExplain → -
transformers ⑂
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
★ 0 5y agoExplain → -
causal-text-embeddings-1 ⑂
Software and data for "Using Text Embeddings for Causal Inference"
★ 0 6y agoExplain → -
COVID-19-TweetIDs ⑂
The repository contains an ongoing collection of tweets IDs associated with the novel coronavirus COVID-19 (SARS-CoV-2), which commenced on January 28, 2020.
★ 0 6y agoExplain → -
interesting_causal_learning_papers
Collection of recent interesting papers related to causal inference from ICLR, NIPS, ICML
★ 0 6y agoExplain → -
mips32-cpu ⑂
奋战一学期，造台计算机（编译出的bit文件在release中，可以直接食用）
★ 0 6y agoExplain → -
gandissect ⑂
Pytorch-based tools for visualizing and understanding the neurons of a GAN. https://gandissect.csail.mit.edu/
★ 0 7y agoExplain → -
LiteratureDL4Graph ⑂
No description.
★ 0 7y agoExplain → -
OAG ⑂
Source code and dataset for KDD 2019 paper "OAG: Toward Linking Large-scale Heterogeneous Entity Graphs"
Python ★ 0 7y agoExplain → -
Knowledge_Graph_Reasoning_Papers ⑂
Must-read papers on knowledge graph reasoning
★ 0 7y agoExplain → -
decaf
No description.
Java ★ 0 7y agoExplain → -
TQLdecaf
tql
★ 0 7y agoExplain →
No repos match these filters.