SivilTaram (Qian Liu)

upvoted a collection 6 days ago

ProX Dataset

Collection

a collection of pre-training corpora refined by ProX • 4 items • Updated 6 days ago • 4

upvoted a paper 6 days ago

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published 10 days ago • 58

upvoted a paper 17 days ago

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published 17 days ago • 121

upvoted a collection 18 days ago

MagpieLM

Collection

Aligning LMs with Fully Open Recipe (data+training configs+logs) • 9 items • Updated 13 days ago • 13

upvoted an article 29 days ago

Article

Meet Yi-Coder: A Small but Mighty LLM for Code

By

•

Sep 4

• 11

upvoted a paper 30 days ago

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Paper • 2409.03753 • Published about 1 month ago • 18

upvoted a collection about 1 month ago

OLMoE

Collection

Artifacts for open mixture-of-experts language models. • 13 items • Updated 11 days ago • 21

upvoted 3 papers about 1 month ago

LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models

Paper • 2409.00509 • Published Aug 31 • 38

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published Sep 3 • 77

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 85

upvoted 3 papers about 2 months ago

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published Aug 19 • 51

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Paper • 2408.06292 • Published Aug 12 • 115

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Paper • 2408.08072 • Published Aug 15 • 31

upvoted a paper 2 months ago

MiniCPM-V: A GPT-4V Level MLLM on Your Phone

Paper • 2408.01800 • Published Aug 3 • 74

upvoted an article 2 months ago

Article

StarCoder: A State-of-the-Art LLM for Code

May 4, 2023

• 24

upvoted a paper 2 months ago

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Paper • 2407.18901 • Published Jul 26 • 31

upvoted a collection 2 months ago

DeepSeekCoder-V2

Collection

6 items • Updated about 1 month ago • 81

upvoted a paper 2 months ago

OpenDevin: An Open Platform for AI Software Developers as Generalist Agents

Paper • 2407.16741 • Published Jul 23 • 67

upvoted an article 3 months ago

Article

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

By

•

Jul 27

• 22

upvoted a collection 3 months ago

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11 • 3

upvoted a paper 3 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18 • 52

upvoted an article 3 months ago

Article

Announcing BigCodeBench-Hard, and More

By

•

Jul 24

• 10

upvoted a paper 3 months ago

Qwen2 Technical Report

Paper • 2407.10671 • Published Jul 15 • 154

upvoted 2 articles 3 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11

• 10

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By

•

Jul 11

• 11

upvoted a collection 3 months ago

💡 DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28 • 7

upvoted a paper 3 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1 • 33

upvoted a collection 3 months ago

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26 • 5

upvoted a paper 3 months ago

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22 • 45

upvoted a collection 3 months ago

🌸BigCodeBench

Collection

Benchmarking Code Generation with Diverse Function Calls and Complex Instructions https://bigcode-bench.github.io/ • 7 items • Updated Jul 18 • 2

upvoted an article 3 months ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

upvoted 3 papers 4 months ago

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Paper • 2406.11896 • Published Jun 14 • 18

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Paper • 2406.11931 • Published Jun 17 • 56

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14 • 37

upvoted an article 4 months ago

Article

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 35

upvoted 3 papers 4 months ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17 • 48

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24 • 3

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted a paper 5 months ago

Make Your LLM Fully Utilize the Context

Paper • 2404.16811 • Published Apr 25 • 52

upvoted a collection 6 months ago

Deita

Collection

14 items • Updated May 20 • 9

upvoted an article 6 months ago

Article

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Apr 16

• 13

upvoted a paper 6 months ago

Compression Represents Intelligence Linearly

Paper • 2404.09937 • Published Apr 15 • 27

upvoted a collection 6 months ago

Pile-T5

Collection

T5 trained on the Pile with Llama Tokenizer • 4 items • Updated Jul 6 • 16

upvoted an article 6 months ago

Article

StarCoder2 and The Stack v2

Feb 28

• 5

upvoted a collection 6 months ago

Chinese Tiny LLM

Collection

9 items • Updated Apr 5 • 7

upvoted an article 6 months ago

Article

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

May 23, 2022

• 1

upvoted a paper 6 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 20

upvoted a collection 6 months ago

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 90

upvoted 4 papers 7 months ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 58

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 54

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

Paper • 2212.13492 • Published Dec 27, 2022 • 2

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26 • 26

upvoted a collection 7 months ago

⚓️ Sailor Language Models

Collection

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 18 items • Updated Jul 26 • 16

upvoted 2 papers 7 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 133

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 592

upvoted a collection 7 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 80

upvoted a paper 7 months ago

Multi-LoRA Composition for Image Generation

Paper • 2402.16843 • Published Feb 26 • 28

upvoted 3 papers 8 months ago

Qian Liu

AI & ML interests

Articles

RegMix: Data Mixture as Regression for Language Model Pre-training

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

Organizations

SivilTaram's activity

Meet Yi-Coder: A Small but Mighty LLM for Code

StarCoder: A State-of-the-Art LLM for Code

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

Announcing BigCodeBench-Hard, and More

RegMix: Data Mixture as Regression for Language Model Pre-training

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

StarCoder2 and The Stack v2

Efficient Table Pre-training without Real Data: An Introduction to TAPEX