Adapting Large Language Models via Reading Comprehension
Paper
•
2309.09530
•
Published
•
78
Synthetic Data
Data enrichment methods for pre-training and fine-tuning
-
-
RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback
Paper • 2309.00267 • Published • 50 -
Self-Alignment with Instruction Backtranslation
Paper • 2308.06259 • Published • 42 -
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor
Paper • 2212.09689 • Published • 1 -
Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models
Paper • 2310.13127 • Published • 12 -
Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models
Paper • 2310.13671 • Published • 19