The Kaitchup's Table of Contents

The Kaitchup has now more than 100 articles. Most of them are still up-to-date but older articles are getting difficult to find.

I created a table of contents to organize them by topic. Have a look below, you might find interesting articles that you have missed.

This table of contents is also on this page that will be regularly updated:

Fine-tuning

LoRA

• QLoRa: Fine-Tune a Large Language Model on Your GPU*

• Fine-tune a Chat Model on Your Data with QLoRa*

• QA-LoRA: Quantization-Aware Fine-tuning for Large Language Models

• Fine-tune Quantized Llama 2 on Your GPU with QA-LoRA*

• LQ-LoRA: Jointly Fine-tune and Quantize Large Language Models*

• Combine Multiple LoRA Adapters for Llama 2

• LoRA Adapters: When a Naive Merge Leads to Poor Performance*

• Don't Merge Your LoRA Adapter Into a 4-bit LLM*

Direct Preference Optimization (DPO)

• Fine-tune Your Own Instruct Version of Mistral 7B with Direct Preference Optimization (DPO)*

• Zephyr 7B Beta: A Good Teacher Is All You Need

• A Cheap Zephyr 7B Beta: Distilled DPO on Consumer Hardware*

Reinforcement Learning with Human Feedback (RLHF)

• Train Instruct LLMs On Your GPU with DeepSpeed Chat — Step #1: Supervised Fine-tuning

• Train Instruct LLMs On Your GPU with DeepSpeed Chat — Step #2: Training a Reward Model*

• Train Instruct LLMs On Your GPU with DeepSpeed Chat — Step #3: Reinforcement Learning with Human Feedback*

Optimization

• Use FlashAttention-2 for Faster Fine-tuning and Inference*

Quantization

GPTQ

• Quantization of Llama 2 with GTPQ for Fast Inference on Your Computer*

• GPTQ or bitsandbytes: Which Quantization Method to Use for LLMs — Examples with Llama 2*

• Quantize and Fine-tune LLMs with GPTQ Using Transformers and TRL*

AWQ

• Fast and Small Llama 2 with Activation-Aware Quantization (AWQ)*

• Simple, Fast, and Memory-Efficient Inference for Mistral 7B with Activation-Aware Quantization (AWQ)

bitsandbytes NF4

• Run Llama 2 Chat Models on Your Computer

ExLlama

• Run Llama 2 70B on Your GPU with ExLlamaV2*

Efficient Loading and Inference

• Device Map: Avoid Out-of-Memory Errors When Running Large Language Models

• Run Very Large Language Models on Your Computer

• Safe, Fast, and Memory Efficient Loading of LLMs with Safetensors*

• High-Speed Inference with llama.cpp and Vicuna on CPU*

• vLLM: PagedAttention for 24x Faster LLM Inference

• Serve Large Language Models from Your Computer with Text Generation Inference

• Deploy Your Local GPT Server With Triton

Pre-training

• ReLoRa: Pre-train a Large Language Model on Your GPU*

LLM Focus

Llama 2

• Fine-tune Llama 2 on Your Computer with QLoRa and TRL*

• Llama 2 on a Budget

• Platypus: Dataset Curation and Adapters for Better Large Language Models

• What You Cannot Do With Llama 2

Falcon

• Fine-tune Falcon-7B on Your GPU with TRL and QLoRa

• Simple and Quick Fine-Tuning of Falcon Models with QLoRA

• Introduction to the Open LLM Falcon-40B: Performance, Training Data, and Architecture*

• Falcon 180B: Can It Run on Your Computer?

• Can You Use the Falcon Models For Commercial Applications?

Mistral 7B

• Mistral 7B: Recipes for Fine-tuning and Quantization on Your Computer

Microsoft phi-1.5

• How to Fine-tune, Quantize, and Run Microsoft phi-1.5

Machine Translation

Fine-tuning

• Llama 2 MT: Turn Llama 2 into a Translation System with QLoRA

GPT

• GPT-3.5 Translates Paragraphs Better

• Translate with ChatGPT

• Translate with GPT-3

Evaluation

• BLEU: A Misunderstood Metric from Another Age

• 12 Critical Flaws of BLEU

• Traditional Versus Neural Metrics for Machine Translation Evaluation

• Scientific Credibility in Machine Translation Research: Pitfalls and Promising Trends

• How Good Is Google PaLM at Translation?

Data Processing

• Datasets to Train, Validate, and Evaluate Machine Translation

• Data Preprocessing for Machine Translation

*: Articles with sections only accessible to paid subscribers