All Stories

LongLLMLingua: Prompt Compression for Long-Context LLMs

LongLLMLingua's question-aware compression, document reordering and subsequence recovery, for prompts that run to long contexts.

LLMLingua: Compressing Prompts for Accelerated LLM Inference

How LLMLingua compresses prompts using a budget controller, iterative token-level compression and distribution alignment.

LLaMA: Open and Efficient Foundation Language Models

A breakdown of Meta's LLaMA: the transformer modifications, the training corpus, and the training procedure behind the model.

The YOLO Algorithm, End to End

Every piece of this series assembled into one detector: the grid, the output tensor, the box parameterisation that makes training stable, and the full pipeline.