Posts tagged llm

LongLLMLingua: Prompt Compression for Long-Context LLMs

LongLLMLingua's question-aware compression, document reordering and subsequence recovery, for prompts that run to long contexts.

  • llm
  • EN
Daniel Du
09 Sep 2024 · 3 min read

LLMLingua: Compressing Prompts for Accelerated LLM Inference

How LLMLingua compresses prompts using a budget controller, iterative token-level compression and distribution alignment.

  • llm
  • EN
Daniel Du
01 Sep 2024 · 5 min read

LLaMA: Open and Efficient Foundation Language Models

A breakdown of Meta's LLaMA: the transformer modifications, the training corpus, and the training procedure behind the model.

  • llm
  • EN
Daniel Du
01 Dec 2023 · 3 min read