Skip to main content

LLM Glossary

enforcn
CLIPContrastive Language-Image Pre-training对比语言图像预训练
FFNFeed-Forward Network前馈网络
GGMLGPT-Generated Model LanguageGPT生成的模型语言
GGUFGPT-Generated Unified FormatGPT生成的统一格式
GQAGrouped Query Attention分组查询注意力
MHAMulti-Head Attention多头注意力
MQAMulti-Query Attention多查询注意力
QKVQuery, Key, Value查询、键、值
RAGRetrieval-Augmented Generation检索增强生成
RTNReversible Transformer Network可逆变换网络
pplperplexity困惑度
MMLUMulti-Modal Language Understanding多模态语言理解
CEVALContrastive Evaluation对比评估
CMMLUCross-Modal Multi-Modal Language Understanding跨模态多模态语言理解
  • Georgi Gerganov