Mmlu | search
Click here to view Mmlu news from 60+ newspapers.
Bookmark or Share- GitHub - deepseek-ai/DeepSeek-V2: DeepSeek-V2: A Strong, Economical ...For attention, we design MLA (Multi-head Latent Attention), which utilizes low-rank key-value union compression to eliminate the bottleneck of inference-time key-value cache, thus supporting efficient inference.
- MMLU_Chinese/README.md at master - GitHubThis is the repository for Measuring Massive Multitask Language Understanding by Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt (ICLR 2021). This repository contains OpenAI API evaluation code, and the test is available for download here.
- GitHub - jxiw/MambaInLlama: Official Repository of The Mamba in the ...MambaInLlama. This repository contains the code and released models for our paper. Our goal is to distill a large Transformer into a (Hybrid)-Mamba model while preserving the generational quality with the best effort.
- GitHub - THUDM/GLM-4: GLM-4 series: Open Multilingual Multimodal Chat ...GLM-4-9B 是智谱 AI 推出的最新一代预训练模型 GLM-4 系列中的开源版本。. 在语义、数学、推理、代码和知识等多方面的数据集测评中， GLM-4-9B 及其人类偏好对齐的版本 GLM-4-9B-Chat 均表现出超越 Llama-3-8B 的卓越性能。. 除了能进行多轮对话，GLM-4-9B-Chat ...
- llama-models/models/llama3_1/eval_details.md at main - GitHubMultilingual MGSM. For post-trained models, we use an 0-shot config with CoT prompt and report exact match (maj@1) scores. Maximum generation length is 2048 tokens. The scores are averaged over all the eleven languages present in the MGSM benchmark, including the ones not supported by Llama models.
More
