Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.
AI & ML interests
Large language models, scaling laws, AI Alignment, democratization of DL
Recent Activity
Papers
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Organization Card
Welcome to EleutherAI's HuggingFace page. We are a non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence. Our open source models are hosted here on HuggingFace.
You may also be interested in our GitHub, website, or Discord server.
models 974
EleutherAI/bergson-wikitext-2-gpt2
Updated • 5
EleutherAI/gpt2-custom
Text Generation • 0.1B • Updated • 281
EleutherAI/bergson-smollm2-lds-4k
Updated
EleutherAI/bergson-smollm2-scratch-olmo-16k
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x-embedskip
Updated
EleutherAI/bergson-smollm2-lds-32k
Updated
EleutherAI/bergson-smollm2-lds-8k
Updated
EleutherAI/bergson-smollm2-lds-16k
Updated
EleutherAI/gpt-2-wikitext-chunks-epsroot-0-bs64
0.1B • Updated • 4
datasets 288
EleutherAI/djinn-problems-v1.0
Viewer • Updated • 2.54k
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008
Viewer • Updated • 96.2k • 19
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007
Viewer • Updated • 96.2k • 19
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006
Viewer • Updated • 96.2k • 20
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005
Viewer • Updated • 96.2k • 19
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004
Viewer • Updated • 89.9k • 7
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256
Viewer • Updated • 4.18k • 45
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium
Viewer • Updated • 4k • 38
EleutherAI/LDS-retrain-bank-muon-N32k-bs256
Viewer • Updated • 4k • 34
EleutherAI/LDS-retrain-bank-muon-N16k-bs16
Viewer • Updated • 4k • 69