ARLoop-0.6B
osunlp · Kit
Completes text as a small pretrained looped transformer with attention residuals. A base model for researchers who want to continue its training with their own…
New
osunlp · Kit
Completes text as a small pretrained looped transformer with attention residuals. A base model for researchers who want to continue its training with their own…
osunlp · Kit
An open 1.2B base language model from osunlp, a looped transformer with attention residuals, released with checkpoints from a 500B-token training run. For text…