svd-linear-attention-roberta-base-adasplash
Hooshaai · Kit
Classifies English text, such as SST-2 sentiment, with a RoBERTa Base model whose attention is made sparse by AdaSplash, trading some accuracy for lower latenc…
New
Hooshaai · Kit
Classifies English text, such as SST-2 sentiment, with a RoBERTa Base model whose attention is made sparse by AdaSplash, trading some accuracy for lower latenc…
Hooshaai · Kit
Classifies English text with a RoBERTa Base model shrunk to about 82M parameters by Fisher-weighted SVD at rank 32, trading some accuracy for lower latency and…
Hooshaai · Kit
A RoBERTa Base sentiment classifier whose attention is swapped for a sparse AdaSplash version, which zeroes out 40% of attention weights to cut time and memory…
intfloat · Kit
Turns text in about 100 languages into 1024-number vectors for search, matching and retrieval. A 560M-parameter embedding model from intfloat, built on xlm-rob…