svd-linear-attention-roberta-base-adasplash
Hooshaai · Kit
Classifies English text, such as SST-2 sentiment, with a RoBERTa Base model whose attention is made sparse by AdaSplash, trading some accuracy for lower latenc…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Hooshaai · Kit
Classifies English text, such as SST-2 sentiment, with a RoBERTa Base model whose attention is made sparse by AdaSplash, trading some accuracy for lower latenc…
Hooshaai · Kit
Classifies English text with a RoBERTa Base model shrunk to about 82M parameters by Fisher-weighted SVD at rank 32, trading some accuracy for lower latency and…
Hooshaai · Kit
A RoBERTa Base sentiment classifier whose attention is swapped for a sparse AdaSplash version, which zeroes out 40% of attention weights to cut time and memory…
intfloat · Kit
Turns text in about 100 languages into 1024-number vectors for search, matching and retrieval. A 560M-parameter embedding model from intfloat, built on xlm-rob…