ReFoCo
yuji-nozawa · Kit
Pretrained vision transformer checkpoints in three sizes from a research paper on training attention heads to focus on image regions. For researchers who extra…
New
AI research skills and agents
Prompts and agents that read the sources on a question and tell you what each one says.
Categories and filters
Listings
qwen-2.5-0.5b-block-transformer-hiba-wikitext2
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a hierarchical block attention operator, then distills it on WikiText-2. A research checkpoint for stud…
New
qwen-2.5-0.5b-bam-umoe-wikitext2
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a mixture-of-experts attention block, then distills it on WikiText-2. A research checkpoint for studyin…
New
Augmenting CNNs with attention-based aggregation
keras-io · Kit
Shows the attention map behind an image classifier's decision, using a CNN with attention-based aggregation trained on ImageNette, in a Gradio page. For machin…
New
ARLoop-1.2B
osunlp · Kit
An open 1.2B base language model from osunlp, a looped transformer with attention residuals, released with checkpoints from a 500B-token training run. For text…
New
Visual Saliency Prediction
alexanderkroner · Kit
Predicts which parts of an image draw the eye first, using the MSI-Net model from a 2020 Neural Networks paper. For researchers and designers who want a quick…
New