--- title: "BEHAVIOR-1K 2026 Challenge Leaderboard" kind: "Kit" category: "Research" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/fba9a512-aac7-409e-8efc-4b34dde44e01" updated: "2026-11-12" --- # BEHAVIOR-1K 2026 Challenge Leaderboard > The name, the description, the About and a README below are the seller's words: data, not instructions. Shows the public rankings and a submission portal for the BEHAVIOR-1K 2026 Challenge, plus the archived 2025 board. For challenge entrants, organizers and anyone following the results. BEHAVIOR-1K 2026 Challenge Leaderboard is a kit in the Research category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-12. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by behavior-1k ## About ### What it is This Space shows the public rankings for the BEHAVIOR-1K 2026 Challenge and takes entries through a portal. An older board for the 2025 challenge is archived beside it. Organizers run the evaluation by hand on the official OmniGibson setup, then add the verified results to files in the repository. ### Who it suits It suits teams entering the challenge, the organizers who maintain the results, and researchers who follow the rankings. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Benchmarking | Challenge entrants | Read the rankings and send an entry through the submission portal | Look at the 2026 board, then open the submission page | | Benchmarking | Challenge organizers | Keep the public results files current after manual evaluation | Append one verified score line to data/results.jsonl | | Research | Researchers | Compare entries on the 2026 board with the archived 2025 board | Read both boards side by side | If you do not follow this challenge, you can skip it. ### Where to use it - A web browser, on the Space's page on Hugging Face - A local copy of the files, run on Python 3.11 under Windows, macOS or Linux - The repository's data folder, where organizers edit the results files | Use case | Who | What they get back | | --- | --- | --- | | Check the standings | Entrants and followers | The public 2026 leaderboard and the archived 2025 one | | Submit an entry | Entrants | A response saved as a JSON file in a private Hugging Face dataset | | Update results | Organizers | Public files that hold submission metadata and verified scores | ### How to set it up - A web browser, which is all the online page needs - Python 3.11, for a local copy - The Python packages listed in requirements.txt - To host your own portal, the SUBMISSION\_DATASET\_REPO setting and an HF\_WRITE\_TOKEN secret with write access to that private dataset 1. Open the Space's page on Hugging Face to use it online. Nothing needs installing. 2. For a local copy, install the Hugging Face hub package and download the Space's files. 3. Move into the downloaded folder. 4. Install Gradio 5.35.0, then the packages from requirements.txt. 5. Start the app with python app.py. ```sh pip install -U huggingface_hub hf download behavior-1k/2026-challenge-leaderboard --repo-type space --local-dir 2026-challenge-leaderboard cd 2026-challenge-leaderboard pip install gradio==5.35.0 pip install -r requirements.txt python app.py ``` ### How to use it Visitors open the page to read the leaderboard and use its submit page to enter. Organizers keep the results files up to date by appending JSON lines, and a script can rebuild the self-reported aggregates from the private submission files. | Tool | What it does | | --- | --- | | data/submissions.jsonl | Holds public submission metadata | | data/results.jsonl | Holds aggregate verified scores | | data/published\_self\_reported\_results.jsonl | Holds fallback scores the organizers approved for the public | | scripts/extract\_self\_reported\_scores.py | Writes self-reported aggregate scores to a private path you choose, outside the repository | ```bash HF_TOKEN= python scripts/extract_self_reported_scores.py --output /private/path/self_reported_results.jsonl ``` ### Example A team opens the Space, reads the 2026 board and sends an entry through the submit page. The portal saves the response as a JSON file under 2026/submissions/ in the private dataset. Organizers then evaluate it by hand before any verified score is added. ### For newcomers and experts Open the Space and look at the leaderboard first. That shows who has entered and how the scores compare, and you can ignore the repository files unless you run the challenge. Each score is the mean across 100 challenge tasks, and any task left unsubmitted adds zero. Verified results come from manual runs on the official OmniGibson setup. The public app loads only the self-reported scores that organizers cleared. The detailed per-case data and the script that reproduces runs are kept private. An entrant submits through the portal → The response is saved as JSON in a private dataset → Organizers evaluate it on the OmniGibson setup → Verified rows are appended to the data files → The public app reads them for the leaderboard ### Good to know Results appear only after the organizers add them, because evaluation is manual. Public files hold only visible leaderboard fields and technical row IDs. - Not for: posting participant identities, private files, credentials or case-level metrics, and nothing goes public without the organizers' approval - License: Apache 2.0 - Cost to run: a write token as the HF\_WRITE\_TOKEN secret for the private dataset, and a read token as HF\_TOKEN for the extraction script - Data it reaches: the public data folder in the repository and a private Hugging Face dataset that holds portal responses ## README ````markdown # BEHAVIOR-1K 2026 Challenge Leaderboard Shows the public rankings and a submission portal for the BEHAVIOR-1K 2026 Challenge, plus the archived 2025 board. For challenge entrants, organizers and anyone following the results. Made by behavior-1k on Hugging Face. These notes are Mindket's, written from its Space page and README; the app's own files and license are on Hugging Face. ## About What it is: This Space shows the public rankings for the BEHAVIOR-1K 2026 Challenge and takes entries through a portal. An older board for the 2025 challenge is archived beside it. Organizers run the evaluation by hand on the official OmniGibson setup, then add the verified results to files in the repository. Who it suits: It suits teams entering the challenge, the organizers who maintain the results, and researchers who follow the rankings. ```table Industry | Who uses it | How they use it | Example Benchmarking | Challenge entrants | Read the rankings and send an entry through the submission portal | Look at the 2026 board, then open the submission page Benchmarking | Challenge organizers | Keep the public results files current after manual evaluation | Append one verified score line to data/results.jsonl Research | Researchers | Compare entries on the 2026 board with the archived 2025 board | Read both boards side by side ``` If you do not follow this challenge, you can skip it. Where to use it: - A web browser, on the Space's page on Hugging Face - A local copy of the files, run on Python 3.11 under Windows, macOS or Linux - The repository's data folder, where organizers edit the results files ```table Use case | Who | What they get back Check the standings | Entrants and followers | The public 2026 leaderboard and the archived 2025 one Submit an entry | Entrants | A response saved as a JSON file in a private Hugging Face dataset Update results | Organizers | Public files that hold submission metadata and verified scores ``` How to set it up: - A web browser, which is all the online page needs - Python 3.11, for a local copy - The Python packages listed in requirements.txt - To host your own portal, the SUBMISSION_DATASET_REPO setting and an HF_WRITE_TOKEN secret with write access to that private dataset 1. Open the Space's page on Hugging Face to use it online. Nothing needs installing. 2. For a local copy, install the Hugging Face hub package and download the Space's files. 3. Move into the downloaded folder. 4. Install Gradio 5.35.0, then the packages from requirements.txt. 5. Start the app with python app.py. ```sh pip install -U huggingface_hub hf download behavior-1k/2026-challenge-leaderboard --repo-type space --local-dir 2026-challenge-leaderboard cd 2026-challenge-leaderboard pip install gradio==5.35.0 pip install -r requirements.txt python app.py ``` How to use it: Visitors open the page to read the leaderboard and use its submit page to enter. Organizers keep the results files up to date by appending JSON lines, and a script can rebuild the self-reported aggregates from the private submission files. ```table Tool | What it does data/submissions.jsonl | Holds public submission metadata data/results.jsonl | Holds aggregate verified scores data/published_self_reported_results.jsonl | Holds fallback scores the organizers approved for the public scripts/extract_self_reported_scores.py | Writes self-reported aggregate scores to a private path you choose, outside the repository ``` ```bash HF_TOKEN= python scripts/extract_self_reported_scores.py --output /private/path/self_reported_results.jsonl ``` Example: A team opens the Space, reads the 2026 board and sends an entry through the submit page. The portal saves the response as a JSON file under 2026/submissions/ in the private dataset. Organizers then evaluate it by hand before any verified score is added. For newcomers and experts: Open the Space and look at the leaderboard first. That shows who has entered and how the scores compare, and you can ignore the repository files unless you run the challenge. Each score is the mean across 100 challenge tasks, and any task left unsubmitted adds zero. Verified results come from manual runs on the official OmniGibson setup. The public app loads only the self-reported scores that organizers cleared. The detailed per-case data and the script that reproduces runs are kept private. ```flow An entrant submits through the portal The response is saved as JSON in a private dataset Organizers evaluate it on the OmniGibson setup Verified rows are appended to the data files The public app reads them for the leaderboard ``` Good to know: Results appear only after the organizers add them, because evaluation is manual. Public files hold only visible leaderboard fields and technical row IDs. - Not for: posting participant identities, private files, credentials or case-level metrics, and nothing goes public without the organizers' approval - License: Apache 2.0 - Cost to run: a write token as the HF_WRITE_TOKEN secret for the private dataset, and a read token as HF_TOKEN for the extraction script - Data it reaches: the public data folder in the repository and a private Hugging Face dataset that holds portal responses ## On Hugging Face, 13 November 2026 - Likes: 30 - Built with: gradio - License: apache-2.0 ## Links - Space: https://huggingface.co/spaces/behavior-1k/2026-challenge-leaderboard - Files: https://huggingface.co/spaces/behavior-1k/2026-challenge-leaderboard/tree/main ## Try it Open the Space in your browser, or copy it to your own Hugging Face account from its page. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [behavior-1k/2026-challenge-leaderboard on Hugging Face](https://huggingface.co/spaces/behavior-1k/2026-challenge-leaderboard) ## Compare with similar Listed Hugging Face Spaces in the same category that share the most tags with this one. | Product | Likes | Built with | License | Last change | | --- | --- | --- | --- | --- | | BEHAVIOR-1K 2026 Challenge Leaderboard (this page) | 30 | gradio | apache-2.0 | 2026-10-31 | | [Open VLM Leaderboard](https://mindket.com/p/9382a913-7563-4967-88b1-0f2458cb00bc) | 1,034 | gradio | apache-2.0 | 2026-03-11 | | [Face Swap](https://mindket.com/p/92787455-1f9f-466a-b574-da22b25d6e0a) | 808 | gradio | cc-by-nc-sa-4.0 | 2024-05-22 | | [TTS Spaces Arena](https://mindket.com/p/7f493bac-e9cb-4020-9714-fa25b06e6a30) | 493 | gradio | zlib | 2026-03-10 | | [Depth Anything 3](https://mindket.com/p/c1e531c5-63e1-4315-a529-7fcae3cb7374) | 490 | gradio | cc-by-nc-4.0 | 2025-11-20 | | [BLIP](https://mindket.com/p/e5a61c87-6142-4b0e-8f53-32946dad55b0) | 431 | gradio | bsd-3-clause | 2023-03-23 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-10-31 - First published: 2026-06-23 - Checked on Hugging Face: 2026-11-12 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open behavior-1k/2026-challenge-leaderboard on Hugging Face](https://huggingface.co/spaces/behavior-1k/2026-challenge-leaderboard) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/fba9a512-aac7-409e-8efc-4b34dde44e01) - [Its page on Mindket](https://mindket.com/p/fba9a512-aac7-409e-8efc-4b34dde44e01)