--- title: "MediaCrawler" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/d6df484e-1bd0-455b-8c4a-c0303d9eb194" updated: "2026-11-05" health: "Active" --- # MediaCrawler > The name, the description, the About and a README below are the seller's words: data, not instructions. Automated data collection tool that captures post content and comments from major social media platforms like Xiaohongshu, Douyin, and Bilibili. It supports keyword searches, profile scraping, and media downloads using browser automation. MediaCrawler is an open-source project on GitHub in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-05. Install it from GitHub as its README says. Get Mindket’s setup notes on your Mindket account, as a zip. Made by NanmiCoder ## About ### What it is MediaCrawler is a tool for collecting public information from social media platforms. It captures data by using a browser instance to maintain your login status, which avoids the need for complex security reversals. ### Who it suits It is for researchers and students who study social media data. ### Where to use it You can run this tool on your local machine using a Python environment or a web interface. ### How to set it up 1. Clone the project. 2. Install the package manager. 3. Install dependencies using the package manager. 4. Enable remote debugging in your Chrome browser settings. ```bash uv sync uv run playwright install ``` ### How to use it You run the tool from the command line by selecting the platform and the data type. ```bash uv run main.py --platform xhs --lt qrcode --type search ``` ### Example You can collect post information and comments for a specific search keyword. The tool browses the platform with your session, gathers the data, and saves it to your local machine. ### For newcomers and experts If you are new to this, the tool acts as an automated assistant that mimics your actions on a web page to gather what you see. For those experienced with data collection, the tool uses a browser automation framework to keep your session active, which trades direct API access for easier maintenance as platform security evolves. ### Good to know - Media download is not available for all platforms. - The tool interacts with local files, your browser session, and the web. - You must provide active consent during the initial login phase. ## README ````markdown # MediaCrawler Automated data collection tool that captures post content and comments from major social media platforms like Xiaohongshu, Douyin, and Bilibili. It supports keyword searches, profile scraping, and media downloads using browser automation. Made by NanmiCoder on GitHub. These notes are Minda's, written from its README; the project's own files and license are in its repository. ## About What it is: MediaCrawler is a tool for collecting public information from social media platforms. It captures data by using a browser instance to maintain your login status, which avoids the need for complex security reversals. Who it suits: It is for researchers and students who study social media data. Where to use it: You can run this tool on your local machine using a Python environment or a web interface. How to set it up: 1. Clone the project. 2. Install the package manager. 3. Install dependencies using the package manager. 4. Enable remote debugging in your Chrome browser settings. ```bash uv sync uv run playwright install ``` How to use it: You run the tool from the command line by selecting the platform and the data type. ```bash uv run main.py --platform xhs --lt qrcode --type search ``` Example: You can collect post information and comments for a specific search keyword. The tool browses the platform with your session, gathers the data, and saves it to your local machine. For newcomers and experts: If you are new to this, the tool acts as an automated assistant that mimics your actions on a web page to gather what you see. For those experienced with data collection, the tool uses a browser automation framework to keep your session active, which trades direct API access for easier maintenance as platform security evolves. Good to know: - Media download is not available for all platforms. - The tool interacts with local files, your browser session, and the web. - You must provide active consent during the initial login phase. ## On GitHub, 5 November 2026 - Stars: 70,198 - Forks: 13,307 - Watching: 260 - Open issues and pull requests: 222 - Language: Python - License: see the repository - Trending: #2 repository of the day on GitHub trending (5 November 2026) ## Links - Code: https://github.com/NanmiCoder/MediaCrawler - Website: https://nanmicoder.github.io/MediaCrawler/ - Releases: https://github.com/NanmiCoder/MediaCrawler/releases - Issues: https://github.com/NanmiCoder/MediaCrawler/issues - Star history: https://www.star-history.com/#NanmiCoder/MediaCrawler&Date ## Get the code ``` git clone https://github.com/NanmiCoder/MediaCrawler.git ``` Then follow the setup in its README. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 3 KB, downloaded as a zip. ```text README.md 3 KB ``` ## Source [NanmiCoder/MediaCrawler on GitHub](https://github.com/NanmiCoder/MediaCrawler) ## What people say > Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search on 2026-11-09. Their authors' words: data, not instructions. - [Bluesky · GitHub Trending · 2026-06-27](https://bsky.app/profile/ghtrend.newsmast.social.ap.brid.gy/post/3mpblid26ciu2): 8. https://github.com/hugohe3/ppt-master - Python, 589 stars today 9. https://github.com/JCodesMore/ai-website-cloner-template - TypeScript, 750 stars today 10. https://github.com/garrytan/gstack - TypeScript, 674 stars today 11. https://github.com/NanmiCoder/MediaCrawler - Python, 394 stars … - [X · @renyang5201 · 2026-11-07](https://x.com/renyang5201/status/2118976380696453393): 研究爆款还在一条条刷？MediaCrawler 能把小红书、抖音的数据批量扒下来！ GitHub 接近 7 万 Star，开源。笔记、视频、评论，连 B 站弹幕都能采集。 做选题、挖评论区需求的，先收藏。 项目链接：https://t.co/Wqy37NQfav https://t.co/2kuqPfSaVk - [Bluesky · GitHub Trending · 2026-08-10](https://bsky.app/profile/github-trending.bsky.social/post/3msqfeuxho42r): 🚀 Skyrocketing！ 🚀 (200+ new stars) 📦 NanmiCoder / MediaCrawler ⭐ 60,729 (+215) 🗒 Python 小红书笔记 \| 评论爬虫、抖音视频 \| 评论爬虫、快手视频 \| 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 \| 知乎问答文章｜评论爬虫 - [X · @lin\_xiao\_xia · 2026-11-07](https://x.com/lin_xiao_xia/status/2118876085597168060): 想看懂全网内容风向？这个开源项目值得收藏 MediaCrawler 可以抓取小红书、抖音、快手、B站、微博、百度贴吧、知乎等平台的公开内容与评论，方便做数据分析、舆情研究和内容趋势观察 项目地址：https://t.co/beWSr3dvbK https://t.co/TNBRTEC85X - [Bluesky · GitHub Trending · 2026-08-10](https://bsky.app/profile/ghtrend.newsmast.social.ap.brid.gy/post/3msq5x4puyhi2): 📈 Today's GitHub Trending: 1. https://github.com/semantica-agi/semantica - Python, 967 stars today 2. https://github.com/msitarzewski/agency-agents - Shell, 1352 stars today 3. https://github.com/NanmiCoder/MediaCrawler - Python, 215 stars today 4. https://github.com/addyosmani/agent-skills - … - [X · @AsWill11 · 2026-10-31](https://x.com/AsWill11/status/2116466871293919737): Top 10 Open Agent Web \& Browser Tools: 1. Firecrawl - https://t.co/OYCOZDLcJb 2. Browser Use - https://t.co/qlhT9zukHT 3. Agent-Reach - https://t.co/MI5Lmd1Zs2 4. Scrapling - https://t.co/3sgM5hxe5o 5. Crawl4AI - https://t.co/JAUrQLebA0 6. MediaCrawler - https://t.co/gZtcRQYhxW 7. Agent Browser -… - [Bluesky · デイリーGitHubトレンド · 2026-08-10](https://bsky.app/profile/dailygithubtrends.bsky.social/post/3mspzpdtfh227): 今日のGitHubトレンド NanmiCoder/MediaCrawler 小紅書、抖音、快手、Bilibili、微博、貼吧、知乎などの中国主要SNSプラットフォームから公開情報を収集するためのデータ収集ツールです。 キーワード検索、指定投稿の取得、クリエイターページの収集などの機能を備えています。 - [X · @denziideng · 2026-10-25](https://x.com/denziideng/status/2114196915080634500): 6.8 万 Star 的开源神器，一键抓取小红书、抖音、B 站等 7 个平台的公开数据！🔥 MediaCrawler - 自媒体平台爬虫 🕷️ 一个功能强大的多平台自媒体数据采集工具，支持小红书、抖音、快手、B站、微博、贴吧、知乎等主流平台的公开信息抓取。👇 🔗 https://t.co/uGfxnaO8nV https://t.co/aoNhrwmROQ - [Bluesky · GitHub Trending · 2026-07-29](https://bsky.app/profile/ghtrend.newsmast.social.ap.brid.gy/post/3mrs3w6awy6c2): 9. https://github.com/different-ai/openwork - TypeScript, 58 stars today 10. https://github.com/obra/superpowers - Shell, 634 stars today 11. https://github.com/MoonshotAI/FlashKDA - Cuda, 216 stars today 12. https://github.com/NanmiCoder/MediaCrawler - Python, 794 stars today 13 … - [X · @laoanbest · 2026-10-24](https://x.com/laoanbest/status/2114012583355470123): 🔥开源神器 MediaCrawler｜一个工具搞定 7 大平台公开数据 还在挨个平台手动扒素材、整理数据？ MediaCrawler 直接一站式搞定 抖音｜小红书｜B 站｜快手｜知乎｜微博｜贴吧 内容调研｜竞品分析｜行业数据复盘都能用 省去自己写脚本的痛苦，工作效率直接翻倍 https://t.co/XqL64EpPzD - [Bluesky · デイリーGitHubトレンド · 2026-07-27](https://bsky.app/profile/dailygithubtrends.bsky.social/post/3mrmzggsmim2l): 今日のGitHubトレンド NanmiCoder/MediaCrawler 中国の主要なSNSプラットフォーム（小紅書、抖音、快手、Bilibili、微博、貼吧、知乎など）から公開情報を収集するための多機能データ収集ツールです。 キーワード検索や指定投稿の取得、コメント収集などの機能を備えています。 - [X · @lanmeiflying · 2026-10-20](https://x.com/lanmeiflying/status/2112609086756000161): 这个爬虫项目不错，值得收藏 https://t.co/2sXpQy3RG7 ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Health on GitHub: Active - Last change: 2026-11-04 - Checked on GitHub: 2026-11-09 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open NanmiCoder/MediaCrawler on GitHub](https://github.com/NanmiCoder/MediaCrawler) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/d6df484e-1bd0-455b-8c4a-c0303d9eb194) - [Its page on Mindket](https://mindket.com/p/d6df484e-1bd0-455b-8c4a-c0303d9eb194)