NanmiCoder/MediaCrawler

★68,843Python🌐 ElsewhereNOASSERTION⑂ 13,102Issue 168Updated Oct 27, 2026

View on GitHub ↗Website ↗

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

Multi-Platform Chinese Social Media Scraper Avoids JS Reverse Engineering — MediaCrawler scrapes posts and comments from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba and Zhihu. Instead of reverse-engineering each site's signature algorithms, it uses Playwright browser automation to reuse login state and pull signing parameters via JS expressions, lowering the technical barrier for researchers and learners.

Metrics

Retention can be computed 30 days after a repository first trends (it isn't shown until then). See About for how each metric is defined.

Star growth and Trending appearances (last 30 days)

Created Jun 9, 2023 · First on trending Oct 23, 2026

Other notable repositories in the same category (Developer tools)

• IPedrax/BIMCraftA Rust-native Revit workflow that agents can drive via MCP
• rdlabo-dev/cf-workers-nativeA TypeScript project bridging Cloudflare Workers and Capacitor apps
• deepfounder-ai/desigmaA native Rust design tool that imports your Figma files offline
• Nutlope/hallmarkA skill that catches the telltale signs of AI-made web pages
• fabio-rovai/open-ontologiesDiff, blast-radius reports and checkable proofs for ontology changes

See all Developer tools repositories →