gitmyhub

Spider_XHS

Python ★ 7.1k updated 5d ago

小红书爬虫数据采集,小红书全域运营解决方案

A scraper and publisher for Xiaohongshu (Little Red Book) that collects posts, comments, and videos, and auto-publishes content, built as a foundation for AI-powered social media automation workflows.

JavaScriptPythonNode.jsDockersetup: moderatecomplexity 3/5

Spider_XHS is a data collection and content publishing tool for Xiaohongshu, a Chinese social media platform sometimes called Little Red Book or RedNote. Xiaohongshu does not provide a public API for most of its features, so this project works by reverse-engineering the platform's internal web requests, including the authentication signatures the platform uses to verify that requests come from its own app. The README is written in Chinese.

The tool covers three main areas. The first is data collection from the regular Xiaohongshu website: logging in, searching posts, reading post content and comments, downloading images and videos without watermarks, and fetching user profile information. The second is publishing through the creator platform: uploading image sets and videos, and managing published content. The third is data from Xiaohongshu's influencer marketplace, where brands find creators to work with, including follower demographics and historical trend data.

The project is designed to work as a foundation for AI-powered content operations workflows. The README includes code examples showing how you would connect it to an AI model: collect posts from a competitor account, pass the content to an AI for rewriting, then automatically publish the result to your own creator account. Other example workflows include keyword monitoring for trend analysis and influencer selection using AI scoring.

Setup requires Python 3.10 or higher and Node.js 20 or higher. Authentication is done by copying your browser cookies after logging in manually and placing them in a configuration file. Docker deployment is also supported. The project includes a companion repository called XHS_ALL_IN_ONE with a graphical interface for account management and publishing.

The README notes the project is intended for learning and research only, not commercial use.

Where it fits