Apify ORG

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

A Node.js library that automates web scraping, visiting websites, extracting data, rotating proxies, and managing large URL queues so you don't get blocked.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

Collection of Apify Agent Skills

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chaining.

HTTP client made for scraping based on got.

A universal CLI client for MCP. mcpc supports persistent sessions, stdio/HTTP, OAuth 2.1, tasks, JSON output for code mode, proxy for AI sandboxes, x402, and more.

impit | rust library for browser impersonation

Experimental Camoufox JS port

Apify command-line interface helps you create, develop, build and run Apify Actors, and manage the Apify cloud platform.

Community collection of Apify agent skills for AI coding assistants

A MCP Server for the RAG Web Browser Actor

Apify SDK monorepo

Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

Apify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.

Base Docker images for Apify actors.

Generates realistic browser fingerprints

This whitepaper describes a new concept for building serverless microapps called Actors, which are easy to develop, share, integrate, and build upon. Actors are a reincarnation of the UNIX philosophy for programs running in the cloud.

Apify API client for JavaScript / Node.js.

Index of all Model Context Protocol (MCP) clients and their capabilities

Model Context Protocol (MCP) Client for Apify's Actors

Home of fingerprint injector.

RAG Web Browser is an Apify Actor to feed your LLM applications and RAG pipelines with up-to-date text content scraped from the web.

NodeJs package for generating browser-like headers.

This project is the home of Apify's documentation.

This project is the :house: home of Apify Actor templates to help users quickly get started. Contributions welcome!

Open APIs with statistics about Covid-19

Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

n8n node to interact with Apify APIs

This is the experimental version of Web Automation Agent. The agent uses natural language instructions to browse the web and extract data.

JavaScript / Node.js library to stream data into an XLSX file

The /llms.txt Generator Actor 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Crawlee dev repo

OpenClaw extension integration

An action to release a CommonJS version of the popular library got, which is soon to be available only in an ESM format.

You can use this act to monitor any page's content and get a notification when content changes.

Runs a simple server that allows you to connect to Chrome DevTools running on dynamic hosts, not only localhost.

I Don't Care About Cookies extension compiled for use with Playwright/Puppeteer

A curated collection of awesome MCP servers, published and monetized as Actors on Apify

Utilities and constants shared across Apify projects.

Contains a boilerplate of an Apify actor to help you get started quickly build your own actors.

A GitHub Action to push an Actor the the Apify platform

Apify integration for Zapier

🤖 AI agent using mastra.ai with Apify MCP Server. 🚀 Runs queries via OpenAI models, taps Apify Actors for web data, and outputs to datasets. 🛠️

Apify's reusable github workflows

A Homebrew tap for Apify tools

Apify actor to run web spiders written in Python in the Scrapy library

Better SQLite prebuild & publish action

A simple app that lets you chat with a given website.

Transfer data from Apify Actors to vector databases (Chroma, Milvus, Pinecone, PostgreSQL (PG-Vector), Qdrant, and Weaviate)

The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.

This repository is opened to run our first AI Agents Hackathon( A part of Actor Bounty Program)

This is a template repo for the n8n single Actor apps.

Apify actor to upload crawler results to AWS S3.

The Finance Monitoring AI Agent 📊💹 analyzes specific tickers, gathering and processing data to generate insightful reports 📈📉. Designed for investors and analysts, this agent provides detailed performance analysis and trends. 🚀

Example Apify Actor written in Python

An example repository showcasing how you can scrape in parallel using one request queue

Apify integration for LangChain 🦜🔗

Documentation site for the Actor Programming Model – a fresh take on serverless microapps. Built with Astro.

🚀 Boilerplate and Starter for Next.js 12+, Tailwind CSS 3 and TypeScript ⚡️ Made with developer experience first: Next.js + TypeScript + ESLint + Prettier + Husky + Lint-Staged + Jest + Testing Library + Commitlint + VSCode + Netlify + PostCSS + Tailwind CSS

Actor Inspector Agent is an Apify Actor designed to evaluate and rate other Apify Actors based on criteria such as documentation quality, input clarity, code standards, functionality, performance, and uniqueness.

Apify actor to crawl a list of URLs

Package generating randomized browser-like headers.

Open-source Actor that provides a sandbox for secure execution of AI generated code. Supports Node.js, Python. Provides pre-configured Claude Code, Codex CLI, and OpenCode. 📦

No description.

An example repository with multiple Apify Actors sharing code between each other.

Standby actor which provides MCP server which lets a user to perform a deep web search on their behalf thus saving them time

Apify input schema editor written in React.js

No description.

Patched fork of `ruslts` for `impit`

No description.

Local emulation of the apify-client NPM package, which enables local use of Apify SDK.

Apify ESLint preset to be shared between projects

No description.

Apify actor that crawls website and indexes selected web pages to Algolia index. It's used to power the search on https://help.apify.com

Actor Playwright MCP server

⚡ Building applications with LLMs through composability ⚡

Example actor showcasing the secret input fields

Example: Intercept requests from https connection using "Man in the middle" proxy solution.

How to get clean web data for chatbots and LLMs slides and supporting materials.

A library of data loaders for LLMs made by the community -- to be used with GPT Index and/or LangChain

Returns an image containing difference of two given images.

A Rust implementation of the filesystem storage used by the Crawlee web scraping framework

Teach your agents to scrape real-time data with this self-guided workshop.

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

The official integration for Apify and Haystack 2.0

No description.

A library of utility functions that make scraping, data extraction and usage of headless browsers easier and faster.

It wraps up messages sending from Apify GitHub workflows into Slack.

Apify Actor to convert HTML string to pdf

LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data.

Apify nodes for n8n.

Constants and utilities shared across Apify's Python libraries and projects.

Get your documents ready for gen AI

🔎 Hunt down social media accounts by username across social networks

No description.

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

singe Actor node of Website Content Crawler Actor on n8n

Connect APIs, remarkably fast. Free for developers.

Scrape list of Zapier integrations from Zapier website

🌐 Human-friendly and powerful HTTP request library for Node.js

Drag & drop UI to build your customized LLM flow using LangchainJS

DEPRECATED: An actor that crawls websites and parses HTML pages using Cheerio library. Supports recursive crawling as well as URL lists.

Source code for the Playwright Test public actor.

Contains specification of the Web Automation Workflow (WAW) file.

Enables AI assistants to search for and access arXiv papers through a simple MCP interface.

Examples for our Actorization and monetization workshop

[DEPRECATED: moved to apify-docs repository] An OpenAPI specification for the Apify API.

TypeScript configuration shared across projects in Apify.

Special, yet insignificant actors

The Github action that makes sure that each PR is correctly set up and has a milestone set.

No description.

All Dify Plugins listed in Dify Marketplace, plus illustrated plugin examples.

No description.

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Repository for Apify actor benchmarks

Custom Algolia search modal for Apify Documentation.

Apify Email Signature Generator

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

Example repository for various Actor schemas

A HTTP request library for Node.js, with a common-sense API, support for Brotli compression and without bugs in "request" NPM package

Example integration of HTTP Message Signatures into Crawlee's HttpCrawler.

Automated MCP server testing tool. Connects to Model Context Protocol servers, tests available tools using AI, and generates detailed reports with pass/fail status. Supports custom authentication headers.

Apify extractor for Keboola Connection

Development dependencies used in all Apify projects.

No description.

DEPRECATED: An Apify actor that enables crawling of websites using headless Chrome and Puppeteer. The actor is highly customizable and supports recursive crawling of websites as well as lists of URLs.

:blue_book: Tweaked version of docsearch for apify-docs

Common preset for the v2 documentation Docusaurus instances.

Actor that runs Selenium based Mocha tests.

The fastest and simplest library for SQLite3 in Node.js.

A fork of the official repository of Mozilla Firefox, which is used for Apify's custom Firefox build.

An example Actor using Standby mode

No description.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Scrape list of available integrations from Make

Small actor which allows Make.com users to trigger their scenarios when run finishes

No description.

Backlink Building Agent 🔗 automates outreach by finding websites, grabbing contacts, and crafting personalized messages. Works on email, LinkedIn, Twitter & Facebook 📩🤖. Powered by Apify & OpenAI for smart, efficient backlink building! 🚀

Everything you need to extend Raycast.

No description.

A standalone POC script for wrapping Scrapy projects with Apify middleware.

⬛️ CLI tool for saving complete web pages as a single HTML file

Typescript ESLint configuration shared across projects in Apify.

Use natural language to query and retrieve results from an Apify dataset

Apify's fork of `docusaurus-plugin-typedoc-api`, customized for our Python documentation.

No description.

HTTP specific Tower utilities.

No description.

This action simplify creating of release PR

No description.

Tools & lib to test actors on the Apify platform

A model-driven approach to building AI agents in just a few lines of code.

Patched fork of h2 for impit

Apify's custom GitHub Actions for internal use

No description.

This Actor is running in a schedule every day and monitors the log for new slow queries

Kilo is the all-in-one agentic engineering platform. Build, ship, and iterate faster with the most popular open source coding agent.

Documentation for the Strands Agents SDK. A model-driven approach to building AI agents in just a few lines of code.

No description.

A simple actor used to test the Apify MCP server

Template for Claude managed agents Actors

No description.

The agent that grows with you

This Actor maps your Apify dataset items into HubSpot company fields and performs imports

Apify oxlint preset to be shared between projects

Common utilities used with hyper.

Local service that mocks recombee, completely vibe coded 🤖

Official Apify powers for Kiro IDE — web scraping, data extraction, and Actor development

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Repository to define an organization (or team) wide Github Actions workflows

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

A set of tools that gives agents powerful capabilities.

This is an automation Actor which uploads your dataset items into Airtable with respect to data field mappings and unique ids

No description.

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

No description.

No description.

No description.

No description.

Apify copilot agent

Github copilot agent for easy Apify integration into your repo.

No description.

This is Keboola extractor for Google Maps Reviews Scraper

Memorize new colleagues' names and roles through a flashcard game embedded in BambooHR.

No description.

🚀 A list of Haystack Integrations, maintained by the community or deepset.

An Implementation of Algolia to emulate its REST API

The C++ bson parser for the node.js mongodb driver.

Apify Actor Curl demo [WIP]

Apify Echo Actor (pushes input to the dataset)

Actor for importing data to Firestore database

No description.

This tool integrates with AWS to monitor service usage costs and posts a summary of these costs to a Slack channel. The summary includes costs for various AWS services along with a chart that provides a visual breakdown of the costs over time.

A temporary repository with reproduction of a bug with uploads to AWS S3

This Apify actor is used for integration tests.