Adrián Chaves Claim this profile

Scrapy, a fast high-level web crawling & scraping framework for Python.

A map full of lovely Python communities ❤️🐍🌎

A scalable frontier for web crawlers

Extract embedded metadata from HTML markup

Simple wrapper of tabula-java: extract table from PDF into pandas DataFrame

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Async http client/server framework (asyncio)

TwitchIO - An Async Bot/API wrapper for Twitch made in Python.

Modding tutorials and documentation for Cyberpunk 2077

Godot Engine – Multi-platform 2D and 3D game engine

No description.

No description.

HTTP API for Scrapy spiders

Visual Studio Code

A Flake8 plugin to catch common issues on Scrapy spiders

An extremely fast Python linter and code formatter, written in Rust.

Paramiko-based minimal SFTP client and server examples

No description.

https://docs.zyte.com/web-scraping/tutorial/index.html

No description.

Example solutions for the practice and contest websites of the code contest of Web Data Extraction Summit.

AI-powered Python 3.8+ library to build HTTP requests out of HTML forms.

scikit-learn inspired API for CRFsuite

Formasaurus tells you the type of an HTML form and its fields using machine learning

PyConEs 2024 Vigo

🍴 OpenNutriTracker is a free and open source calorie tracker with a focus on simplicity and privacy.

Export to OneDrive

Free and open public transport routing.

Software stack with latest Scrapy and updated deps

More flexible and featured Frontera scheduler for Scrapy

Library for annotation-based dependency injection

No description.

Swagger API Documentation builder for aiohttp server

Spider templates for automatic crawlers.

No description.

No description.

XLSX exporter for Scrapy

python library to simplify working with jsonlines and ndjson data

Style and Grammar Checker for 25+ Languages

A hatch msgfmt plugin, integrating msgfmt.py to convert .po files to .mo during build.

reuse is a tool for compliance with the REUSE recommendations.

QML based X11 and Wayland display manager

Scrapy+Splash for JavaScript integration

Web based localization tool with tight version control integration.

Zyte Data API integration for Scrapy

https://mimesniff.spec.whatwg.org/ implementation for Python

Page Object pattern for Scrapy

Web scraping Page Objects core library

Python client for Zyte Data API

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing

Contains the common item definitions used in Zyte.

A conda-smithy repository for scrapy.

A client interface for Scrapinghub's API

Simple library to convert a Python dictionary or other native data type into a valid XML string.

convert curl commands to python, javascript, php, R, Go, Rust, Dart, JSON, Ansible

The scrapy.org website

// foss.events: The most comprehensive collection of FOSS events in Europe

A complimentary proxy to help to use Crawlera with headless browsers

Crawlera HTTPS clients collection

GSoC proposal for scrapy

Pluggable DSL that uses pipes to perform a series of linear transformations to extract data

Python clients for Scrapinghub AutoExtract API

Example site for web scraping tutorials

Scrapy entrypoint for Scrapinghub job runner

use multiple proxies with Scrapy

Detect and classify pagination links

Scrapy schema validation pipeline and Item builder using JSON Schema

A pure-python HTML screen-scraping library

This is a sample Scrapy project for educational purposes

Fill HTML login forms automatically

A browser extension to monitor your spiders deployed on Scrapy Cloud.

Hack day project. Figure out if the main thread is hanging, and if so, what's causing it to hang.

A CLI for benchmarking Scrapy.

Common interface for data container classes

A conda-smithy repository for itemloaders.

Library to populate items using XPath and CSS with a convenient API

Lightweight, scriptable browser as a service with an HTTP API

Command-line interface to install and execute Steam games

The Python Cryptography Toolkit

A Python wrapper around the OpenSSL library

A place to submit conda recipes before they become fully fledged conda-forge feedstocks

Website and ideas page for Python's Google Summer of Code efforts

A pure-Python robots.txt parser with support for modern conventions.

No description.

Collection of persistent (disk-based) queues

A decorator to write coroutine-like spider callbacks.

Event-driven networking engine written in Python.

Analyze scraped data

No description.

Scrapinghub Command Line Client

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Main repository for the Sphinx documentation builder

Extract price amount and currency symbol from a raw text string

Extract text from HTML

Python library of web-related functions

Repositorio de datos y slides de las charlas llevadas a cabo por el grupo de Python Vigo

Web grep: search all rendered resources used by a URI

Convert Javascript code to an XML document

CSS Selectors for Python

Monitor Scrapy Cloud spiders

python parser for human readable dates

Crawlera middleware for Scrapy

🔩 Like builtins, but boltons. 220+ constructs, recipes, and snippets extending (and relying on nothing but) the Python standard library. Nothing like Michael Bolton.

A self-contained cryptographic library for Python

Python Data Validation for Humans™.

hunspell-gl

Number to number name and money text conversion libraries in C++, Java, JavaScript and Python & LibreOffice Calc Extension

Laravel plugins for PHPStan

Useful localization tools with Python API for building localization & translation systems

Localisation guide

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS