Daniel van Strien

awesome synthetic (text) datasets

No description.

Self-contained UV scripts for data & ML tasks — OCR, vision, audio & more — run one in a command, locally or on Hugging Face Jobs. Built for humans and agents.

Using open source LLMs to build synthetic datasets for direct preference optimization

Per-collection OCR leaderboards using VLM-as-judge

No description.

Command Line Interface for running 🤗 Transformers Image Classification locally

A study group for v4 of the fastai introduction to deep learning course with a focus on applications in GLAM settings

No description.

AI Design Patterns for Galleries, Libraries, Archives, and Museums

Experimental tl;dr summaries for datasets on the Hugging Face Hub!

hf CLI extension: semantic search over Hugging Face Hub datasets & models

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

Workshop materials on Python as part of a series of Library Carpentry workshops at the British Library

LLM PubMed Query Generation Evaluation

Wouldn't it be nice to generate parts of our dataset card automagically?

Find illustrations in historic book using computer vision

Train transformer language models with reinforcement learning.

Minimal benchmark for structured extraction from GLAM documents (index cards + forms). POC/silver.

Embedding Atlas is a tool that provides interactive visualizations for large embeddings. It allows you to visualize, cross-filter, and search embeddings and metadata.

Introduction to Machine Learning for Librarians & Archivists

Convert Data Lifeboats from Flickr Foundation to HuggingFace datasets and Spaces

push ImageFolder style image datasets to the 🤗 Hub from the command line

A curated list of data science blogs

POC: automatic bucket-backed snapshots of agent working directories — a safety net for when agents do something weird

Minimal hf CLI extension for the Hugging Face datasets library: no-download inspect, streaming preview, footgun-free folder->Hub publish (exploratory)

Read and write Hugging Face Hub buckets with Polars (pure-Python IO plugin)

Agent skill for deploying and using Label Studio on Hugging Face Spaces

Parse and analyze coding agent session traces (Pi, Claude Code, Codex, ATIF) into Polars DataFrames and Parquet

Synthetic Data curation for post-training and structured data extraction

British Library Digitised Books c. 1510 - c. 1900: JSONL (OCR derived text & metadata)

Automatically annotates YOLO dataset using Moondream visual model

No description.

No description.

No description.

⚗️ AI Feedback framework for scalable LLM alignment

No description.

This repository contains alternative setup instructions for a forthcoming Programming Historian lesson 'Computer Vision for the Humanities: an introduction to deep learning for image classification'.

Prepare ALTO XML datasets to Hugging Face datasets compatible format

python library for generating and parsing IIIF Image API URLs

Bulk download British Library Heritage Made Digital Newspapers 📰

A clean book theme for scientific explanations and documentation with Sphinx

🔌 A central repository collecting pre-trained adapter modules

flyswot models

No description.

Daniel van Strien's personal blog

MT Evaluation in Many Languages via Zero-Shot Paraphrasing

🪐 End-to-end NLP workflows from prototype to production

Experimenting with web archive data

Week Three lesson

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Community hf CLI extension for HF Jobs: selectors (@N, @status=…) + a dense live monitor (top) with sparklines and inline logs.

A minimal, toolz-style helper for batched, bounded-memory access to Hugging Face bucket files.

Give your agents the power of the Hugging Face ecosystem

A lightweight, local-first, and free experiment tracking library from Hugging Face 🤗

Agent skill for building labelstudio xml labeling config

Docs of the Hugging Face Hub

All the open source things related to the Hugging Face Hub.

Use Hugging Face with JavaScript

No description.

Collect, review, and upload redacted pi session files to a Hugging Face dataset

🎨 NeMo Data Designer: A general library for generating high-quality synthetic data from scratch or based on seed data.

The agent that grows with you

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local

No description.

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI

Self-hosted AI coding assistant

aider is AI pair programming in your terminal

Inspect: A framework for large language model evaluations

Structured Text Generation

Hugging Face Jobs

No description.

Learn Deep Learning with Python

🤗 AutoTrain Advanced

No description.

A polars plugin to parse/extract fields from urls

How you (yes, you!) can write a Polars Plugin

Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ for the code

Create delightful python projects using Jupyter Notebooks

The code used to train and run inference with the ColPali architecture.

Build interactive, publication-quality documents from Jupyter Notebooks

GAHD: A German Adversarial Hate speech Dataset

Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.

Computer Vision for the Humanities workshop

A Gradio app to monitor annotation effort done by users using the Argilla HF Space over the prompt dataset

Multilingual Knowledge Graph Enhancement (EMNLP 2023)

Python wrapper for the arXiv API

No description.

A Benchmark Dataset for Multimodal Scientific Fact Checking

Awesome AI in Libraries

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

No description.

OCR engine for all the languages

OCR a IIIF images in a manifest and generate annotations

No description.

Code used for sourcing and cleaning the BigScience ROOTS corpus

Trying to classify web archives using metadata...

static site version of Programming Historian

This repository aims to collect information on the policies of research funders towards the payment of Article Processing Charges (APCs)

Demonstration repo

Living with Machines GitHub Stats report

This is simply to publish my templates to the world :)

Source for https://fullstackdeeplearning.com

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

No description.

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

Annotations stored in a git repo

A community dedicated to supporting tools for technical and scientific communication and interactive computing

A collection of Jupyter notebooks used for interactive learning sessions in the AI4LAM Metadata working group meetings. Jupyter Book available at https://ai4lam.github.io/metadata-working-group/

🦾 training flyswot models (fairly) easily

Libraries, Archives and Museums (LAM)

A place for all my recipes to live. Mostly vegan. Usually tasty. Creative Commons licensed.

Public repo for HF blog posts

No description.

A Python framework for creating reproducible, maintainable and modular data science code.

BigScience working group on language models for historical texts

Sample, annotate and apply computer vision to the Newspaper Navigator dataset

No description.

🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code

Source of XYZ tiles providers

Hypermodern Python Cookiecutter

The fastai deep learning library, plus lessons and tutorials

A curated list of awesome Jupyter projects, libraries and resources

Hypermodern Python

No description.

No description.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Optional static typing for Python 3 and 2 (PEP 484)

An Emacs framework for the stubborn martian hacker

Materials for Programming Historian Lessons on Computer Vision

Org mode syntax reference card

Community-curated topic and collection pages on GitHub

Library Carpentry: FAIR Data & Software

No description.

:headphones: :relaxed: Collaborate on Spotify playlists using Pull Requests, powered by GitHub Actions

Markdown -> PDF/HTML resumé generator

A work-in-progress site for submitting and reviewing new Programming Historian lessons

An introduction to computer vision for working with maps: workshop at DHN 2020

Template for nbdev projects

End-to-End Object Detection Framework - Pluggable to any Training Library: Fastai, Pytorch-Lightning with more to come

IceData: Datasets Hub for the *IceVision* Framework

Temporary home for fastai v2 while it's being developed

A functional standard library for Python.

Repository for code underlying the paper 'Assessing the Impact of OCR Quality on Downstream NLP Tasks'

An easy to use blogging platform, with enhanced support for Jupyter Notebooks.

The 3rd edition of course.fast.ai

Split images into tiles. Join the tiles back together.

Library Carpentry: The UNIX Shell

No description.

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://nlproc.info

NLP with pytorch notes/notebooks

No description.

Propagation model used in HELIO

Code snippets from "Text Mining with R: A Tidy Approach" translated into Python

Jupyter Interactive Notebook

Python best practices guidebook, written for Humans.

Workshop materials for a course introducing digital scholarship and open research

No description.

Simple web-based blog to introduce Flask, HTML, CSS, Bootstrap, and Jinja2.

DCC/UC3 collaboration for a data management planning tool

Gitbook for onboarding lessons, materials, and activities

source code to readthedocs.org

No description.

PyRDM is a Python-based library for research data management (RDM). It facilitates the automated publication of scientific software and associated input and output data.

Contains all the "handout" materials for my Python Jumpstart by Building 10 Apps course. This includes try it yourself and finished versions of the 10 apps.

Minimal Jekyll blog styled to resemble the look and layout of Edward Tufte's books

Templates for pandoc

Pandoc template for writing letters in markdown

NLTK Book

No description.

Warcbase is an open-source platform for managing analyzing web archives

A queue-controlled browser automation tool for improving web crawl quality

Materials for Library Carpentry development

No description.

Plugins and shell scripts for integrating 3rd party tools with FileBot

Automatic TV episode file renamer, uses data from thetvdb.com via tvdb_api

Provides basic function to read a ContentMine CProject and CTrees into python datastructures.

Tools for downloading offence and punishment data from the Old Bailey Online web-API, then modelling and analysing this data.

A command line client for Google Play Music

A collection of useful .gitignore templates

:page_with_curl: A list of practical projects that anyone can solve in any programming language.

Trying out Git

No description.

No description.

Week Two lesson

Automatically exported from code.google.com/p/tufte-latex

Write your PhD thesis using pandoc (Markdown, LaTeX)

The HTML Presentation Framework

repo for example lesson

Collect and disseminate information on fee-based Open Access publishing

process MARC records from Python

No description.

This repo is for demonstration purposes only.

A collection of notes for the literature review section of a dissertation on Open Access and the funding of APCs

Simple Markdown CV / Resume

notes for citymash talk

No description.