Arthi Arumugam Claim this profile

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.

gnani is a spreadsheet tool where every cell thinks. every cell is an AI agent.

cost monitoring and optimization tool

Twenty-five pull requests across fifteen LLM eval, tracing and cost libraries. Sixteen are the same defect: a number comes out wrong and nothing raises. Three merged upstream.

Refine high-quality datasets and visual AI models

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Armature analytics wrapper SDK for Python MCP servers

The fullstack MCP framework to develop MCP Apps for ChatGPT / Claude & MCP Servers for AI Agents.

We write your reusable computer vision tools. 💜

No description.

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack

LlamaIndex is the leading document agent and OCR platform

A framework for building realtime voice AI agents 🤖🎙️📹

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

Turn any computer or edge device into a command center for your computer vision projects.

Open Source framework for voice and multimodal conversational AI

Our library for RL environments + evals

Collection of evals for Inspect AI

AI observability platform for production LLM and agent systems.

Calculate prices for calling LLM inference APIs.

No description.

profile

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

The LLM Evaluation Framework

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

Python library for interacting with Okareo Cloud APIs

AI Observability & Evaluation

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Python SDK for Vellum API

🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any LLM or framework

Python Library for Accessing the Cohere API

Analysis, Comparison, Trends, Rankings of Open Source Software, you can also get insight from more than 10 billion with natural language (powered by LLM). Follow us on Twitter: https://twitter.com/ossinsight

The OpenTelemetry website and documentation

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.