AI Observability & Evaluation

Evaluation and Tracking for LLM Experiments and AI Agents

React components for visualizing traces from AI agents

A comprehensive solution for monitoring your AI models in production

A python library to send data to Arize AI!

g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.

AI-Powered Zabbix Monitoring with Google Gemini Seamlessly integrate Google Gemini AI into your Zabbix monitoring to get intelligent alert analysis, predictive insights, and automated troubleshooting suggestions

Java client to interact with Arize API

AI-powered online exam proctoring system that detects suspicious activities using computer vision. Tracks eye movements, face presence, multiple faces, and talking during exams with real-time alerts and dashboard.

Example projects for Arthur Model Monitoring Platform

Classifying AI agent actions to ensure safety and reliability

Production-ready Retrieval Augmented Generation (RAG) system with hybrid retrieval, advanced evaluation metrics, and monitoring. Build enterprise LLM applications with reduced hallucinations, better context management, and comprehensive observability.

Fencing Game

Automatic Langfuse tracking for Claude Code

Real-time Statistical Process Control (SPC) monitoring for LLMs

Sentio IoT is an open-source observability hub for IoT and edge computing. Monitor metrics, logs, and traces across thousands of devices in real-time. Features AI-driven alerting, predictive maintenance, native integrations (Home Assistant, Zigbee, Modbus), and secure cloud/on-prem deployment.

AI observability Grafana plugin tracking real-time LLM metrics — latency, cost, tokens, insights, and provider performance (Cerebras, LLAMA, MCP) with live 5s updates.

Daily-updated hub of no-auth AI providers and models from GPT4Free. It lists options that work now for quick access and reliable, up-to-date results across services. 🐙

AI-Powered Citation Monitoring & Content Authority