AI Red Team Operations Console

A structured audit framework for ML pipelines. 14 stages, 100+ checks, and every leakage pattern that silent model failures are made of.

Autonomous Update Review Architecture for Federated Learning. A full-stack platform for inspecting, scoring, and auditing model updates using SHAP explainability, anomaly detection, and ledger-based tracking. Built with FastAPI, React 19, and Flower.

Production-grade platform for auditing AI/ML models for fairness, explainability, and robustness. JWT auth, SHA-256 model verification, paginated REST API, dark web dashboard. 30/30 tests passing.

A production-grade LLM Evaluation & Benchmarking Framework for systematic model auditing. Features parallel benchmarking, fairness/bias detection, MMLU integration, and a real-time analytics dashboard powered by React and FastAPI.

Reproducible pipeline for silent-failure auditing in ECG accept-sets (MIT-BIH) with Newton–Puiseux onset scoring

Open-source toolkit for Fourier-based audits of trained quantum neural networks.

Audit a public AI text classifier for bias and explain its decisions. Counterfactual fairness probing (Equity Evaluation Corpus style) + occlusion-based token attribution, on a black-box model using only inputs and outputs. Python · Transformers · PyTorch.

SHAP-based bias detection and model interpretability auditing framework. Feature importance analysis and ML audit automation.

Subgroup-stratified, calibration-aware fairness auditing for ML models: DeLong AUC confidence intervals, per-subgroup calibration error, multiple-comparison-corrected significance, and a novel five-axis cross-platform protocol (CPFE). Grounded in peer-reviewed methods.

AI Evaluator Pro 🛡️ is an AI security auditing tool that checks Hugging Face models for supply chain risks, unsafe formats, and author trust using OSINT + LLMs. It supports direct or discovery-based audits to detect security and integrity issues before deployment.

Second Look — a clinically-grounded triage safety-net & audit system (Triagegeist hackathon): calibrated ESI + vitals-independent red-flag NLP + honest informative-missingness & fairness audit + live Gradio demo.

Coordinate multiple LLMs in parallel for voting, debate, synthesis, critique, red teaming, and verification via MCP and Claude Code