NVIDIA open-sources SkillEvaluator for AI agent skills
NVIDIA released the Apache 2.0-licensed SkillEvaluator for checking AI agent skills through quality validation, semantic overlap detection, model-backed rubric evaluation, synthetic evaluation dataset generation and live agent comparisons. It offers CLI and CI integration, and its three tiers can run independently. Tier 1 performs validation and security scanning, Tier 2 identifies overlapping guidance, and Tier 3 compares agent task results with and without a skill using provider access, a supported agent and a running sandbox, with Docker as the default. The bundled text-analyzer example receives a static quality score of 86.2 out of 100. NVIDIA describes the project as experimental and community-supported, with best-effort support and no SLA or enterprise support entitlement.
SkillEvaluator gives developers a unified way to inspect agent-skill quality and measure how a skill affects task results, combining static checks, rubric feedback, overlap detection and live comparisons in one CLI.
Multi-tier framework for evaluating AI agent skills and plugins with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

https://docs.nvidia.com/skills/skillevaluator/
Evaluate and improve AI agent skills and plugins: quality, security, overlap, compatibility, and real impact across agents
📺 Livestream: Ask the Experts: Evaluating Agent Skills
#NVIDIA#SkillEvaluator#NVIDIA Build#Harbor#SkillSpector#Gitleaks#Semgrep#Docker#Claude Code#Codex