Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/skillevaluator

SkillEvaluator0 membersJoin discussion
Project infoNVIDIA/SkillEvaluator

About

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

Open sourceCreated November 12, 2026

Readme badge

Open-source project

Avatar from GitHubNVIDIA/SkillEvaluatorView on GitHub
Community-run · not official
Stars
792
Forks
100
Language
Python
License
Apache-2.0

Last commit Nov 12, 2026

Daily rank, last 30 days

Not on the daily list in the last 30 days

SkillEvaluator: An open-source tool that checks AI agent skills and measures their effect on task results.

What problem it solves AI agent skills need to be checked for quality, security, duplication, and their actual effect on agent behavior. Static checks alone cannot establish whether guidance improves task results, so evaluation must also support live comparison with and without a skill. Key features Three-tier evaluation pipeline — Independent tiers validate skill safety and structure, detect over…

github.comhttps://github.com/NVIDIA/SkillEvaluator