NVIDIA/SkillEvaluator
Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.
6 skills listed · average QAI Index 77 of 100 · Apache 2.0 · 4.3k stars · last pushed 20 Nov 2026
The QAI Index is a guide to compare skills by, not a verdict on them.
How it's scoredAcross these 6 skills
Pattern check
Nothing flagged in 6
What it can touch
- 1 installs more skills
- 5 run shell commands
- 5 bundle scripts
+2 more
- 2 reach the network
- 2 name web addresses
Checked at commit 4327960 on 20 Nov 2026.
Skills
| Skill | QAI Index | What it can touch | Pattern check | Licence | Updated |
|---|---|---|---|---|---|
api-callerCall any REST API dynamically. Make GET, POST, PUT, DELETE requests to any endpoint with custom headers and JSON body. 78/QI
Pattern check: Nothing flaggedApache 2.0Updated 19 Nov 2026 | 78/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 19 Nov 2026 |
calculatorEvaluate mathematical expressions and unit conversions. Handles arithmetic, percentages, exponents, and common unit conversions (temperature, distance, weight). No external dependencies. 78/QI
Pattern check: Nothing flaggedApache 2.0Updated 20 Nov 2026 | 78/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 20 Nov 2026 |
create-custom-graderUse when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation. 77/QI
Pattern check: Nothing flaggedApache 2.0Updated 17 Nov 2026 | 77/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 17 Nov 2026 |
skillevaluatorRun and interpret SkillEvaluator for agent skills. Use for any skill benchmark or eval - validating or scoring a SKILL.md, writing evals.json test cases or evals config, explaining benchmark reports, verdicts and exit codes, or gating skills in CI. 72/QI
Pattern check: Nothing flaggedApache 2.0Updated 17 Nov 2026 | 72/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 17 Nov 2026 |
task-listRequired for 4+ step requests; add tasks at start and update status after each step. 78/QI
Pattern check: Nothing flaggedApache 2.0Updated 19 Nov 2026 | 78/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 19 Nov 2026 |
text-analyzerAnalyze text content and produce statistics including word count, line count, character count, sentence count, average word length, and most frequent words. Use when asked to analyze, count, or summarize a text or a text file (inline text or a file path such as input.txt), or when a request names text-analyzer. 77/QI
Pattern check: Nothing flaggedApache 2.0Updated 17 Nov 2026 | 77/QI |
| Pattern check: Nothing flagged | Apache 2.0 | 17 Nov 2026 |
QAI Index badge
Show the average QAI Index of this repo's skills in its README or on a website. It links back to this page and changes when we refresh the catalog.
[](https://qai.io/skills/nvidia/skillevaluator)Claim this repo
If this repo is yours, claim it. Its pages then say it is claimed by its maintainer, and its skills go on your Watching page, as many as your list has room for, so you hear by email when a check changes. A claim never changes a QAI Index or a skill's place in a list.
Not listed from this repo
3 test fixtures.