Summary
This is your toolkit for building evaluation datasets in LangSmith without writing a bunch of SDK boilerplate. It wraps the langsmith CLI so you can export traces, shape them into datasets (final response, single step, trajectory, or RAG formats), and upload them for testing. The workflow is straightforward: pull traces from a project, transform the JSON into examples with inputs and outputs, then push it back up. Handy if you're iterating on agent behavior and need regression tests or comparative evals. The CLI handles confirmations on destructive ops, which is nice when you're moving fast and don't want to accidentally nuke a dataset.
Install to Claude Code
npx -y skills add langchain-ai/langsmith-skills --skill langsmith-dataset --agent claude-codeInstalls into .claude/skills of the current project.
Keep your Mac awake while Claude Code and 40+ AI agents run. Sleeps when they're idle.
One time payment $9 →
Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →
Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →
On Capafy, your Skill runs online 24/7 as an agent product, and you get paid every time someone uses it.
Start earning →
Files
SKILL.md
Select a file.
Featured
Keep your Mac awake while Claude Code and 40+ AI agents run. Sleeps when they're idle.
One time payment $9 →Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →On Capafy, your Skill runs online 24/7 as an agent product, and you get paid every time someone uses it.
Start earning →
