primer/agent-eval

Agent eval navigation

Experiments

NameDescriptionModelsScenarios
BaselineBaseline experiment to evaluate the performance of the agent with our recommended setup.65
MCP with server instructionsComparing `@primer/mcp` with and without server instructions to determine if server instructions improve the model's ability to follow instructions and complete tasks effectively. The experiment will involve two groups: one using `@primer/mcp` with server instructions and another using `@primer/mcp` without server instructions.12
MCPCompare MCP versus local instructions performance for Primer usage.32