Experiments
| Name | Description | Models | Scenarios |
|---|---|---|---|
| MCP with server instructions | Comparing `@primer/mcp` with and without server instructions to determine if server instructions improve the model's ability to follow instructions and complete tasks effectively. The experiment will involve two groups: one using `@primer/mcp` with server instructions and another using `@primer/mcp` without server instructions. | 1 | 2 |
| MCP | Compare MCP versus local instructions performance for Primer usage. | 3 | 2 |
| noop | A fast experiment for testing agent-eval | 1 | 1 |