prompt-tester
0
The MCP Prompt Tester is a simple server designed to facilitate testing of large language model prompts using different providers like OpenAI and Anthropic. It supports configuration of prompts and parameters, provides tools for comparison and conversation management, and allows for multi-turn conversation handling.
MCP Prompt Tester
A simple MCP server that allows agents to test LLM prompts with different providers.
Features
- Test prompts with OpenAI and Anthropic models
- Configure system prompts, user prompts, and other parameters
- Get formatted responses or error messages
- Easy environment setup with .env file support
Installation
Installable via pip or uv, supporting .env file for configuration.
Usage
Start the server using stdio or SSE transport. Tools available include list_providers, test_comparison, and test_multiturn_conversation for LLM interactions.
Configuration
Set API keys for OpenAI and Anthropic via environment variables or a .env file. Optional Langfuse tracing is available.