mcp_function_call_server

mcp_function_call_server

3.3

mcp_function_call_server is a tool service designed for large language models (LLM) to enable external function calls, compatible with mainstream LLM function call standards and the latest MCP Server access specifications.

🏠📄

The mcp_function_call_server is a versatile tool service designed to enhance the capabilities of large language models (LLMs) by allowing them to call external functions. It supports mainstream LLM function call standards and the latest MCP Server access specifications. This service enables LLMs to perform tasks such as web searches, weather queries, and simple chat interactions, thereby extending their functionality to access real-time information or execute specific functions. The server supports both standard API mode and MCP Server mode, includes a custom LLM model module, and is capable of load balancing and dynamic allocation across multiple LLMs. It also supports streaming responses and event stream processing, making it a robust solution for integrating external functionalities with LLMs.

Features

  • {'name': 'Web Search', 'description': 'Allows LLMs to perform real-time web searches and retrieve results.'}
  • {'name': 'Weather Query', 'description': 'Enables querying of real-time weather information for specified cities.'}
  • {'name': 'Chat', 'description': 'Facilitates simple chat interactions as a demonstration of functionality.'}
  • {'name': 'Service Modes', 'description': 'Supports both standard API mode and MCP Server mode for flexibility.'}
  • {'name': 'Load Balancing', 'description': 'Supports load balancing and dynamic allocation across multiple LLMs.'}

Usage with Different Platforms

API Mode

bash
python -m server.main --mode api

MCP Mode

bash
python -m server.main --mode mcp