Project Configuration

System Settings

Configuration Features

Storage Method

  • Stored in database
  • Supports dynamic modification via management API
  • Supports hot reload without restart
  • Provides behavioral baseline for the entire application

Management Features

  • Web interface visual configuration
  • RESTful API programmatic management
  • Configuration validation and constraint checking
  • Change history tracking and rollback

Basic Parameters

Configuration ItemField NameDefault ValueGroup OverridableDescription
Project URLapp_urlhttp://localhost:3001Project base URL for concatenating group endpoints
Global Proxy Keysproxy_keysInitial value is AUTH_KEY from environment configGlobally effective proxy authentication keys, separated by commas
Log Retention Daysrequest_log_retention_days7Request log database retention days, 0 for no cleanup
Log Write Intervalrequest_log_write_interval_minutes1Log write to database cycle (minutes)
Enable Log Detailsenable_request_body_loggingfalseWhether to record complete request body content in request logs, enabling will increase memory and storage usage

Request Settings

Configuration ItemField NameDefault ValueGroup OverridableDescription
Request Timeoutrequest_timeout600Complete lifecycle timeout for forwarded requests (seconds)
Connect Timeoutconnect_timeout15Connection establishment timeout with upstream service (seconds)
Idle Connection Timeoutidle_conn_timeout120HTTP client idle connection timeout (seconds)
Response Header Timeoutresponse_header_timeout600Timeout waiting for upstream response headers (seconds)
Max Idle Connectionsmax_idle_conns100Maximum total idle connections in connection pool
Max Idle Connections Per Hostmax_idle_conns_per_host50Maximum idle connections per upstream host
Proxy Server Addressproxy_url-HTTP/HTTPS proxy for forwarding requests, uses environment config if empty

Key Configuration

Configuration ItemField NameDefault ValueGroup OverridableDescription
Max Retriesmax_retries3Maximum retry attempts for a single request using different keys
Blacklist Thresholdblacklist_threshold3Number of consecutive failures before a key enters blacklist
Key Validation Intervalkey_validation_interval_minutes60Background scheduled key validation cycle (minutes)
Key Validation Concurrencykey_validation_concurrency10Concurrency level for background scheduled validation of invalid keys
Key Validation Timeoutkey_validation_timeout_seconds20API request timeout for background scheduled validation of individual keys (seconds)

Proxy Configuration Priority

System proxy configuration has medium priority, overrides environment variable config but can be overridden by group config:

Group Config > System Config > Environment Config

When proxy_url in system configuration is empty, environment variable proxy settings will be used automatically.

Group Configuration

Configuration Features

Highest Priority

  • Can override any parameter in system settings
  • Customize dedicated behavior for specific groups
  • Supports fine-grained performance tuning
  • Implements multi-tenant isolated configuration
  • Proxy configuration has highest priority, overrides system and environment settings

Configuration Flexibility

  • Flexible configuration in JSON format
  • Supports parameter override and inheritance
  • Dynamic calculation of effective configuration
  • Configuration validation and constraint checking

Overridable Configuration Items

Request and Connection Configuration

  • request_timeout - Request timeout
  • connect_timeout - Connect timeout
  • idle_conn_timeout - Idle connection timeout
  • response_header_timeout - Response header timeout
  • max_idle_conns - Max idle connections
  • max_idle_conns_per_host - Max idle connections per host
  • proxy_url - Proxy server address

Key Management Configuration

  • max_retries - Max retries
  • blacklist_threshold - Blacklist threshold
  • key_validation_interval_minutes - Key validation interval
  • key_validation_concurrency - Key validation concurrency
  • key_validation_timeout_seconds - Key validation timeout
  • enable_request_body_logging - Enable log details

Project Configuration Summary

Project configuration is the core of GPT-Load configuration system, providing powerful dynamic management capabilities covering system-level and group-level configuration.

  • Role and LayeringDivided into "System Settings" and "Group Configuration", the former as global baseline, the latter providing overrides for specific scenarios, implementing hierarchical management.
  • Management FeaturesSupports dynamic modification through Web interface and API, configuration changes can be hot-reloaded without service restart, ensuring high system availability.
  • Proxy Configuration PriorityGroup Config > System Config > Environment Config, implementing flexible proxy settings from global to specific groups.
  • Usage AdvantagesProvides extremely high flexibility and dynamic adjustment capabilities, allowing fine-grained isolation and optimization for different business scenarios (such as multi-tenancy).