This is an AI API gateway/proxy built with Go. It aggregates 40+ upstream AI providers (OpenAI, Claude, Gemini, Azure, AWS Bedrock, etc.) behind a unified API, with user management, billing, rate limiting, and an admin dashboard.
Layered architecture: Router -> Controller -> Service -> Model
router/ — HTTP routing (API, relay, dashboard, web)
controller/ — Request handlers
service/ — Business logic
model/ — Data models and DB access (GORM)
relay/ — AI API relay/proxy with provider adapters
relay/channel/ — Provider-specific adapters (openai/, claude/, gemini/, aws/, etc.)
middleware/ — Auth, rate limiting, CORS, logging, distribution
setting/ — Configuration management (ratio, model, operation, system, performance)
common/ — Shared utilities (JSON, crypto, Redis, env, rate-limit, etc.)
dto/ — Data transfer objects (request/response structs)
constant/ — Constants (API types, channel types, context keys)
types/ — Type definitions (relay formats, file sources, errors)
i18n/ — Backend internationalization (go-i18n, en/zh)
oauth/ — OAuth provider implementations
pkg/ — Internal packages (cachex, ionet)
web/ — React frontend
web/src/i18n/ — Frontend internationalization (i18next, zh/en/fr/ru/ja/vi)
i18n/)nicksnyder/go-i18n/v2web/src/i18n/)i18next + react-i18next + i18next-browser-languagedetectorweb/src/i18n/locales/{lang}.json — flat JSON, keys are Chinese source stringsuseTranslation() hook, call t('中文key') in componentsSemiLocaleWrapperbun run i18n:extract, bun run i18n:sync, bun run i18n:lintcommon/json.goAll JSON marshal/unmarshal operations MUST use the wrapper functions in common/json.go:
common.Marshal(v any) ([]byte, error)common.Unmarshal(data []byte, v any) errorcommon.UnmarshalJsonStr(data string, v any) errorcommon.DecodeJson(reader io.Reader, v any) errorcommon.GetJsonType(data json.RawMessage) stringDo NOT directly import or call encoding/json in business code. These wrappers exist for consistency and future extensibility (e.g., swapping to a faster JSON library).
Note: json.RawMessage, json.Number, and other type definitions from encoding/json may still be referenced as types, but actual marshal/unmarshal calls must go through common.*.
All database code MUST be fully compatible with all three databases simultaneously.
Use GORM abstractions:
Create, Find, Where, Updates, etc.) over raw SQL.AUTO_INCREMENT or SERIAL directly.When raw SQL is unavoidable:
"column", MySQL/SQLite uses `column`.commonGroupCol, commonKeyCol variables from model/main.go for reserved-word columns like group and key.true/false, MySQL/SQLite uses 1/0. Use commonTrueVal/commonFalseVal.common.UsingPostgreSQL, common.UsingSQLite, common.UsingMySQL flags to branch DB-specific logic.Forbidden without cross-DB fallback:
GROUP_CONCAT without PostgreSQL STRING_AGG equivalent)@>, ?, JSONB operators)ALTER COLUMN in SQLite (unsupported — use column-add workaround)TEXT instead of JSONB for JSON storageMigrations:
ALTER TABLE ... ADD COLUMN instead of ALTER COLUMN (see model/main.go for patterns).Use bun as the preferred package manager and script runner for the frontend (web/ directory):
bun install for dependency installationbun run dev for development serverbun run build for production buildbun run i18n:* for i18n toolingWhen implementing a new channel:
StreamOptions.streamSupportedChannels.