跳到正文
DEV Community· CapLine AI Studio·· 3 天前AI 評分37

Intelligence Studio:自託管 AI 評估、治理及人手審核平台

Intelligence Studio: Self-Hosted AI Evaluation, Governance, and Human-in-the-Loop Review

AI 導讀

Intelligence Studio 是自託管企業平台,將 AI 評估、品質保證、治理及審計整合於同一環境,並讓資料留在用戶自己的基礎設施內。平台支援加權評分、敏感決策人手審核、數據集基準測試及安全分析。它採用商業自託管授權 v1.1.0,並非 SaaS 訂閲,提供完整原始碼、部署指令碼、文件及安全報告。

正文

CapLine AI Studio

AI systems ship fast. Verifying their output — and keeping a human accountable for sensitive decisions — usually does not.

Intelligence Studio is a self-hosted enterprise platform that brings AI evaluation, quality assurance, governance, and audit into one environment. You run it on your own infrastructure, and your data never leaves it.

What it does:

  • Structured AI evaluation — build evaluation cases with deterministic, weighted scoring rubrics, assign analysts and reviewers, and run cases individually or through background workers.
  • Human-in-the-loop governance — sensitive decisions require human review. Approve, reject, or request changes with mandatory written justification, and keep a full trace of every decision.
  • Dataset benchmarking — import CSV records (with validation and duplicate detection), ingest through authenticated webhooks, and run repeatable evaluations against labeled datasets.
  • Enterprise security — multi-tenant PostgreSQL 16 with Row-Level Security, RBAC (Admin / Analyst / Reviewer / Viewer), TOTP MFA, refresh-token rotation with reuse detection, distributed rate limiting with Redis 7, ClamAV scanning on uploads, and structured JSONL security event logs with SIEM webhooks.
  • Analytics & reporting — executive dashboards, approval-rate monitoring, anomaly detection, trend analysis, and CSV exports.
  • Backup & operations — automated PostgreSQL backups with SHA-256 integrity manifests, retention/cleanup routines, and restore procedures.

Stack: Python / FastAPI backend, React + TypeScript + Vite frontend, PostgreSQL 16, Redis 7, Nginx with HTTPS/TLS, deployed via Docker Compose (eight services). Recommended production spec: 4 vCPU, 8 GB RAM, 50 GB SSD.

This is a commercial self-hosted license (v1.1.0), not a SaaS subscription — you get full source code, deployment scripts, documentation, and security reports, and you own the infrastructure.

If your team needs transparent, auditable AI evaluation with humans kept in the decision loop, I'd love your feedback. Questions and criticism welcome in the comments.

來源:DEV Community · dev.to