Agent Skills › lobehub/lobehub › response-compliance

response-compliance

GitHub

用于对 Response API 运行 OpenResponses 合规测试套件，验证端点 Schema、基本响应、流式传输及工具调用等功能的正确性。

.agents/skills/response-compliance/SKILL.md lobehub/lobehub

Trigger Scenarios

需要验证 API 合规性检查端点 Schema 失败执行 API 测试用例

Install

npx skills add lobehub/lobehub --skill response-compliance -g -y

More Options

Non-standard path

npx skills add https://github.com/lobehub/lobehub/tree/canary/.agents/skills/response-compliance -g -y

Use without installing

npx skills use lobehub/lobehub@response-compliance

指定 Agent (Claude Code)

npx skills add lobehub/lobehub --skill response-compliance -a claude-code -g -y

安装 repo 全部 skill

npx skills add lobehub/lobehub --all -g -y

预览 repo 内 skill

npx skills add lobehub/lobehub --list

SKILL.md

Frontmatter

{
    "name": "response-compliance",
    "description": "Use for OpenResponses\/Response API compliance tests, endpoint schema failures and test runs."
}

OpenResponses Compliance Test

Run the official OpenResponses compliance test suite against the local (or remote) Response API endpoint.

Quick Start

# From the openapi package directory
cd packages/openapi

# Run all tests (dev mode, localhost:3010)
APP_URL=http://localhost:3010 bun run test:response-compliance -- \
  --auth-header "lobe-auth-dev-backend-api" --no-bearer --api-key 1

# Run specific tests only
APP_URL=http://localhost:3010 bun run test:response-compliance -- \
  --auth-header "lobe-auth-dev-backend-api" --no-bearer --api-key 1 \
  --filter basic-response,streaming-response

# Verbose mode (shows request/response details)
APP_URL=http://localhost:3010 bun run test:response-compliance -- \
  --auth-header "lobe-auth-dev-backend-api" --no-bearer --api-key 1 -v

# JSON output (for CI)
APP_URL=http://localhost:3010 bun run test:response-compliance -- \
  --auth-header "lobe-auth-dev-backend-api" --no-bearer --api-key 1 --json

Prerequisites

Dev server running with ENABLE_MOCK_DEV_USER=true in .env
The api/v1/responses route registered (via src/app/(backend)/api/v1/[[...route]]/route.ts)

Auth Modes

Mode	Flags
Dev (mock user)	`--auth-header "lobe-auth-dev-backend-api" --no-bearer --api-key 1`
API Key	`--api-key lb-xxxxxxxxxxxxxxxx`
Custom	`--auth-header <name> --api-key <value>`

Test IDs

Available --filter values:

ID	Description	Related Issue
`basic-response`	Simple text generation (non-streaming)	LOBE-5858
`streaming-response`	SSE streaming lifecycle + events	LOBE-5859
`system-prompt`	System role message handling	LOBE-5858
`tool-calling`	Function tool definition + call output	LOBE-5860
`image-input`	Multimodal image URL content	—
`multi-turn`	Conversation history via input items	LOBE-5861

Environment Variables

Variable	Default	Description
`APP_URL`	`http://localhost:3010`	Server base URL (auto-appends `/api/v1`)
`API_KEY`	—	API key (alternative to `--api-key` flag)

How It Works

The script (packages/openapi/scripts/compliance-test.sh) clones the official openresponses/openresponses repo into scripts/openresponses-compliance/ (gitignored) and runs its CLI test runner. First run clones; subsequent runs update from upstream.

Debugging Failures

Run with -v to see full request/response payloads
Common failure patterns:
- "Failed to parse JSON": Auth failed, server returned HTML redirect
- "Response has no output items": LLM execution not yet implemented
- "Expected number, received null": Missing required field in response schema
- "Invalid input": Zod validation on response schema — check field format