feat(worker-risk): 风控后台页面(可调阈值/实时状态/事件留痕/人工封禁解封),并修复解封后仍被 403 的 bug
## 修复的 bug(生产已发生) 风控三级封号把 tracker.banned 置为 true 后,banned 检查发生在鉴权之前, 而它只存在于进程内存。后台把账号改回 active 时数据库变了、内存没变, 于是账号在库里已经正常、请求却永远 403,只能等容器重启才恢复。 修法两道: - **数据库是唯一事实来源**:banned 改为带 30 秒 TTL 的缓存,到点回查 worker_users.status;已解封(或账号已删)则清除标记并放行。 对被判 banned 的 key 最多每 30 秒查一次,即便对方仍以 65 QPS 刷也只是 每 30 秒一次查询。查询失败时**保守维持封禁**,不因数据库抖动放行刷子。 - **后台改状态时主动释放**:review 只允许设 active/rejected/disabled/pending_review (没有 frozen),所以走到那里就意味着不再由风控冻结,直接释放内存状态。 顺带修掉一个连带缺陷:解封时只清了 violationCount,没清滑动窗口计数, 账号刚恢复就会被上一轮残留的 windowCount 立刻限流、并在 60 秒内二次封禁。 现在整轮窗口状态一并清零。 ## 新增后台页面 接单平台 → 风控(/admin/worker-platform?tab=risk-control),三块: - 阈值配置:6 个阈值可视化编辑,落 app_config_entries,保存即热生效,无需重启 - 当前实时风控:进程内存状态(已封禁/惩罚中/仅记录),支持人工解封、封禁、仅释放内存状态 - 风控事件留痕:worker_risk_events 分页查询,可按类型/IP 筛选 ## 关键取舍 只记**显著事件**(二级惩罚、三级封号、人工处置),不记每一次被拒请求。 被刷时实测 45~65 QPS,按请求写库正是最初要解决的问题。实时计数仍走进程内存。 事件写入为 fire-and-forget 并吞异常,留痕失败绝不影响大厅请求。 ## 验证 - 新增 6 个用例覆盖解封立即生效、对账自愈、TTL 不重复查库、对账失败保守维持、阈值可配置 - 迁移 089 已在临时库实测:表结构/4 索引/CHECK 约束/外键均正确,非法 event_type 被拒 - 后端 557 测试 554 通过 0 失败;前后端 typecheck/lint/format/build 全绿
This commit is contained in:
@@ -0,0 +1,192 @@
|
||||
import { query } from '../../db/client.js'
|
||||
|
||||
/**
|
||||
* 风控事件留痕的数据访问层。
|
||||
*
|
||||
* 设计约束(重要):
|
||||
* - **只写显著事件**,不写每一次被拒请求。被刷时实测 45~65 QPS,按请求写库会把数据库拖垮,
|
||||
* 而那正是风控要解决的问题。实时计数走进程内存,见 middleware/worker-risk-control.ts。
|
||||
* - 写入方(风控中间件)必须 **fire-and-forget 并吞掉异常**:留痕失败绝不能让
|
||||
* 大厅请求变成 500。仓储层因此不抛业务错误,只让 pg 错误向上冒泡给调用方去吞。
|
||||
*/
|
||||
|
||||
export type WorkerRiskEventType =
|
||||
| 'tier2_penalized'
|
||||
| 'tier3_autofrozen'
|
||||
| 'manual_banned'
|
||||
| 'manual_unbanned'
|
||||
| 'manual_ban_failed'
|
||||
|
||||
export type WorkerRiskEventRow = {
|
||||
id: string
|
||||
event_type: WorkerRiskEventType
|
||||
target_key: string
|
||||
worker_id: string | null
|
||||
worker_username: string
|
||||
ip: string
|
||||
violation_count: number
|
||||
window_count: number
|
||||
penalty_until: Date | null
|
||||
action: 'auto' | 'manual'
|
||||
actor_user_id: string | null
|
||||
actor_username: string
|
||||
reason: string
|
||||
detail_json: Record<string, unknown> | null
|
||||
created_at: Date
|
||||
}
|
||||
|
||||
export type InsertWorkerRiskEventInput = {
|
||||
eventType: WorkerRiskEventType
|
||||
targetKey: string
|
||||
workerId?: number | null
|
||||
ip?: string
|
||||
violationCount?: number
|
||||
windowCount?: number
|
||||
penaltyUntil?: string | null
|
||||
action?: 'auto' | 'manual'
|
||||
actorUserId?: number | null
|
||||
actorUsername?: string
|
||||
reason?: string
|
||||
detail?: Record<string, unknown>
|
||||
}
|
||||
|
||||
/** 写入一条风控事件。账号名用子查询就地补全,避免调用方多发一次查询。 */
|
||||
export async function insertWorkerRiskEvent(input: InsertWorkerRiskEventInput): Promise<void> {
|
||||
await query(
|
||||
`
|
||||
INSERT INTO worker_risk_events (
|
||||
event_type, target_key, worker_id, worker_username, ip,
|
||||
violation_count, window_count, penalty_until,
|
||||
action, actor_user_id, actor_username, reason, detail_json, created_at
|
||||
) VALUES (
|
||||
$1, $2, $3,
|
||||
COALESCE((SELECT username FROM worker_users WHERE id = $3), ''),
|
||||
$4, $5, $6, $7, $8, $9, $10, $11, $12::jsonb, NOW()
|
||||
)
|
||||
`,
|
||||
[
|
||||
input.eventType,
|
||||
String(input.targetKey || '').slice(0, 200),
|
||||
input.workerId ?? null,
|
||||
String(input.ip || '').slice(0, 64),
|
||||
Math.max(0, Math.trunc(Number(input.violationCount) || 0)),
|
||||
Math.max(0, Math.trunc(Number(input.windowCount) || 0)),
|
||||
input.penaltyUntil ?? null,
|
||||
input.action === 'manual' ? 'manual' : 'auto',
|
||||
input.actorUserId ?? null,
|
||||
String(input.actorUsername || '').slice(0, 100),
|
||||
String(input.reason || '').slice(0, 500),
|
||||
JSON.stringify(input.detail ?? {}),
|
||||
],
|
||||
)
|
||||
}
|
||||
|
||||
export type ListWorkerRiskEventsInput = {
|
||||
limit: number
|
||||
offset?: number | undefined
|
||||
eventType?: string | undefined
|
||||
ip?: string | undefined
|
||||
workerId?: number | null | undefined
|
||||
targetKey?: string | undefined
|
||||
/** 只看某个时间点之后的事件,用于「最近 N 小时」筛选 */
|
||||
sinceIso?: string | undefined
|
||||
}
|
||||
|
||||
/**
|
||||
* 分页查询风控事件。
|
||||
*
|
||||
* 注意:worker_risk_events 是低频表(每天几条到几百条),因此这里用朴素的分页查询;
|
||||
* 没有做成 keyset 分页。
|
||||
*/
|
||||
export async function listWorkerRiskEvents(
|
||||
input: ListWorkerRiskEventsInput,
|
||||
): Promise<WorkerRiskEventRow[]> {
|
||||
const { where, params } = buildEventFilters(input)
|
||||
const limit = Math.min(200, Math.max(1, Math.trunc(Number(input.limit) || 20)))
|
||||
const offset = Math.max(0, Math.trunc(Number(input.offset) || 0))
|
||||
|
||||
const result = await query<WorkerRiskEventRow>(
|
||||
`
|
||||
SELECT *
|
||||
FROM worker_risk_events
|
||||
${where}
|
||||
ORDER BY created_at DESC, id DESC
|
||||
LIMIT $${params.length + 1} OFFSET $${params.length + 2}
|
||||
`,
|
||||
[...params, limit, offset],
|
||||
)
|
||||
|
||||
return result.rows
|
||||
}
|
||||
|
||||
export async function countWorkerRiskEvents(
|
||||
input: Omit<ListWorkerRiskEventsInput, 'limit' | 'offset'>,
|
||||
): Promise<number> {
|
||||
const { where, params } = buildEventFilters(input)
|
||||
const result = await query<{ total: string }>(
|
||||
`SELECT COUNT(*)::text AS total FROM worker_risk_events ${where}`,
|
||||
params,
|
||||
)
|
||||
return Number(result.rows[0]?.total || 0)
|
||||
}
|
||||
|
||||
/** 按事件类型统计近期分布,用于面板上的概览卡片。 */
|
||||
export async function summarizeWorkerRiskEvents(sinceIso: string) {
|
||||
const result = await query<{ event_type: string; total: string }>(
|
||||
`
|
||||
SELECT event_type, COUNT(*)::text AS total
|
||||
FROM worker_risk_events
|
||||
WHERE created_at >= $1
|
||||
GROUP BY event_type
|
||||
ORDER BY COUNT(*) DESC
|
||||
`,
|
||||
[sinceIso],
|
||||
)
|
||||
return result.rows.map((row) => ({ eventType: row.event_type, total: Number(row.total) }))
|
||||
}
|
||||
|
||||
function buildEventFilters(input: {
|
||||
eventType?: string | undefined
|
||||
ip?: string | undefined
|
||||
workerId?: number | null | undefined
|
||||
targetKey?: string | undefined
|
||||
sinceIso?: string | undefined
|
||||
}): { where: string; params: unknown[] } {
|
||||
const conditions: string[] = []
|
||||
const params: unknown[] = []
|
||||
|
||||
const eventType = String(input.eventType || '').trim()
|
||||
if (eventType) {
|
||||
params.push(eventType)
|
||||
conditions.push(`event_type = $${params.length}`)
|
||||
}
|
||||
|
||||
const ip = String(input.ip || '').trim()
|
||||
if (ip) {
|
||||
params.push(ip)
|
||||
conditions.push(`ip = $${params.length}`)
|
||||
}
|
||||
|
||||
const workerId = Number(input.workerId)
|
||||
if (Number.isInteger(workerId) && workerId > 0) {
|
||||
params.push(workerId)
|
||||
conditions.push(`worker_id = $${params.length}`)
|
||||
}
|
||||
|
||||
const targetKey = String(input.targetKey || '').trim()
|
||||
if (targetKey) {
|
||||
params.push(targetKey)
|
||||
conditions.push(`target_key = $${params.length}`)
|
||||
}
|
||||
|
||||
const sinceIso = String(input.sinceIso || '').trim()
|
||||
if (sinceIso) {
|
||||
params.push(sinceIso)
|
||||
conditions.push(`created_at >= $${params.length}`)
|
||||
}
|
||||
|
||||
return {
|
||||
where: conditions.length ? `WHERE ${conditions.join(' AND ')}` : '',
|
||||
params,
|
||||
}
|
||||
}
|
||||
Reference in New Issue
Block a user