perf(ci): ci-base 镜像预装 ffmpeg——消除 unit-tests 每次 24min apt 安装 #1588

Merged
xiaoxia merged 1 commits from fix/prebake-ffmpeg-ci-image into develop 2026-09-01 00:32:54 +08:00
Owner

问题

Unit Tests job 每次跑 45-50 分钟,表现为长时间无输出看似卡死。拆解日志发现:

步骤 耗时
Install ffmpeg(apt-get update + 安装数百个编解码依赖) ~24 分钟
pytest 单元测试本体 21-23 分钟

根因:CI job 每次在全新容器运行,但 ci-base 镜像未预装 ffmpeg,step_install_ffmpeg.sh 每次都现场 apt 安装 ffmpeg(带 x264/aom/systemd 等大量依赖)。

修复

把 ffmpeg 预装到 ci-base 镜像(ci.Dockerfile)。step_install_ffmpeg.sh 检测到 ffmpeg 已存在会 exit 0 秒退,unit-tests 每次省约 24 分钟。

生效条件

ci-base 镜像需重建并推送 registry 后才对新 job 生效。

不改动

  • pytest / 测试逻辑不动
  • 其他镜像(api/web/worker)不动
## 问题 Unit Tests job 每次跑 45-50 分钟,表现为长时间无输出看似卡死。拆解日志发现: | 步骤 | 耗时 | |------|------| | Install ffmpeg(apt-get update + 安装数百个编解码依赖)| **~24 分钟** | | pytest 单元测试本体 | 21-23 分钟 | 根因:CI job 每次在全新容器运行,但 `ci-base` 镜像未预装 ffmpeg,`step_install_ffmpeg.sh` 每次都现场 apt 安装 ffmpeg(带 x264/aom/systemd 等大量依赖)。 ## 修复 把 ffmpeg 预装到 ci-base 镜像(ci.Dockerfile)。`step_install_ffmpeg.sh` 检测到 ffmpeg 已存在会 `exit 0` 秒退,unit-tests 每次省约 24 分钟。 ## 生效条件 ci-base 镜像需重建并推送 registry 后才对新 job 生效。 ## 不改动 - pytest / 测试逻辑不动 - 其他镜像(api/web/worker)不动
xiaoxia added 1 commit 2026-08-31 23:55:13 +08:00
perf(ci): ci-base 镜像预装 ffmpeg——消除 unit-tests 每次 24min apt 安装
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 3s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 1s
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
AI Code Review / AI Code Review (pull_request) Successful in 2m27s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 2m41s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 2m40s
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
PR Automation / Auto Approve on CI Green (pull_request) Successful in 4m57s
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 1m5s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 1m42s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 4m59s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 5m6s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 7m35s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 8m15s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 16m23s
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 1s
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 5m15s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 5m16s
adcfc1e919
unit-tests job 跑在全新容器里,ci-base 镜像未预装 ffmpeg,
step_install_ffmpeg.sh 每次都 apt-get update + install ffmpeg,
ffmpeg 拉取 x264/aom/systemd 等数百个编解码依赖,固定耗时约 24 分钟,
pytest 本身 21-23 分钟,导致该 job 每次 45-50 分钟。

把 ffmpeg 预装到 ci-base 镜像后,step_install_ffmpeg.sh 检测到
ffmpeg 已存在会立即退出(exit 0),unit-tests 直接省掉 ~24 分钟。

注:ci-base 镜像需重建并推送 registry 后生效。
Collaborator

代码审查结果 - PR #1588

⚠️ 问题(0个需要修改)

💡 建议(0个可选)


格式检查通过 | 逻辑审查通过 | 性能无隐患


🤖 由 AI 代码审查机器人自动生成 | 2026-08-31 16:03:59 | 模型:

## 代码审查结果 - PR #1588 ### ⚠️ 问题(0个需要修改) ### 💡 建议(0个可选) --- ✅ 格式检查通过 | ✅ 逻辑审查通过 | ✅ 性能无隐患 --- <sub>🤖 由 AI 代码审查机器人自动生成 | 2026-08-31 16:03:59 | 模型: </sub> <!-- AI_CODE_REVIEW_AUTO_COMMENT -->

🚀 预览环境已部署

项目 详情
PR号 #1588
预览链接 https://pr-1588.preview.xiaoxiajianji.com
API环境 staging

💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。

🔄 每次提交新代码后预览环境会自动更新。

🗑️ PR 关闭或合并后,预览环境会自动清理。

🚀 **预览环境已部署** | 项目 | 详情 | |------|------| | PR号 | #1588 | | 预览链接 | [https://pr-1588.preview.xiaoxiajianji.com](https://pr-1588.preview.xiaoxiajianji.com) | | API环境 | staging | > 💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。 > > 🔄 每次提交新代码后预览环境会自动更新。 > > 🗑️ PR 关闭或合并后,预览环境会自动清理。
xiaoxia merged commit ea51a8af26 into develop 2026-09-01 00:32:54 +08:00

🗑️ 预览环境已清理

PR #1588 已关闭或合并,对应的预览环境已被清理。

如有需要,可以重新打开 PR 来重新生成预览环境。

🗑️ **预览环境已清理** PR #1588 已关闭或合并,对应的预览环境已被清理。 > 如有需要,可以重新打开 PR 来重新生成预览环境。
Sign in to join this conversation.