Latest Test Report¶

Report ID: 2025-01-06-main Generated: 2025-01-06 at 02:30 UTC Branch: main Commit: 13343da

Summary¶

Metric	Value	Status
Total Tests	1,247	✅
Passed	1,245	✅
Failed	2	⚠️
Skipped	0	✅
Coverage	87.3%	✅
Duration	4m 32s	✅

Coverage Report¶

Overall Coverage¶

Name                                              Stmts   Miss  Cover
---------------------------------------------------------------------
backend/app/                                       4523    572   87.3%
  core/                                             623     25   96.0%
  domains/                                         1823    255   86.0%
  modules/                                         1204    208   82.7%
  infrastructure/                                   873     84   90.4%
---------------------------------------------------------------------
TOTAL                                             4523    572   87.3%

Coverage by Component¶

Core Components¶

app/core/config.py - 100% coverage
app/core/security.py - 95% coverage
app/core/jwt.py - 94% coverage
app/core/middleware.py - 93% coverage

Domains¶

environments - 88% coverage
sites - 86% coverage
wordpress - 84% coverage
backups - 85% coverage
domains_management - 82% coverage

Modules¶

auth - 92% coverage
users - 88% coverage
teams - 86% coverage
rbac - 84% coverage

Test Results by Category¶

Unit Tests¶

tests/unit/ ............... 1,023 tests, 1,022 passed, 1 failed
Duration: 2m 15s
Coverage: 87.3%

Integration Tests¶

tests/integration/ ........ 189 tests, 189 passed
Duration: 1m 45s
Coverage: 72.1%

E2E Tests¶

tests/e2e/ ............... 35 tests, 34 passed, 1 failed
Duration: 32s
Coverage: N/A

Failed Tests¶

Test 1: Unit Test Failure¶

File: tests/unit/domains/test_environments_service.py Test: test_environment_creation_with_invalid_domain Error:

AssertionError: Expected ValidationError but got ValueError
  File "test_environments_service.py", line 245

Status: Open - Assigned to @backend-team

Test 2: E2E Test Failure¶

File: tests/e2e/test_site_deployment.py Test: test_site_deployment_full_workflow Error:

TimeoutError: Site deployment exceeded 300s timeout
  File "test_site_deployment.py", line 89

Status: Known Issue - Flaky test, retry passes

Mutation Testing Results¶

Security-Critical Files¶

app/core/jwt.py .......... Score: 94% (Target: 90%) ✅
app/core/security.py ..... Score: 92% (Target: 90%) ✅
app/core/auth.py ......... Score: 89% (Target: 85%) ✅

Overall Mutation Score¶

Total Mutations: 1,523
Killed: 1,347 (88.5%)
Survived: 156 (10.2%)
Timeout: 20 (1.3%)

Performance Metrics¶

Test Execution Time¶

Fastest Test: 0.01s
Median Test: 0.15s
Slowest Test: 8.2s (tests/integration/test_backup_restore.py::test_full_restore)

Slow Tests (> 3s)¶

test_full_restore - 8.2s
test_site_clone_workflow - 5.7s
test_wp_install_with_plugins - 4.3s
test_domain_ssl_provisioning - 3.8s
test_environment_state_machine - 3.2s

Quality Gates¶

Gate Results¶

Gate	Requirement	Actual	Status
Coverage	≥ 85%	87.3%	✅ PASS
Core Coverage	≥ 95%	96.0%	✅ PASS
Mutation Score	≥ 80%	88.5%	✅ PASS
Security Mutation	≥ 90%	92.0%	✅ PASS
Failed Tests	0	2	⚠️ WARNING

Overall Status¶

⚠️ WARNING - Coverage and mutation gates passed, but 2 tests failed

Recommendations¶

Immediate Actions¶

Fix failing unit test in test_environments_service.py
Investigate flaky E2E test in test_site_deployment.py

Coverage Improvements¶

Add tests for domains_management (currently 82%)
Improve error path coverage in sites domain
Add edge case tests for backup restoration

Performance Improvements¶

Optimize slow integration tests (particularly test_full_restore)
Consider parallel test execution for faster feedback

Historical Comparison¶

vs Previous Report (2025-01-05)¶

Metric	Previous	Current	Change
Coverage	86.8%	87.3%	+0.5%
Mutation Score	87.2%	88.5%	+1.3%
Test Count	1,240	1,247	+7
Duration	4m 45s	4m 32s	-13s

Metadata¶

Report Details¶

{
  "report_id": "2025-01-06-main",
  "generated_at": "2025-01-06T02:30:00Z",
  "branch": "main",
  "commit": "13343da",
  "trigger": "push_to_main",
  "pipeline_url": "https://github.com/mbpanel/mbpanelapi/actions/1234"
}

Archive¶

View All Reports - Historical test reports archive.