You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
chore(ci): improve visual regression test time - #486
Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 10 remain after this review.
Walkthrough
The change updates visual test runner lifecycle and execution settings across several projects. It also consolidates Monaco visual fixtures and adds a separate dark-theme visual test.
The visual test config selects VisualTestRunner. The runner adds worker cleanup, pool-specific instance IDs, and report-collection control. The Playwright runner recursively creates the distribution directory. The setup opens the runner in beforeAll, and .gitignore excludes .visual/port-* paths.
Visual test execution settings projects/core/vitest.visual.ts, projects/media/vitest.visual.ts, projects/viewport/vitest.visual.ts, projects/monaco/vitest.visual.ts
The configurations enable file parallelism, set a two-worker limit and a concurrency limit of one. Monaco’s include pattern now matches src/index*.test.visual.ts.
The Monaco tests use shared fixture templates and readiness checks for light and dark themes. The dark-theme test checks that the maximum visual difference is at most 5%.
sequenceDiagram
participant Vitest
participant VisualTestRunner
participant VisualRunner
participant VitePlaywrightRunner
Vitest->>VisualTestRunner: run files
VisualTestRunner->>VisualRunner: close during worker cleanup
VisualRunner->>VitePlaywrightRunner: close with collectReports false
Loading
Possibly related PRs
NVIDIA/elements#479: Changes Lighthouse and Playwright runner performance and concurrency, which intersects with this PR’s runner lifecycle and port handling.
NVIDIA/elements#449: Changes the shared VitePlaywrightRunner lifecycle and concurrency infrastructure.
NVIDIA/elements#475: Changes the VitePlaywrightRunner.open() startup path that this PR also updates.
No merge-blocking issue was established. Run the normal visual checks before merging.
Pre-merge checks: 4
Check name
Status
Explanation
Description Check
Check skipped - CodeRabbit’s high-level summary is enabled.
Title check
The title clearly and concisely describes the main changes, which improve visual regression test performance through parallelism and runner updates.
Linked Issues check
Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check
Check skipped because no linked issues were found for this pull request.
Finishing Touches
📝 Generate docstrings
Commit to this branch
Create a new PR
🧪 Generate unit tests (beta)
Commit to this branch
Create a new PR
Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts
Warning
Some tools did not complete. Review the errors below.
ESLint
If the error stems from missing dependencies, add them to the package.json file. For unrecoverable errors (e.g., due to private dependencies), disable the tool in the CodeRabbit configuration.
projects/core/vitest.visual.ts
ESLint skipped: missing config or dependency (missing-dependency). The ESLint configuration references a package that is not available in the sandbox.
projects/media/vitest.visual.ts
ESLint skipped: missing config or dependency (missing-dependency). The ESLint configuration references a package that is not available in the sandbox.
projects/monaco/src/fixtures.test.visual.ts
ESLint skipped: missing config or dependency (missing-dependency). The ESLint configuration references a package that is not available in the sandbox.
4 others
Comment @coderabbitai help to get the list of available commands.
ℹ️ Calculations represent line coverage. Results may change as calculations are updated.
This branch has not been deployed
No deployments
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary by CodeRabbit