Skip to content

fix: normalize multimodal calibration inputs - #3049

Merged
Qubitium merged 2 commits into
mainfrom
fix/multimodal-calibration-chat-inputs
Sep 3, 2026
Merged

fix: normalize multimodal calibration inputs#3049
Qubitium merged 2 commits into
mainfrom
fix/multimodal-calibration-chat-inputs

Conversation

@ZX-ModelCloud

Copy link
Copy Markdown
Collaborator

Summary

  • normalize raw text calibration samples into chat conversations before invoking multimodal processor chat templates
  • preserve existing structured multimodal conversations across supported VL and Omni model definitions
  • place captured input_ids on the materialized input embedding device to prevent CPU/CUDA mismatches during text-only calibration
  • add shared and Intern-S2 regression coverage

Validation

  • pytest tests/test_prepare_dataset.py -q
  • pytest tests/test_stage_inputs_capture.py tests/models/test_intern_s2_preview.py -q -k "not TestInternS2Preview"
  • targeted calibration-device tests
  • CUDA device-alignment smoke test
  • Ruff and compile checks

Fixes #3048

@Qubitium
Qubitium merged commit fee12a4 into main Sep 3, 2026
6 checks passed
@Qubitium
Qubitium deleted the fix/multimodal-calibration-chat-inputs branch September 3, 2026 09:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] 'str' object has no attribute 'get' when calling model.quantize() with a dataset column

2 participants