Skip to content

Add multimodal model training support in WeightsLab #270

Description

@guillaume-byte

Summary

Enable multimodal model training workflows in WeightsLab (e.g., mixed modality inputs such as image+text, or other multimodal combinations).

Scope

  • Add/extend data interfaces for multimodal batches.
  • Ensure trainer lifecycle supports modality-specific preprocessing/forward/metrics.
  • Support evaluation for multimodal models.
  • Provide at least one baseline multimodal config/example.

Acceptance Criteria

  • At least one multimodal training scenario runs successfully end-to-end.
  • Data pipeline and trainer correctly process mixed modality inputs.
  • Evaluation path works for multimodal models.
  • Minimal documentation/example is added.

Dependency

This issue is blocked by #198.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions