Skip to content

Recover the training recipe for the best LFM run (r32 encoder LoRA + FLEURS mix) #1

Description

@Awshesh12

The strongest result in the paper — LFM2.5-Audio + LoRA at 80.8% ScriptAcc / 27.0% MER (Table 5) — has no documented recipe. docs/asr-ft-training-log.md stops at Run 7 (lfm_lora_native_asr), which is a different configuration.

Right now that row is a measurement without a method, and it is the row the paper's constructive claim rests on.

What's needed

Recover and add to docs/asr-ft-training-log.md as a new run entry, matching the format of Runs 1–7:

  • LoRA config: rank, alpha, dropout, exact target modules for LM and Conformer encoder
  • Learning rates for both AdamW param groups, warmup, schedule
  • max_steps, batch size, and which checkpoint was selected
  • Data recipe: exact composition of the "FLEURS-balanced mix" — row counts per category, how much FLEURS was mixed in, and which split
  • Validation loss curve, and the W&B run ID if it exists

Where to look

  • W&B project lfm25-asr-lora-jp (entity awsheshnath708-lfm) — run history should still have the config
  • checkpoints/ on the training box
  • 03-training/asr-ft/run_r32.sh looks like the closest candidate script

Done when

docs/asr-ft-training-log.md has a Run 8 entry, and paper/main.tex §6 no longer carries the red TODO block.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    paper-blockerMust be resolved before the paper can be submittedtrainingFine-tuning recipes, ablations, hyperparameters

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions