W2v2 - #2

Open

taylanbil wants to merge 22 commits into

Commits on Oct 6, 2020

Intermediate experiments wav2vec

ultrons
authored and
taylanbil
committed
7e6f3cf
input shape temp update

vaibhav singh
authored and
taylanbil
committed
6a03e5c
clean up

vaibhav singh
authored and
taylanbil
committed
433ca76

Commits on Oct 7, 2020

dataset updates

ultrons
authored and
taylanbil
committed
19535a2
clean up

ultrons
authored and
taylanbil
committed
a500587
move tensor idx to matrix op inside apply_mask

kevinmtian
authored and
taylanbil
committed
b49f103
use tensor operators to replace tensor indexing, passed consistency test verification

kevinmtian
authored and
taylanbil
committed
73e2f3b
Minor improvements
taylanbil
committed
8802a31
Fix bucketpadlendataset
taylanbil
committed
dc60592

Commits on Oct 13, 2020

Moved mask matrices creation to dataset prep.
taylanbil
committed
be3ca6a

Commits on Oct 15, 2020

Remove dynamism, apply mask correctly, add some guardrails, some cleanups.
taylanbil
committed
30f3761

Commits on Oct 19, 2020

Send device data to cpu b4 logging.
taylanbil
committed
af6d4d6

Commits on Oct 21, 2020

Commits on Oct 22, 2020

Remove extra validation atens, clean up marking step and sending to cpu.
taylanbil
committed
9b98663

Commits on Oct 23, 2020

Correct loss computation for w2v2 criterion + refactor index_put
taylanbil
committed
91cdca2

Commits on Oct 26, 2020

Fix bug in index_put + fix integer division
taylanbil
committed
2c59cec

Commits on Oct 27, 2020

Dont call float on extra logs, clean up comment.
taylanbil
committed
5565622

Commits on Nov 3, 2020

Commits on Nov 5, 2020

Remove sending log outputs back to cpu after allreduce.
taylanbil
committed
d844a2e

Commits on Nov 13, 2020

Dont sample padded states when sampling negatives + correct mi in loss computation.
taylanbil
committed
10fcd6c