Skip to content

Update ED to use Dynamic Inference Engine from MCore #693

@athitten

Description

@athitten

MCore is deprecating the static engine in favor of Dynamic Engine. Relevant PRs shared by @shanmugamr1992 : NVIDIA/Megatron-LM#4697, NVIDIA/Megatron-LM#4880.

Metadata

Metadata

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions