7B模型的vllm推理支持 #77

Open

opened

on Nov 15, 2024

你好，请问目前7b模型有办法使用vllm进行推理吗，如果不行的话目前有什么障碍

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests