Skip to content

Implement invoke_model_with_response_stream #2

Description

@AAlvAAro

To be able to receive the LLMs response by chunks instead of a giant block of text, the invoke_model_from_response_stream AWS gem method needs to be implemented. See reference:

https://docs.aws.amazon.com/sdk-for-ruby/v3/api/Aws/BedrockRuntime/Client.html#invoke_model_with_response_stream-instance_method

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions