Skip to content

Local LLM Models #64

@jimmietron

Description

@jimmietron

This is a great keyboard app, and all your efforts are much appreciated!

If not too difficult to implement, this feature request is to integrate a small local LLM as an optional model that can be downloaded, such as the open source (open-weight) Google Gemma 4. This model is very fast on my Galaxy S24+ using their Edge Gallery app, and really good at proofreading, summarizing, and generating content, such as "Generate a lasagna recipe with a list of ingredients" or "Give me a thorough explanation of thunderstorms for a school project."

Is your feature request related to a problem? Please describe.
No

Describe the solution you'd like
Add Gemma 4 under the list of AI providers and allow either the E2B or E4B model to be downloaded, with a disclaimer that it will only work effectively on more recent flagship devices.

Use case
Many of the same AI features, such as proofreading, summarizing, re-writing content in different tones, generating content, etc., but all done privately and on device.

Describe alternatives you've considered (if any)
N/A

App version
3.7.6 Standard

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions