AKI° is an Open Source document assistant designed to help comply with legal and regulatory requirements when working with sensitive documents. By running all AI processing locally, AKI° ensures that confidential files and prompts never leave your device—helping you avoid accidental data leaks and stay on the right side of the law (e.g., GDPR, attorney/client privilege, or other professional secrecy obligations).
This project uses Ollama to run large language models (LLMs) locally, ensuring your data never leaves your machine. Ollama is an open-source tool that lets you run and manage LLMs on your own device.
Phi-3 is a family of lightweight, high-performance language models developed by Microsoft. In this project, you can run Phi-3 locally using Ollama for private, fast, and secure AI-powered document management. Many other LLMs, both free and commercial, are also available.
| Tool | Version | Notes |
|---|---|---|
| Node.js | 20 LTS or later | |
| Yarn | 4.x (Berry) | Enabled via corepack enable |
| Ollama | latest | Runs the local LLM |
-
Clone the repository
git clone https://github.com/goldlabelapps/aki.git cd aki -
Install dependencies
corepack enable # activates Yarn 4 from package.json#packageManager yarn install
-
Install Ollama
- Download Ollama from https://ollama.com/download and install it for your OS (macOS, Windows, or Linux).
- Follow the installation instructions on the website.
-
Pull the Phi-3 model
ollama pull phi3
-
Start the Ollama server
ollama serve
-
(Optional) Run other models
You can also run other models, for example:
ollama run codellama
-
Start AKI°
This command starts the Ollama LLM server and loads the phi3 model:
yarn start
Note: The package.json includes scripts to start Ollama and run these models for convenience.
Simple cut+paste propmts to try. See if AKI° can give a sensible answer
Explain what machine learning weights which make LLM's work are in kindergarten terms
Wie könnten große Sprachmodelle deutschen Anwaltskanzleien bei der Recherche helfen?
What does the GDPR mean for a law firm in Europe that processes personal data?
What risks arise if companies send confidential files to a public AI service like ChatGPT?
Erkläre in einfachen Worten, was das Berufsgeheimnis für deutsche Rechtsanwälte bedeutet.
Explain in simple terms what professional secrecy means for UK lawyers.
What confidentiality obligations do firms have toward their clients?
See CONTRIBUTING.md for guidelines on how to get involved.
MIT — see LICENSE.