Skip to content

feat: Add Electron desktop app with MLX Parakeet transcription - #25

Merged
johnnyhuy merged 3 commits into
mainfrom
feat/electron-desktop-app
Sep 3, 2026
Merged

feat: Add Electron desktop app with MLX Parakeet transcription#25
johnnyhuy merged 3 commits into
mainfrom
feat/electron-desktop-app

Conversation

@johnnyhuy

@johnnyhuy johnnyhuy commented May 1, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Electron + React + TypeScript desktop application for local and cloud transcription
  • Global hotkey recording (Cmd+Shift+Space default) β€” works from any app
  • Enhanced Model Manager with categories, speaker recognition, and download management
  • Local Models: MLX Parakeet, WhisperKit, Whisper C++, Apple Speech
  • Cloud Providers: OpenAI Whisper API, AssemblyAI (with speaker diarization)
  • Speaker Recognition: Badge indicators, speaker diarization display, separate speaker segments
  • Export Formats: TXT, SRT, VTT, JSON, CSV, PDF, Word
  • Copy to Clipboard: One-click copy with visual feedback
  • Meeting App Detection: Zoom, Teams, Webex, Skype, Discord, Chime
  • System Tray Integration: Menu bar access with quick record/stop
  • Auto-Paste: Automatically insert transcribed text into active application
  • Cloud API Key Management: Secure storage in settings

Model Categories

Category Description
Apple Speech On-device Apple Speech recognition
WhisperKit Greater accuracy, faster performance, real-time
Parakeet Nvidia Parakeet engine for accuracy and speed
Whisper C++ Lightweight C++ engine
Speaker Recognition Models that identify and separate speakers
Pro Advanced models for power users

Export Formats

  • TXT β€” Plain text
  • SRT β€” Subtitles with timestamps
  • VTT β€” Web video text tracks
  • JSON β€” Structured data with speakers
  • CSV β€” Spreadsheet format
  • PDF β€” Portable document
  • Word β€” Microsoft Word document

Architecture

  • Electron Main Process: Window, tray, hotkeys, IPC, recording, export
  • Electron Preload: Secure IPC bridge
  • React Frontend: Recording UI, model manager, settings, history, export dialog
  • Python Backend: MLX Parakeet (local), OpenAI/AssemblyAI (cloud)

Prerequisites

  • macOS 14+ with Apple Silicon (M1/M2/M3) for MLX
  • Python 3.9+ with parakeet-mlx, openai, assemblyai
  • Node.js 18+ and npm
  • sox/rec for audio recording (brew install sox)

How to Run

cd desktop
npm install
pip install parakeet-mlx openai assemblyai
npm run dev

Consequences

  • New desktop/ directory with full Electron application
  • No changes to existing Python CLI tool
  • Desktop app is optional/additional interface

Testing

  • Vite build passes successfully
  • TypeScript compilation passes
  • Electron app packages successfully for macOS

johnnyhuy added 3 commits May 1, 2026 21:21
- Electron + React + TypeScript desktop application
- Global hotkey recording (Cmd+Shift+Space default)
- Local transcription via MLX Parakeet models (on-device, private)
- Meeting app detection (Zoom, Teams, Webex, Skype, Discord, Chime)
- System tray integration with menu bar access
- Auto-paste transcribed text into active application
- Model manager for downloading different Parakeet variants
- Settings for hotkey, auto-paste, meeting detection
- Transcription history and waveform visualization
- Python backend scripts for model download and transcription
…xport formats

- Model manager with categories (WhisperKit, Parakeet, Whisper C++, Apple Speech)
- Speaker recognition support with badge indicators
- Cloud transcription providers (OpenAI, AssemblyAI)
- Export to TXT, SRT, VTT, JSON, CSV, PDF, Word formats
- Copy to clipboard with visual feedback
- Cloud provider API key management in settings
- Speaker diarization display in transcript view
- Pro/advanced model tier support
@socket-security

Copy link
Copy Markdown

Warning

Review the following alerts detected in dependencies.

According to your organization's Security Policy, it is recommended to resolve "Warn" alerts. Learn more about Socket for GitHub.

Action Severity Alert  (click "β–Ά" to expand/collapse)
Warn Critical
Critical CVE: npm shell-quote quote() does not escape newlines in object .op values

CVE: GHSA-w7jw-789q-3m8p shell-quote quote() does not escape newlines in object .op values (CRITICAL)

Affected versions: >= 1.1.0 < 1.8.4

Patched version: 1.8.4

From: desktop/package-lock.json β†’ npm/concurrently@9.2.1 β†’ npm/shell-quote@1.8.3

β„Ή Read more on: This package | This alert | What is a critical CVE?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Remove or replace dependencies that include known critical CVEs. Consumers can use dependency overrides or npm audit fix --force to remove vulnerable dependencies.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/shell-quote@1.8.3. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn Critical
Critical CVE: node-npm tar: Decompression/parse DoS via unlimited input

CVE: GHSA-23hp-3jrh-7fpw node-tar: Decompression/parse DoS via unlimited input (CRITICAL)

Affected versions: < 7.5.19

Patched version: 7.5.19

From: desktop/package-lock.json β†’ npm/electron-builder@26.8.1 β†’ npm/tar@7.5.13

β„Ή Read more on: This package | This alert | What is a critical CVE?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Remove or replace dependencies that include known critical CVEs. Consumers can use dependency overrides or npm audit fix --force to remove vulnerable dependencies.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/tar@7.5.13. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: npm brace-expansion is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: desktop/package-lock.json β†’ npm/electron-builder@26.8.1 β†’ npm/eslint@10.2.1 β†’ npm/typescript-eslint@8.59.1 β†’ npm/brace-expansion@5.0.5

β„Ή Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/brace-expansion@5.0.5. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: npm electron-winstaller is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: desktop/package-lock.json β†’ npm/electron-builder@26.8.1 β†’ npm/electron-winstaller@5.4.0

β„Ή Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/electron-winstaller@5.4.0. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: npm tar is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: desktop/package-lock.json β†’ npm/electron-builder@26.8.1 β†’ npm/tar@7.5.13

β„Ή Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/tar@7.5.13. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: npm tiny-async-pool is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: desktop/package-lock.json β†’ npm/electron-builder@26.8.1 β†’ npm/tiny-async-pool@1.3.0

β„Ή Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/tiny-async-pool@1.3.0. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

View full report

@johnnyhuy
johnnyhuy merged commit e87ba87 into main Sep 3, 2026
6 checks passed
@johnnyhuy
johnnyhuy deleted the feat/electron-desktop-app branch September 3, 2026 14:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant