GitHub - Condor2026/keltic_kraken: 🇮🇪🛡️🚨 Ireland Criminal Intelligence Platform - Monitoring crime- Analist

🇮🇪 Real-time monitoring of drug trafficking, gang violence & organized crime across all 32 counties 🇮🇪
180+ rotating User-Agents · Auto-URL discovery · Anti-blocking system · Interactive 3D Map

WHAT IS KELTIC KRAKEN?

KELTIC KRAKEN is an open source criminal intelligence platform specifically designed for Ireland. The system:

#	Action	Description
1	Scans	78+ Irish newspapers (national, regional and local)
2	Detects	News related to organized crime, drug trafficking and violence
3	Classifies	Each incident by type (drugs, murder, gang violence, etc.)
4	Geolocates	By county (Dublin, Cork, Galway, Belfast, etc.)
5	Visualizes	Interactive 3D Globe Map with popups
6	Analyzes	Generates statistics and interactive charts in real-time
7	Exports	Data in JSON, CSV or HTML for external analysis

🎯 Who is it for?

User	Benefit
Journalists	Consolidated source of criminal information
Researchers	Historical data for trend analysis
Criminologists	Material for academic studies
Security forces	Overview of criminal activity (ethical use)
Citizens	Situational awareness of their community
Developers	API and data for integrations

KEY FEATURES

🌍 Interactive 3D Map

Feature	Description
Globe View	Full 3D globe with all crime points
Fullscreen	Expand to full screen with one click
Auto-close Popups	Click another point to close previous popup
Clickable Titles	Click any crime title to open original source
100% Functional Buttons	All map controls work correctly
3000+ Points	Show up to 3000 crime points simultaneously
Color-coded	Each crime type has unique color

🔒 Anti-blocking

Feature	Value	Description
User-Agents	180+	Continuous rotation of browsers
Attempts	3	Retries per source before marking inactive
Delays	1.5-3.5s	Random waits between requests
Timeout	10s	Limit per request
Session	Persistent	Cookies and headers between requests
Retry	Automatic	Exponential backoff on failures

🔧 Self-repair

Feature	Description
Auto-discovery URLs	If a URL fails, automatically searches for the correct one
URL cache	Saves discovered URLs for future runs
Smart pagination	Automatically detects pagination patterns
Data repair	Fixes missing coordinates and colors automatically
Duplicate removal	Cleans duplicate entries

🖥️ Interface

Feature	Description
Terminal	Menu with 13 commands, colors and progress bars
Web dashboard	4 interactive charts (Chart.js)
3D Map	MapLibre GL with full interactive controls
Bilingual	Spanish and English fully supported
Responsive	Works on mobile, tablet and desktop

📊 Data

Feature	Value
Sources	78+ newspapers
Counties	32 (all Ireland)
Crime types	9 categories
Keywords	100+ search terms
Map Points	Up to 3000 simultaneous

📥 Export

Format	Use	Compatibility
JSON	Complete data	All applications
CSV	Spreadsheets	Excel, Google Sheets, LibreOffice
HTML	Professional report	Any browser

SYSTEM REQUIREMENTS

Minimum vs Recommended

Component	Minimum	Recommended
OS	Windows 10 / macOS 11 / Linux	Windows 11 / macOS 14 / Ubuntu 22.04
Python	3.8	3.11+
RAM	1 GB	2 GB
Storage	200 MB	1 GB
Internet	5 Mbps	20 Mbps
GPU	Integrated	Dedicated (for 3D map)

Verify Python

# Linux / Mac
python3 --version

# Windows
python --version

If you don't have Python: Download Python 3.11+

STEP-BY-STEP INSTALLATION

🐧 Linux / 🍎 Mac

# STEP 1: Clone the repository
git clone https://github.com/Condor2026/keltic-kraken
cd keltic-kraken

# STEP 2: Create virtual environment
python3 -m venv venv
source venv/bin/activate

# STEP 3: Install dependencies
pip install --upgrade pip
pip install -r requirements.txt

# STEP 4: Verify installation
python3 -c "import requests, bs4, flask, maplibregl; print('✅ Everything correct')"

# STEP 5: Run
python3 keltic_kraken.py

🪟 Windows

# STEP 1: Clone the repository
git clone https://github.com/Condor2026/keltic-kraken
cd keltic-kraken

# STEP 2: Create virtual environment
python -m venv venv
venv\Scripts\activate

# STEP 3: Install dependencies
pip install --upgrade pip
pip install -r requirements.txt

# STEP 4: Verify installation
python -c "import requests, bs4, flask; print('✅ Everything correct')"

# STEP 5: Run
python keltic_kraken.py

🐳 Docker

# Build image
docker build -t keltic-kraken:v4.1 .

# Run container
docker run -p 5019:5019 keltic-kraken:v4.1

# Or with docker-compose
docker-compose up -d

FIRST USE - QUICK GUIDE

When running for the FIRST TIME, follow these steps:

1️⃣ Choose execution mode

┌────────────────────────────────────────────────────┐
│  How do you want to run?                          │
├────────────────────────────────────────────────────┤
│  [1] Terminal Mode (recommended for analysis)     │
│  [2] Web Mode (dashboard with 3D map)             │
└────────────────────────────────────────────────────┘
➤ Choose: 1

2️⃣ VERIFY SOURCES (MANDATORY)

➤ Option: 8

What it does:

✅ Verifies all 78+ sources one by one
✅ Marks active those that work
❌ Marks inactive those that fail
🔍 Applies auto-discovery to dead URLs
💾 Saves discovered URLs in cache

Expected result:

📊 RESULTS:
   Active sources: 68 out of 78
   Auto-discovery applied: 12 URLs found
   Cache saved for future runs

3️⃣ SEARCH FOR CRIMES

➤ Option: 1

What it does:

Scans all active sources
Searches for crime-related keywords
Extracts titles, dates and locations
Classifies by crime type
Saves to local database

You will see:

🔪 KELTIC KRAKEN - SCANNING IRELAND
================================================================================
📰 Irish Times (1/68)
   📍 County: Dublin
   📄 Page 1... ✓ 24 found
   📄 Page 2... ✓ 18 found
   📊 Total in this source: 42 incidents

4️⃣ VIEW RESULTS

➤ Option: 6

📰 LATEST 20 INCIDENTS
================================================================================
 1. Man arrested after €500k cocaine seizure in Dublin
      📅 2026-06-12 | 📍 Dublin | 📰 Irish Times | 💀 Severidad: 8/10

 2. Two charged over Kinahan-linked shooting in Cork
      📅 2026-06-11 | 📍 Cork | 📰 Irish Examiner | 💀 Severidad: 9/10

 3. Gardaí launch operation after body found in Galway
      📅 2026-06-11 | 📍 Galway | 📰 RTÉ | 💀 Severidad: 10/10

5️⃣ (OPTIONAL) WEB DASHBOARD WITH 3D MAP

➤ Option: 5

Open browser: http://localhost:5019

TERMINAL MENU COMMANDS

Option	Command	What it does	When
1	🔍 Search crimes	Scans all active sources	Daily
2	📊 Complete analysis	Shows detailed statistics	Post-search
3	🔗 Patterns	Detects criminal concentrations	Weekly
4	📈 Evolution	Temporal trend chart	Monthly
5	🌐 Web server	Starts dashboard on localhost	On demand
6	📰 Latest 20	Lists recent incidents	Quick
7	📥 Export	Saves to JSON/CSV/HTML	To share
8	🔍 Verify	Updates source status	Weekly
9	📊 Distribution	Percentages by type	Post-search
10	📈 Advanced	Metrics like density, trend	Deep analysis
11	🧹 Clean	Removes duplicates	If you notice repetitions
12	🔧 Repair Data	Fixes missing coordinates/colors	If map doesn't show points
13	🗑️ Exit	Closes the application	When finished

📋 Daily flow example

# Monday 9:00 AM
➤ 8    # Verify sources
➤ 1    # Search for new crimes
➤ 6    # View latest incidents
➤ 2    # View statistics
➤ 5    # (optional) Open web dashboard with 3D map

WEB DASHBOARD

When you run Option 5, a web server starts at http://localhost:5019

🌍 Interactive 3D Map

Feature	Description
Globe View	Full 3D globe showing all crime points
Color-coded Points	Each crime type has unique color
Clustering	Groups nearby points for clarity
Click Popups	Shows crime details with source link
Fullscreen	Expand map to full screen
Auto-rotate	Automatically rotates globe
Reset View	Returns to default view
3D Toggle	Switch between 2D and 3D views

🎨 Point Colors by Crime Type

Crime Type	Color	Icon
Drug Trafficking	🔴 `#ff0000`	💊
Gang Violence	🟥 `#ff4444`	🔫
Murder/Homicide	⬛ `#000000`	💀
Assault	🟧 `#ff8c00`	👊
Robbery/Theft	🟨 `#ffd700`	💰
Organized Crime	🟪 `#800080`	🕴️
Garda Operation	🟦 `#0066cc`	👮
Weapon Offense	🟥 `#990000`	🔪
Other Crime	⬜ `#666666`	❓

📊 Chart 1: Incidents by County (Bars)

Element	Description
Type	Vertical bar chart
Data	Incidents per county
Interaction	Hover to see exact numbers
Utility	Identify hotspots

🥧 Chart 2: Crime Types (Donut)

Type	Color	Description
💊 Drugs	Dark red	Drug trafficking, seizures, smuggling
🔫 Gang Violence	Red	Gang violence (Kinahan, Hutch)
💀 Murder	Black	Murders and homicides
👮 Garda Op	Blue	Police operations
👊 Assault	Orange	Assaults
💰 Robbery	Yellow	Robberies and thefts
🕴️ Org Crime	Purple	Organized crime
🔪 Weapon	Maroon	Weapons offenses
❓ Other	Gray	Other types

📈 Chart 3: Monthly Trend (Line)

Element	Description
Type	Line chart with fill
Data	Month by month evolution
Trend	Goes up/down visually
Utility	Detect seasonal patterns

📊 Chart 4: Top Sources (Horizontal bars)

Element	Description
Type	Horizontal bars
Data	Most active newspapers
Order	From highest to lowest
Utility	Identify most informative sources

📋 Incident list

Each card shows:

Full title of the news
Date of publication
County where it occurred
Source (newspaper)
Crime type with color
Severity level (1-10)
URL link to original source

🎛️ Web controls

Button	Function
🔄 UPDATE DATA	Scans sources and updates
📥 JSON	Downloads data in JSON
📥 CSV	Downloads in CSV (Excel)
📄 HTML REPORT	Generates professional report
ALL	All incidents
7D	Last 7 days
30D	Last 30 days
90D	Last 90 days

GEOGRAPHIC COVERAGE

Republic of Ireland (26 counties)

County	Sources	Main media
Dublin	7	Irish Times, Irish Independent, RTÉ, Dublin Live
Cork	5	Irish Examiner, Cork Beo, Cork Independent
Galway	4	Galway Beo, Galway Advertiser, Connacht Tribune
Limerick	4	Limerick Leader, Limerick Post
Kerry	4	Kerryman, Radio Kerry
Donegal	4	Donegal Daily, Donegal News
Mayo	4	Mayo News, Connaught Telegraph
Wexford	4	Wexford People, Wexford Echo
Kildare	4	Kildare Now, KFM Radio
Tipperary	4	Tipperary Live, Tipp FM
Louth	4	Louth Live, LMFM
Waterford	3	Waterford News, Waterford Live
Clare	4	Clare Champion, Clare FM
Sligo	3	Sligo Champion, Ocean FM
Rest	2-3	Local media

Northern Ireland (6 counties)

County	Sources	Main media
Antrim (Belfast)	5	Belfast Telegraph, Irish News, Belfast Live
Derry/Londonderry	3	Derry Journal, Derry Now
Down	2	Down Recorder, Newry Reporter
Tyrone	2	Tyrone Times, Ulster Herald
Armagh	2	Armagh I, Lurgan Mail
Fermanagh	2	Fermanagh Herald, Impartial Reporter

📊 Totals

Region	Counties	Sources
Republic of Ireland	26	~62
Northern Ireland	6	~16
TOTAL	32	78+

PROJECT STRUCTURE

keltic-kraken/
│
├── 📄 keltic_kraken.py          # Main script (3000+ lines)
├── 📄 requirements.txt          # Python dependencies
├── 📄 README.md                 # This document
├── 📄 LICENSE                   # GPL v3
├── 📄 CHANGELOG.md              # Version history
├── 📄 CODE_OF_CONDUCT.md        # Community guidelines
├── 📄 LEGAL_ETHICAL_NOTICE.md   # Legal and ethical notice
├── 📄 Dockerfile                # Docker configuration
├── 📄 docker-compose.yml        # Docker Compose configuration
├── 📄 .gitignore                # Git ignore file
├── 📄 install.sh                # Linux/Mac installer
├── 📄 install.bat               # Windows installer
├── 📄 env.example               # Environment variables example
│
├── 📊 keltic_kraken_ireland.json   # Incidents database
├── 💾 keltic_kraken_backup.json    # Automatic backup
├── 🗺️ url_cache_ireland.json       # Discovered URLs cache
├── 📡 estado_fuentes_ireland.json  # Source status
│
├── 📤 keltic_kraken_export.json    # Manual export (JSON)
├── 📤 keltic_kraken_export.csv     # Manual export (CSV)
├── 📤 keltic_kraken_report.html    # Manual export (HTML)
│
├── 📁 docs/                         # Extra documentation
│   ├── usage.md
│   ├── api.md
│   └── screenshots/
│
└── 📁 images/                       # Images and assets
    └── kraken_imagen.jpg

Automatically generated files

File	When	What it contains
`keltic_kraken_ireland.json`	1st run	All incidents
`url_cache_ireland.json`	Auto-discovery	Alternative URLs
`estado_fuentes_ireland.json`	Option 8	Active/inactive status
`keltic_kraken_backup.json`	Each save	Backup copy

TROUBLESHOOTING

Error: "Module not found"

pip install -r requirements.txt

Error: "Connection timeout"

Check your internet connection
Increase timeout in code (line 180)
Some sources may be temporarily down

Error: "No data found"

Run Option 8 first (verify sources)
Wait for the complete scan to finish
Verify you have active sources

Error: "Map points not showing"

Run Option 12 (Repair Data)
This fixes missing coordinates and colors
Then restart the web server

Error: "Port 5019 already in use"

# Change port in code or kill the process
# Linux/Mac
lsof -ti:5019 | xargs kill -9

# Windows
netstat -ano | findstr :5019
taskkill /PID <PID> /F

Dashboard doesn't load

Make sure Flask is installed
Check that no firewalls are blocking
Try with http://127.0.0.1:5019

FREQUENTLY ASKED QUESTIONS

❓ Is this legal?

Yes. The system:

Only accesses public data
Respects delays between requests
Does not overload servers
Does not violate security measures
Only uses public sections of newspapers

❓ Can I use this for another country?

The system is designed for Ireland, but can be adapted:

Change FUENTES_BASE (list of newspapers)
Change PALABRAS_CLAVE_CRIMEN (local terms)
Change COORDENADAS_CONDADOS (for country regions)
Change TIPOS_CRIMEN (local categories)

❓ Where is the data saved?

In keltic_kraken_ireland.json (readable JSON format)

❓ Can I export the data?

Yes, three formats:

➤ 7 → Exports to JSON, CSV and HTML
📥 JSON button on web
📥 CSV button on web
📄 HTML REPORT button on web

❓ Does it consume many resources?

No. Typical usage:

RAM: ~300-600 MB
CPU: ~10-20% during scraping
Storage: ~10-50 MB per month of data

❓ Is there mobile support?

Yes. The web dashboard is responsive and works on:

iPhone (iOS)
Android
Tablet
iPad

❓ How often should I run it?

Daily: To keep data updated
Weekly: For trend analysis
Monthly: For complete reports

❓ Can I automate the runs?

Yes. Use cron (Linux/Mac) or Task Scheduler (Windows):

# Cron - run daily at 9 AM
0 9 * * * cd /path/keltic-kraken && python3 keltic_kraken.py --auto

LICENSE

GNU General Public License v3.0

Copyright (C) 2026 Condor2026 / SpectrumSecurity

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program. If not, see <https://www.gnu.org/licenses/>.

🔒 Permissions

Action	Allowed
✅ Commercial use	Yes
✅ Modification	Yes
✅ Distribution	Yes
✅ Private use	Yes
❌ Liability	No
❌ Warranty	No

AUTHOR

Condor2026 · SpectrumSecurity

🇮🇪 "With great power comes great responsibility" 🇮🇪
KELTIC KRAKEN v4.1 - Monitoring Ireland's criminal landscape

📝 CAMBIOS PRINCIPALES:

Elemento	v3.0	v4.1
Versión	3.0	4.1
Badges	24	28
Líneas de código	2,250	3,000+
User-Agents	150+	180+
Fuentes	85+	78+
Puerto	5014	5019
Mapa	No	Sí (3D Globe)
Menú	12 opciones	13 opciones
Popups	No	Sí (autocerrantes)
Fullscreen	No	Sí
Reparación datos	No	Sí (opción 12)

🦅 - Condor2026 Threat Security - 🦅

Name		Name	Last commit message	Last commit date
Latest commit History 114 Commits
.gitignore		.gitignore
CHANGELOG.md		CHANGELOG.md
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
LEGAL_ETHICAL_NOTICE.md		LEGAL_ETHICAL_NOTICE.md
LICENSE		LICENSE
README.md		README.md
docker-compose.yml		docker-compose.yml
env.example		env.example
images		images
install.bat		install.bat
install.sh		install.sh
keltic_kraken.py		keltic_kraken.py
kraken_imagen.jpg		kraken_imagen.jpg
requirements.txt		requirements.txt

Folders and files

Latest commit

History

Repository files navigation

📋 TABLE OF CONTENTS

WHAT IS KELTIC KRAKEN?

🎯 Who is it for?

KEY FEATURES

🌍 Interactive 3D Map

🔒 Anti-blocking

🔧 Self-repair

🖥️ Interface

📊 Data

📥 Export

SYSTEM REQUIREMENTS

Minimum vs Recommended

Verify Python

STEP-BY-STEP INSTALLATION

🐧 Linux / 🍎 Mac

🪟 Windows

🐳 Docker

FIRST USE - QUICK GUIDE

1️⃣ Choose execution mode

2️⃣ VERIFY SOURCES (MANDATORY)

3️⃣ SEARCH FOR CRIMES

4️⃣ VIEW RESULTS

5️⃣ (OPTIONAL) WEB DASHBOARD WITH 3D MAP

TERMINAL MENU COMMANDS

📋 Daily flow example

WEB DASHBOARD

🌍 Interactive 3D Map

🎨 Point Colors by Crime Type

📊 Chart 1: Incidents by County (Bars)

🥧 Chart 2: Crime Types (Donut)

📈 Chart 3: Monthly Trend (Line)

📊 Chart 4: Top Sources (Horizontal bars)

📋 Incident list

🎛️ Web controls

GEOGRAPHIC COVERAGE

Republic of Ireland (26 counties)

Northern Ireland (6 counties)

📊 Totals

PROJECT STRUCTURE

Automatically generated files

TROUBLESHOOTING

Error: "Module not found"

Error: "Connection timeout"

Error: "No data found"

Error: "Map points not showing"

Error: "Port 5019 already in use"

Dashboard doesn't load

FREQUENTLY ASKED QUESTIONS

❓ Is this legal?

❓ Can I use this for another country?

❓ Where is the data saved?

❓ Can I export the data?

❓ Does it consume many resources?

❓ Is there mobile support?

❓ How often should I run it?

❓ Can I automate the runs?

LICENSE

🔒 Permissions

AUTHOR

📝 CAMBIOS PRINCIPALES:

About

Topics

Resources

Code of conduct

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages