This repository contains a Google Cloud Function designed to extract and process basketball game statistics from the ACB (Asociación de Clubes de Baloncesto).
- Targeted Scraping via BigQuery: The function queries an external BigQuery table to determine exactly which games are missing from the database, ensuring only the necessary data is fetched.
- Parallel Execution with Workflows: A
batchvariable is used to parallelize the calls to this Cloud Function via Google Cloud Workflows. The process calls the function in batches of 3, significantly speeding up the data extraction process. - Data Adaptation: Performs minor adaptations and formatting on the extracted variables (such as exact playing times, shooting percentages, and player types) to facilitate subsequent analysis of the ACB basketball league data.
- Automated Data Warehousing: The processed dataset is automatically appended to a centralized BigQuery table for further storage.
If you want to check the process and results as a project dashboard, you can access the following link: