📥 Protepto Job Statistics Collector (PJSC)

Harness the power of the Arbeitsamt.

❔ Introduction

The job statistics collector is a tool which uses the API of the German Federal Employment Agency or "Budesagentur für Arbeit".
It is able to collect data from the API and save them to a MySQL or MariaDB database for further statistical analysis.
The goal of the entire Protepto Job Statistics Project is to collect data and follow trends in the German job market.

📦 Build

Use Python 3 with hatchling to build from source.

Install dependencies

pip install -r requirements.txt

Build the job-statistics-collector package

python3 -m build

💾 Install

Go to the releases tab and download the newest .whl file.
Then install using

pip install job_statistics_collector-*-py3-none-any.whl

or if you prefer to install from source:

Install the package after bulding

pip install dist/*.whl

▶️ Run

Make sure that you have deployed a MySQL or MariaDB instance.

A development/testing instance in form of a docker-compose file is available at ./infrastructure.
Use the following command to deploy locally, but do not use in production.

docker-compose -f infrastructure/docker-compose.yaml up -d

Run the job statistics collector using

python3 -m job_statistics_collector

For further help use

python3 -m job_statistics_collector --help