Krawla Architecture

The Krawla-landscape consists of many distributet workers. The workers communicate through rabbitmq. State and results are stored in a central postgres database. The config tool is used for centralised state-management and configuration.

Config Tool

- config tool (edit shop configuration, control-interface, qa-tools) - watchers (check state of craws, kill workers,…)

Controller

- controller-api (interface to start/stop shops) - rabbitmq (messaging-system)

DB-Host

- postgres

Downloaders

- workers + config-tool-workers