The Krawla-landscape consists of many distributet workers. The workers communicate through rabbitmq. State and results are stored in a central postgres database. The config tool is used for centralised state-management and configuration.
- config tool (edit shop configuration, control-interface, qa-tools) - watchers (check state of craws, kill workers,…)
- controller-api (interface to start/stop shops) - rabbitmq (messaging-system)
- postgres
- workers + config-tool-workers