Picalike Dokuwiki Archive

The Krawla-landscape consists of many distributet workers. The workers communicate through rabbitmq. State and results are stored in a central postgres database. The config tool is used for centralised state-management and configuration.

- config tool (edit shop configuration, control-interface, qa-tools) - watchers (check state of craws, kill workers,…)

- controller-api (interface to start/stop shops) - rabbitmq (messaging-system)

- postgres

- workers + config-tool-workers