PyTaskDistributor is a task distributor for clusters. It is based on shared file system, e.g., NFS, Samba or Syncthing.
There are 3 main components in this distributor:
- Master: find Servers and distribute Jobs to each Server
- Server: run Jobs according to CPU usage
- Job: object generated by Master and done by Server