-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
Right now when a worker gets a neighbor to score it sets the score to inf right away to "claim" it (stop other workers from scoring the same neighbor).
The issue:
If worker_timeout is too short the work can be reassigned to another worker. This worker will see the same neighbors and many could be "claimed" and will not be scored. This worker will then quickly submit its work results which will mark all of the neighbors as visited but their scores will still be inf. When the original worker finally finishes, it will submit its work results but since the neighbors are marked as visited, they will be skipped.
The fix for now:
Increase worker_timeout
The long term fix:
Add a separate redis hash for claimed neighbors being actively scored
Metadata
Metadata
Assignees
Labels
No labels