Skip to content

Fix "claiming" mechanism #10

@bwhall61

Description

@bwhall61

Right now when a worker gets a neighbor to score it sets the score to inf right away to "claim" it (stop other workers from scoring the same neighbor).

The issue:
If worker_timeout is too short the work can be reassigned to another worker. This worker will see the same neighbors and many could be "claimed" and will not be scored. This worker will then quickly submit its work results which will mark all of the neighbors as visited but their scores will still be inf. When the original worker finally finishes, it will submit its work results but since the neighbors are marked as visited, they will be skipped.

The fix for now:
Increase worker_timeout

The long term fix:
Add a separate redis hash for claimed neighbors being actively scored

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions