domverse/photoanalyzer
1
0
Fork 0
Code Issues 5 Pull Requests Actions Packages Projects 1 Releases Wiki Activity

US02-03 — Execute Jobs with Leases, Locks, and Recovery #10

New Issue
Closed
opened 2026-07-13 13:10:40 +02:00 by domverse · 3 comments
domverse commented 2026-07-13 13:10:40 +02:00
Owner
Copy Link

Source specification: delivery_backlog/stories/US02-03-worker-recovery.md

US02-03 — Execute Jobs with Leases, Locks, and Recovery

Epic: E02

As an operator, I want workers to claim, cancel, and recover jobs safely so crashes or
duplicate workers cannot corrupt state.

Acceptance criteria

  • Workers use leases, heartbeats, fencing tokens, bounded queues, and typed lanes.
  • Cancellation is cooperative and leaves resumable or terminal item states.
  • Lock ordering prevents conflicting analysis, EXIF, rename, upload, and archive work.
  • A recovered job rejects late commits from its former worker.

Automated tests

  • Process tests kill workers, expire leases, recover jobs, and attempt stale commits.
  • Randomized concurrency tests assert no deadlocks, duplicate completion, or lost events.

Dependencies

  • US02-02
Source specification: [delivery_backlog/stories/US02-03-worker-recovery.md](https://git.domverse-berlin.eu/domverse/photoanalyzer/src/branch/main/delivery_backlog/stories/US02-03-worker-recovery.md) # US02-03 — Execute Jobs with Leases, Locks, and Recovery Epic: [E02](https://git.domverse-berlin.eu/domverse/photoanalyzer/src/branch/main/delivery_backlog/E02-unified-workflow-shell.md) As an operator, I want workers to claim, cancel, and recover jobs safely so crashes or duplicate workers cannot corrupt state. ## Acceptance criteria - Workers use leases, heartbeats, fencing tokens, bounded queues, and typed lanes. - Cancellation is cooperative and leaves resumable or terminal item states. - Lock ordering prevents conflicting analysis, EXIF, rename, upload, and archive work. - A recovered job rejects late commits from its former worker. ## Automated tests - Process tests kill workers, expire leases, recover jobs, and attempt stale commits. - Randomized concurrency tests assert no deadlocks, duplicate completion, or lost events. ## Dependencies - US02-02
domverse added this to the E02 — Unified Workflow Shell milestone 2026-07-13 13:10:40 +02:00
domverse added the area/backendtype/featurepriority/normal labels 2026-07-13 13:10:40 +02:00
domverse added a new dependency 2026-07-13 13:11:17 +02:00
#9 US02-02 — Persist and Coordinate Durable Jobs
domverse added a new dependency 2026-07-13 13:11:18 +02:00
#11 US02-04 — Expose Job APIs and Activity Events
domverse added a new dependency 2026-07-13 13:11:20 +02:00
#14 US02-07 — Automate Phase B End-to-End Acceptance
domverse added this to the Photo Analyzer Delivery project 2026-07-13 13:19:44 +02:00
domverse added the status/backlog label 2026-07-13 13:52:46 +02:00
domverse added status/in-progress and removed status/backlog labels 2026-07-15 23:03:22 +02:00
domverse self-assigned this 2026-07-15 23:03:22 +02:00
domverse commented 2026-07-15 23:03:23 +02:00
Author
Owner
Copy Link

Claimed for implementation on branch us/US02-03-execute-jobs-with-leases-locks-and-recovery.

Claimed for implementation on branch `us/US02-03-execute-jobs-with-leases-locks-and-recovery`.
domverse added status/review and removed status/in-progress labels 2026-07-15 23:13:08 +02:00
domverse commented 2026-07-15 23:13:08 +02:00
Author
Owner
Copy Link

Submitted for review: #56

Tests passed:

  • work_item/scripts/python -m unittest discover -s work_item/tests -v
  • work_item/scripts/python -m pytest tests -q
  • work_item/scripts/python -m pytest tests/unit tests/integration tests/e2e -q
Submitted for review: https://git.domverse-berlin.eu/domverse/photoanalyzer/pulls/56 Tests passed: - `work_item/scripts/python -m unittest discover -s work_item/tests -v` - `work_item/scripts/python -m pytest tests -q` - `work_item/scripts/python -m pytest tests/unit tests/integration tests/e2e -q`
domverse added status/done and removed status/review labels 2026-07-15 23:13:28 +02:00
domverse commented 2026-07-15 23:13:29 +02:00
Author
Owner
Copy Link

Completed and merged via PR #56.

Completed and merged via PR #56.
domverse moved this to Done in Photo Analyzer Delivery on 2026-08-16 11:58:16 +02:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
area/backend
Backend services, jobs, or API
 area/database
Schema, persistence, migration, or queries
 area/filesystem
Filesystem identity, mutation, or storage
 area/frontend
Browser UI and client-side application
 area/integration
External tools or provider integrations
 area/testing
Automated test suites, fixtures, and tooling
 priority/critical
Release-blocking safety or correctness
 priority/high
Important phase outcome
 priority/normal
Normal planned work
 status/backlog
Awaiting dependency eligibility or prioritization
 status/blocked
Cannot proceed without an explicit resolution
 status/done
Merged, tested, and completed
 status/in-progress
Currently being implemented
 status/ready
Eligible to be claimed
 status/review
Submitted in a pull request for review
 type/feature
User-facing or domain capability
 type/hardening
Security, resilience, operations, or release hardening
 type/migration
Donor extraction, migration, or legacy consolidation
 type/test
Automated test infrastructure or acceptance coverage
No Label area/backend priority/normal status/done type/feature
Milestone
No items
No Milestone E02 — Unified Workflow Shell
Projects
Clear projects
No project Photo Analyzer Delivery
Assignees
Clear assignees
domverse
No Assignees domverse
1 Participants
Notifications
Due Date
No due date set.
Blocks
#11 US02-04 — Expose Job APIs and Activity Events
domverse/photoanalyzer
#14 US02-07 — Automate Phase B End-to-End Acceptance
domverse/photoanalyzer
Depends on
#9 US02-02 — Persist and Coordinate Durable Jobs
domverse/photoanalyzer
Reference: domverse/photoanalyzer#10
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?