Robot Cell A · Work-cell camera
Check the cell before the robot moves
EdgeSentry watches the camera with OpenCV 5, confirms who is really inside the hazard zone, and takes the safe action: stop the robot, ask a supervisor, or keep monitoring.
1
See
OpenCV 5 compares each frame to the empty-cell reference, finds people, and tracks them across frames.
2
Verify
An intrusion only counts after 1.5 s inside the zone, and a worker is re-inspected up close before any stop.
3
Act
Evidence is stored, alerts go out, and a supervisor approves or stops each borderline entry.
Shift summary
▶ How EdgeSentry runs on AWS architecture
Perceive · OpenCV 5Clean-plate differencing, Otsu threshold, morphology, connected components, centroid tracking, zone polygon test.
Decide · Amazon BedrockA tool-using safety agent reads the scene report, re-inspects PPE up close, and chooses an action. Code guardrails veto unsafe or unproven actions; a fixed policy takes over if the model is unavailable.
Act · S3 + SNSEvery action stores an evidence frame in a private, encrypted S3 bucket. Stops and approval requests are published to an SNS alert topic.
Operate · Lambda + CloudWatchOne Lambda behind a Function URL. Per-run metrics (latency, steps, guardrail blocks, accuracy) via CloudWatch; X-Ray tracing; a DynamoDB daily cap protects the public demo.