# AI Extraction Human Review SOP Template > Source: https://netray.co/tools/extraction-human-review-sop-template > Publisher: Netray (netray.co), AI and integration engineering for ERP and manufacturing systems. > Section: Free Tools ## Short answer A fill-in SOP for human-in-the-loop review of OCR and AI extraction, with thresholds, roles, sampling and escalation. ## Category ai-automation ## Industry Aerospace & Defense ## Audience - AP manager - Quality manager - Internal audit ## Tool **Kind:** template **Output:** document **Fields:** #### Company **Key:** company **Type:** text **Default:** Acme Precision Ltd #### SOP number **Key:** sop_no **Type:** text **Default:** FIN-0207 #### Revision **Key:** rev **Type:** text **Default:** A #### Effective date **Key:** date **Type:** date **Default:** 2026-11-15 #### Documents in scope **Key:** scope **Type:** textarea **Default:** Supplier invoices, credit notes, certificates of conformance and material test reports processed by the document capture system. #### Confidence threshold for auto-accept **Key:** conf **Type:** text **Default:** 0.95 per field, and every mandatory field present #### Random sample of auto-accepted items **Key:** sample_pct **Type:** select **Options:** - 2 percent - 5 percent - 10 percent **Default:** 5 percent #### Second reviewer above amount **Key:** amount_limit **Type:** text **Default:** USD 25,000 #### First-level reviewer **Key:** reviewer **Type:** text **Default:** AP clerk #### Escalation owner **Key:** escalation **Type:** text **Default:** AP supervisor #### Review turnaround **Key:** sla **Type:** text **Default:** Within 1 business day **Blocks:** #### Human Review of Extracted Data **Body:** {{company}} SOP {{sop_no}}, Revision {{rev}} Effective: {{date}} #### Purpose and scope **Body:** This procedure sets when a person must check values read by OCR or AI before they are posted or relied on. In scope: {{scope}} #### Routing rules **Body:** 1. Auto-accept only when confidence is {{conf}}, and the document matches an open PO or lot where applicable. 2. Any document below the threshold goes to {{reviewer}}. 3. A random sample of {{sample_pct}} of auto-accepted documents is checked each week. 4. Documents above {{amount_limit}} require a second reviewer regardless of confidence. 5. Any change to vendor bank details is never accepted from an extracted document. It follows the separate vendor change control procedure. #### Reviewer duties **Body:** Compare each highlighted field with the source image. Correct errors in the system, never in a side file. Record the reason code for every correction. Review turnaround: {{sla}}. #### Escalation **Body:** Escalate to {{escalation}} when a document looks altered, when the vendor is unknown, when totals do not reconcile, or when the same error appears more than three times in a week. #### Monitoring **Table:** **Columns:** - Measure - Frequency - Owner - Action level **Rows:** **0:** Sample error rate **1:** Weekly **0:** Touchless rate **1:** Weekly **0:** Average review minutes **1:** Monthly **0:** Corrections by field **1:** Monthly #### Approval **Signatures:** - Process owner - Internal control - IT security **Notes:** A starting point. Align thresholds with your internal control framework and any customer or regulator rules for records and approvals. ## Content **Intro:** Automation without defined review is a control gap. This SOP states who checks what, when, and how errors are escalated, so auditors and operators share one process. **Sections:** #### How to use the template **Body:** Set your confidence threshold, sampling rate, second-review limit and roles, then export to PDF or Word and put it through document control. Start with conservative values, such as a higher sample rate, and relax them only when monitored error rates stay low for several weeks. Review the SOP whenever the model, capture configuration or document mix changes. #### The three layers of review **Body:** Layer one is exception review, where low-confidence or failed-validation items go to a person. Layer two is random sampling of auto-accepted items, which tests whether the confidence score can be trusted. Layer three is value-based review, where high-value items get a second pair of eyes regardless of score. Together these catch both obvious and silent errors. #### Controls to pair with the SOP **Body:** Matching against ERP data, such as open PO, receipt and vendor master, catches errors that confidence cannot. Segregation of duties still applies, so the reviewer should not also approve payment. Bank detail changes are a classic fraud route and must be handled outside the extraction flow. Keep an audit trail of what the system proposed and what the reviewer changed. #### Common mistakes **Body:** Setting a threshold once and never testing it is the biggest risk. Another is skipping the sample because the dashboard looks good. Reviewers who simply click accept add no control, so measure how often they make corrections. **Cta:** Netray builds extraction agents with read-only ERP lookups, visible confidence and human approval for write-back. We can map this SOP to your system. **Faq:** #### What confidence threshold should I use? **Answer:** There is no universal value. Pick a threshold using your own labeled sample, so you know what error rate you accept above it. Revisit it when documents or models change, and use stricter values for amounts and identifiers. #### Why sample auto-accepted documents? **Answer:** Confidence scores can be miscalibrated, and layouts change over time. A random sample gives an independent estimate of the real error rate among items nobody looked at. #### Do auditors accept AI extraction? **Answer:** Auditors focus on controls and evidence. A documented review procedure, ERP validation, an audit trail and monitored error rates give them something to test. Check specifics with your own auditor. #### Who should be the second reviewer? **Answer:** Someone independent of the first reviewer and outside payment approval, such as an AP supervisor, a buyer for price checks, or a quality engineer for certificates. ## Search terms human in the loop review procedure, ocr review sop, ai extraction review process template, document ai human review policy, invoice capture review procedure, ai output verification sop --- Talk to an engineer: https://netray.co/contact?intent=erp_ai | Machine catalog: https://netray.co/agent/catalog.json