{"claim":{"id":"f4077b36-a184-4f63-81ea-ff8de46228e7","submission_id":"51bc6b79-4327-4ff2-8766-739d8d085ea4","submission_revision_id":"5424bcc4-756e-4885-a840-eaae821b9884","builder":"builder-01","status":"active","claimed_at":"2026-10-15T14:56:26.081994Z","delivered_at":null,"ended_at":null,"delivery_note":null,"end_reason":null},"task":{"submission_id":"51bc6b79-4327-4ff2-8766-739d8d085ea4","submission_revision_id":"5424bcc4-756e-4885-a840-eaae821b9884","revision_version":2,"submission_status":"under_review","submitted_at":"2026-08-10T06:09:27.535922Z","submitter_name":"Shuang Liu","submitter_email":"shuangl4@andrew.cmu.edu","task":{"status":"submitted","version":2,"extra_fields":{"difficulty_self_test":{"model":"Claude Opus 4.8, max reasoning effort","harness":"Claude Code","estimated_score":"5–10%"}},"submitted_at":"2026-08-10T06:09:27.535922+00:00","industry_domain":"E-commerce Finance / Revenue Operations","task_short_name":"settlement_reconciliation_instance_1","operating_system":"Windows, Linux, MacOS","task_description":"Objective: Close fiscal period FY2026-P02 (March 1–28, 2026) for an e-commerce merchant by reconciling the internal orders ledger against four weekly processor settlement batches and the company bank statement, and produce the period reconciliation report as a single JSON file.\n\nStarting State: A folder containing README.md (the controller's memo — the authoritative task brief, including the exact output schema), orders_ledger.csv (the period's charge ledger), a processor_settlements/ folder with four weekly batch exports (as delivered by the processor: mixed encodings, delimiters, and number formats), bank_statement.csv, and fx_rates.csv (daily reference rates). The input bundle is fully self-contained: everything the task requires is in these files, the task runs fully offline, and no external downloads, credentials, or network access are needed.\n\nInstructions & Rules: Follow README.md exactly — it defines every documented rule (matching, rounding, FX reference-rate usage, in-transit definition, the output schema and formatting) and states which pricing parameters were lost with the old billing system and must be recovered from the data before the numbers can be recomputed. Match settled activity to the ledger, audit processor fees against the recovered schedule, reconcile expected payouts to bank receipts, and report — never plug — any remaining difference. Write the completed report to output/reconciliation_report.json next to the README, matching the schema field-for-field.\n\nExpected completion time: 8-12 hours for a skilled revenue-operations analyst comfortable with scripting.\n\nFull provenance (seeded generator, independently written reference solver, inferability proofs, checker, freeze manifest, and the complete measurement history) is included in the Reference Output & Evaluation Dependencies upload; evaluation is equally self-contained, running offline on Python 3.11+ standard library.","software_licensing":"Free/Open Source","evaluation_criteria":null,"verification_method":"Grade the single file output/reconciliation_report.json against the reference report by exact comparison, all-or-nothing. Rules: the JSON must contain exactly the schema's fields; monetary fields are strings compared for exact equality after normalizing to two decimal places; integer fields compare exactly; list fields compare exactly as sets after ascending sort; any missing field, extra field, wrong type, or malformed JSON is a fail. There are no tolerances and no partial credit — every value is either exactly right or the task fails. The provided evaluation/checker.py (reference upload) implements precisely this comparison; running python3 checker.py <candidate> <reference> and reading its exit code (0 = pass, 1 = fail) reproduces our grading and can serve as the automated grader directly.","software_and_version":"Python 3.11+","specific_requirements":null,"expected_completion_time":null},"files":[{"file_id":"98c85104-7d70-4c8d-93a0-2863f79b6a9d","filename":"ale_settlement_input_bundle.zip","category":"input_materials","content_type":"application/zip","size_bytes":189497},{"file_id":"71b741e9-350e-49f2-84af-fa66d5991d01","filename":"ale_settlement_reference_upload.zip","category":"reference_output","content_type":"application/zip","size_bytes":18263},{"file_id":"a71608d7-b835-4001-960a-d30256f45ccb","filename":"evidence_settlement_selftest_v3.zip","category":"difficulty_self_test_evidence","content_type":"application/zip","size_bytes":7865}],"deep_review":{"overall_verdict":"Accept","review_text":"**Overall Verdict:** Accept — the task is complete, self-contained, objectively gradable, and independently reproducible, with only optional clarity and calibration-evidence improvements.\n\n**Completeness Check:**\n\n- Instruction: Complete — the memo defines the fiscal period, time-zone boundary, reconciliation concepts, exact 14-field schema, rounding, formatting, and residual treatment; the remaining fee, FX, and duplicate-record conventions are recoverable from the supplied data.\n- Inputs: Complete — all required ledger, bank, FX, and four settlement files are present and parseable, including the documented mixed encodings and CSV dialects.\n- Toolchain: Complete — Python 3.11+ and its standard library provide a viable offline implementation and evaluation path on a suitable machine.\n- Reference output: Complete — the schema-valid reference report is present, its frozen hashes match, and an independent exact-decimal recomputation reproduced every field.\n- Rubric: Complete — the checker enforces exact keys, types, two-decimal monetary strings, sorted reference lists, and exact all-or-nothing comparison as described.\n\n**File and Task Reachability:**\n\nThe attachment set is `reachable`, and the end-to-end task is `reachable`. All three manifest attachments were inspected: `ale_settlement_input_bundle.zip`, `ale_settlement_reference_upload.zip`, and `evidence_settlement_selftest_v3.zip`. Their archive structures, member types, sizes, integrity, encodings, representative records, schemas, reference artifacts, static program contents, and self-test reports were reviewed; no content remained unreviewed. The archives contain no traversal paths, encryption barriers, links, devices, or problematic expansion.\n\nThe inputs comprise 3,223 ledger rows, 108 FX rows, 38 bank rows, and 3,256 settlement records. They cleanly exercise UTF-8 with BOM, Latin-1, semicolon delimiters, decimal commas, an embedded quoted newline, and two exact duplicate export rows. Solver-visible inputs are separated from the protected reference and evaluator. A solver can produce `output/reconciliation_report.json`, after which the supplied checker can compare it with the protected reference. The uploaded programs were inspected statically rather than executed; Python was unavailable in the review environment, but the report was independently recomputed through another exact-decimal parser.\n\nLicense keys, accounts, tokens, and other credentials are not required from the contributor. Confidential, proprietary, or internal material may be evaluated as submitted evidence without requiring additional disclosure.\n\n**Special Screening:**\n\nNone — no affirmative evidence supports a policy label. Public identifiability was not externally checked because review was restricted to submitted evidence.\n\n**Recommended Changes:**\n\nThe task has strong input construction, realistic reconciliation hazards, a consistent reference, and a precise evaluator. No material changes are required. Optionally, state explicitly that exact duplicate export records represent one activity and that non-published FX dates use the latest prior published rate. Also consider including the referenced supplementary 23-run calibration logs or narrowing the claim that the complete measurement history is included.","reviewed_at":"2026-08-15T00:32:12.249274Z"},"claim":{"id":"f4077b36-a184-4f63-81ea-ff8de46228e7","submission_id":"51bc6b79-4327-4ff2-8766-739d8d085ea4","submission_revision_id":"5424bcc4-756e-4885-a840-eaae821b9884","builder":"builder-01","status":"active","claimed_at":"2026-10-15T14:56:26.081994Z","delivered_at":null,"ended_at":null,"delivery_note":null,"end_reason":null}},"revision_is_current":true}