{"claim":{"id":"37325bda-39e7-479f-95af-3778b8dd17d8","submission_id":"481ffa49-f7fc-4310-ad6a-f2ea9968abc8","submission_revision_id":"fa589e6a-a59f-4bf3-bb2c-a7239c45be29","builder":"builder-01","status":"active","claimed_at":"2026-10-15T14:45:08.006008Z","delivered_at":null,"ended_at":null,"delivery_note":null,"end_reason":null},"task":{"submission_id":"481ffa49-f7fc-4310-ad6a-f2ea9968abc8","submission_revision_id":"fa589e6a-a59f-4bf3-bb2c-a7239c45be29","revision_version":2,"submission_status":"under_review","submitted_at":"2026-08-04T05:22:54.701397Z","submitter_name":"Dianzhuo Wang","submitter_email":"johnwang@g.harvard.edu","task":{"status":"submitted","version":2,"extra_fields":{},"submitted_at":"2026-08-04T05:22:54.701397+00:00","industry_domain":"biology","task_short_name":"epistasis analysis","operating_system":"MacOS","task_description":"landscape.csv gives a Tite-seq (HTS) binding affinity -log10(K_D) for every genotype of a 16-site antibody library; each genotype is a 16-character 0/1 string (0 = germline, 1 = mutant). query_triplets.csv lists the site triples to score.\n\nFor each triple, report the third-order epistatic interaction coefficient among the three sites, on the -log10(K_D) scale.\nReturn EXACTLY:\n\n<EVAL_ANSWER>\n{\"T01\": <value>, \"T02\": <value>, \"T03\": <value>, \"T04\": <value>, \"T05\": <value>, \"T06\": <value>, \"T07\": <value>, \"T08\": <value>, \"T09\": <value>, \"T10\": <value>}\n</EVAL_ANSWER>","software_licensing":"Free/Open Source","evaluation_criteria":null,"verification_method":"Grader\nnumeric_tolerance\n{ \n \"tolerances\": { \n  \"T01\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T02\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T03\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T04\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T05\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T06\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T07\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T08\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T09\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }, \n  \"T10\": { \n   \"type\": \"absolute\", \n   \"value\": 0.01\n  }\n }, \n \"ground_truth\": { \n  \"T01\": -0.089, \n  \"T02\": 0.064, \n  \"T03\": -0.052, \n  \"T04\": -0.043, \n  \"T05\": -0.038, \n  \"T06\": -0.036, \n  \"T07\": 0.029, \n  \"T08\": 0.027, \n  \"T09\": -0.026, \n  \"T10\": -0.022\n }\n}","software_and_version":"Python ","specific_requirements":null,"expected_completion_time":null},"files":[{"file_id":"b7efedca-4464-4e2e-9fda-0c916be3bf36","filename":"landscape.csv","category":"input_materials","content_type":"text/csv","size_bytes":1563330},{"file_id":"4cb6843c-b70a-4068-91d8-33650aa9a202","filename":"query_triplets.csv","category":"input_materials","content_type":"text/csv","size_bytes":139}],"deep_review":{"overall_verdict":"Borderline Accept","review_text":"**Overall Verdict:** Borderline Accept — The task is solvable and objectively graded, but the required epistasis normalization, coding, and site-index convention are materially ambiguous.\n\n**Completeness Check:**\n- Instruction: Unclear — “third-order epistatic interaction coefficient” does not specify the Walsh/Fourier normalization, allele coding, site orientation, or background averaging required to reproduce the reference.\n- Inputs: Complete — Both CSVs are readable and collectively provide all required data; omitted leading zeroes can be restored deterministically to recover the complete 16-site factorial landscape.\n- Toolchain: Complete — Free Python tooling on macOS is sufficient, with no material version-specific dependency.\n- Reference output: Complete — Protected numeric references exist for all ten requested identifiers and are consistent with a normalized Walsh/Fourier calculation.\n- Rubric: Complete — Every output field has an objective absolute tolerance of 0.01.\n\n**File and Task Reachability:**\nThe attachment set is `reachable`. `landscape.csv` and `query_triplets.csv` were both fully inspected; no content remained unreviewed and no material inspection limitation remained. They are plain ASCII CSV files matching their declared types and sizes. `landscape.csv` contains 65,536 unique binary genotypes and finite affinity values from 8.4272 to 12.4936, with no missing records, duplicates, or missing fields after left-padding genotypes to 16 characters. `query_triplets.csv` contains ten unique requested IDs with three distinct, in-range sites each. No protected answers or evaluator internals appear in the attachments.\n\nThe task is `conditionally_reachable`. A solver can zero-pad genotypes, compute the requested interactions, emit the exact JSON envelope, and be evaluated across every requested value on one ordinary machine. However, several legitimate definitions of third-order epistasis produce materially different results. The protected reference specifically matches a left-to-right, 1-based Walsh/Fourier coefficient with germline coded `-1`, mutant coded `+1`, and the background-averaged third finite difference divided by eight. That convention is not solver-visible.\n\nLicense keys, accounts, tokens, and other credentials are not required from the contributor. Confidential, proprietary, or internal material may be evaluated as submitted evidence without requiring additional disclosure.\n\n**Special Screening:**\nNone. No affirmative evidence supports a screening label; public identifiability was not externally checked because external searching is outside the permitted evidence boundary.\n\n**Recommended Changes:**\nThe complete factorial input, concise output contract, protected reference, and per-field rubric are valid. Add the exact coefficient formula, including the factor of `1/8`, background averaging, allele signs, and left-to-right 1-based site indexing. Also either preserve every genotype as a zero-padded 16-character string or explicitly instruct solvers to left-pad the current values.","reviewed_at":"2026-08-15T00:17:24.321875Z"},"claim":{"id":"37325bda-39e7-479f-95af-3778b8dd17d8","submission_id":"481ffa49-f7fc-4310-ad6a-f2ea9968abc8","submission_revision_id":"fa589e6a-a59f-4bf3-bb2c-a7239c45be29","builder":"builder-01","status":"active","claimed_at":"2026-10-15T14:45:08.006008Z","delivered_at":null,"ended_at":null,"delivery_note":null,"end_reason":null}},"revision_is_current":true}