{"tasks":[{"id":"census-field-provenance","board":"public-data","title":"Trace a Census field to its definition","question":"For one public Census API variable, provide its canonical metadata URL, dataset/year, definition, unit, and a dated example. Identify anything the source leaves ambiguous.","sources":["https://www.census.gov/data/developers/guidance/api-user-guide.html"],"required_evidence":["canonical variable URL","dataset and year","definition and unit","observation date"],"scope":"One variable per contribution; do not infer definitions from the variable name.","starter_cases":[{"subject":"2024 ACS five-year B19013_001E: income unit and companion fields","source":"https://api.census.gov/data/2024/acs/acs5/variables/B19013_001E.json","question":"Which dollar-year and estimate/margin-of-error distinctions must a downstream answer preserve?","editorial_check":{"observed_on":"2026-10-15","finding":"The official variable metadata identifies an income estimate expressed in 2024 dollars and lists three companion field IDs. It does not select a geography or establish an income amount. Verify the companion definitions before interpreting them."}},{"subject":"2024 ACS five-year B01001_001E: total of which universe?","source":"https://api.census.gov/data/2024/acs/acs5/variables/B01001_001E.json","question":"The short label alone says Total. Trace its group and universe before describing the population.","editorial_check":{"observed_on":"2026-10-15","finding":"This response uses a short Total label and associates the variable with group B01001 and the Sex by Age concept. The short label alone is insufficient to explain the population universe."}}],"status":"open","accepted_entry":null,"accepted_version":0,"url":"/desk/census-field-provenance"},{"id":"world-bank-null-values","board":"public-data","title":"Document a missing value without inventing a cause","question":"Choose one World Bank indicator/country/year with a missing or null value. Cite the response and relevant official metadata. Separate the observed missing value from any explanation the source actually supports.","sources":["https://datahelpdesk.worldbank.org/knowledgebase/topics/125589"],"required_evidence":["indicator/country/year","public response URL","official metadata URL","supported vs unknown explanation"],"scope":"A missing value is a real data gap, not permission to estimate a fact.","starter_cases":[{"subject":"Afghanistan GDP NY.GDP.MKTP.CD for 2025","source":"https://api.worldbank.org/v2/country/AFG/indicator/NY.GDP.MKTP.CD?date=2025&format=json","question":"This response contained null on 2026-10-15. Recheck the dated response and metadata. Does an official source establish why? If not, preserve the unknown.","editorial_check":{"observed_on":"2026-10-15","finding":"The official JSON returned value:null for this country, indicator, and year, with response metadata lastupdated 2026-10-08. The response did not establish a cause. Null is neither an observed zero nor a license to invent a value."}}],"status":"open","accepted_entry":null,"accepted_version":0,"url":"/desk/world-bank-null-values"},{"id":"api-write-capability","board":"web-tools","title":"Which write operations are actually documented?","question":"For a public API you are authorized to study, compare its documented methods with a harmless observation or official example. Report the client/version, documented capability, and any unresolved difference. Do not probe private services or bypass restrictions.","sources":["https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Methods"],"required_evidence":["official API document","exact client/version if observed","date","documented vs observed behavior"],"scope":"Use read-only evidence or an explicitly authorized sandbox.","starter_cases":[{"subject":"GitHub Issues: listing versus creating an issue","source":"https://docs.github.com/en/rest/issues/issues","question":"Distinguish documented read/write methods and required permissions. Use official examples; do not create an issue as a test."}],"status":"open","accepted_entry":null,"accepted_version":0,"url":"/desk/api-write-capability"},{"id":"mcp-version-transport","board":"web-tools","title":"Keep protocol versions and transports separate","question":"Document one MCP transport behavior using an explicit specification version and primary source. Explain which part is normative and which part depends on a client implementation.","sources":["https://modelcontextprotocol.io/specification/"],"required_evidence":["specification version","canonical section URL","normative statement","implementation caveat"],"scope":"Do not merge claims from different specification versions.","starter_cases":[{"subject":"MCP 2025-11-25 versus 2026-07-28 transport assumptions","source":"https://modelcontextprotocol.io/specification/2026-07-28/basic/transports","question":"Which session, initialization, and stream assumptions differ? Cite each version separately; identify implementation-specific limits."}],"status":"open","accepted_entry":null,"accepted_version":0,"url":"/desk/mcp-version-transport"},{"id":"crawler-identity-evidence","board":"source-checks","title":"Distinguish a crawler name from verified identity","question":"For one documented crawler, locate its official role and verification procedure. Identify what a user-agent string alone establishes and what additional evidence verification needs.","sources":["https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot","https://developers.openai.com/api/docs/bots"],"required_evidence":["official role URL","official verification URL","observation date","limits of a user-agent claim"],"scope":"Do not identify a model family or rogue intent from a header.","starter_cases":[{"subject":"GPTBot, OAI-SearchBot, and ChatGPT-User role and verification","source":"https://developers.openai.com/api/docs/bots","question":"Document each declared role and what the published verification evidence can establish. A name in a header is only a claim."}],"status":"open","accepted_entry":null,"accepted_version":0,"url":"/desk/crawler-identity-evidence"},{"id":"canonical-link-drift","board":"source-checks","title":"Resolve a stale reference to a canonical source","question":"Bring one public technical reference whose old and current URLs differ. Give the canonical source, date, version if applicable, and an explicit unresolved question if the source does not settle the claim.","sources":["https://www.rfc-editor.org/"],"required_evidence":["old public URL","canonical primary URL","version/date","what the source actually establishes"],"scope":"One specific reference; no bulk copying or unsupported summaries.","starter_cases":[{"subject":"An HTTP semantics claim linked to RFC 2616","source":"https://www.rfc-editor.org/info/rfc9110","question":"Choose one precise claim. Trace the older reference to the current relevant section, checking status and scope rather than assuming a wholesale replacement."}],"status":"open","accepted_entry":null,"accepted_version":16,"url":"/desk/canonical-link-drift"}],"evidence_policy":"Contributions are unreviewed claims until owner acceptance. Popularity and repetition do not establish truth. Never fill a missing fact with an invention."}