ReAct: Synergizing Reasoning and Acting in Language Models

1. Citation and canonical version

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, Yuan Cao. arXiv:2210.03629; submitted 2022-10-06, version 3 dated 2023-03-10. Full text audited at ar5iv's rendering of arXiv v3; metadata checked through arXiv and OpenAlex. Accessed 2026-08-03 UTC.

2. Selection reason

Field-shaping historical mechanism: a frozen LLM interleaves free-form reasoning with environment actions. The original benchmark numbers are load-bearing for later agent architectures.

3. Paper in one paragraph

AUTHOR CLAIM: interleaving thoughts, actions, and observations improves few-shot performance and makes trajectories more grounded/interpretable than reason-only or act-only prompting. The paper evaluates PaLM-540B on HotpotQA, FEVER, ALFWorld, and WebShop and reports absolute success-rate improvements over prior trained methods on ALFWorld and WebShop (full text, §§3–4).

4. Claim-to-evidence table

Claim	Type/system/input/comparator	Outcome and magnitude	Boundary/supporting location	Audit status
ReAct improves interactive task success	predictive; PaLM-540B; 1–2 demonstrations; prior imitation/RL and act-only controls	ALFWorld best ReAct 71% vs BUTLER 37% and best Act 45%; WebShop 40.0% success vs prior best 30.1%	134 unseen ALFWorld games and 500 WebShop instructions; Tables 3–4 in full text	Direct same-origin evidence; SINGLE-SOURCE for exact reproduction
ReAct reduces hallucinated successful traces vs CoT on HotpotQA	descriptive; 200 manually labeled trajectories	false-positive hallucination 6% vs 14%; CoT failures labeled hallucination 56% vs ReAct 0%	Authors sampled 50 correct and 50 incorrect trajectories per method; Table 2 in full text	Weak human-label evidence; no inter-rater/reliability details visible
Reasoning+acting is broadly more interpretable/trustworthy	translational	qualitative diagnosability	trajectory inspection and author analysis	Overbroad; no controlled human trust/interpretability study

5. Methods and validity audit

• The strongest isolation is ReAct vs Act using the same annotated trajectories with thoughts removed; six ALFWorld prompt permutations test prompt selection to a degree (full text, §4).
• The headline ALFWorld comparison uses best-of-six ReAct/Act trials and best-of-eight published BUTLER trials; average ReAct is 57%, still above Act's best 45%, but selection conventions complicate the 34-point headline.
• WebShop evaluates 500 test instructions, but only one-shot prompting and point estimates are reported; no confidence interval or seed variance is supplied.
• Knowledge-task results are mixed: ReAct is 27.4 vs CoT 29.4 on HotpotQA, while ReAct is 60.9 vs CoT 56.3 on FEVER. Combined fallback systems perform best, so the paper does not support a universal ReAct-over-CoT claim.
• Human-selected demonstrations, manual trajectory writing, fixed step limits, and proprietary PaLM-540B constrain reproducibility and causal attribution.
• Benchmark contamination cannot be ruled out for a large pretrained model; the paper does not document training-data overlap checks.

6. Checks performed

Table values and denominators were cross-checked against the full text. No executable reproduction was attempted: the decisive original setup depends on unavailable PaLM-540B and historical benchmark environments, so a host-side imitation would not materially resolve the claim.

7. Code/data/reproducibility

The paper supplies prompts and states that PaLM was not openly accessible. The official repository metadata shows an MIT-licensed implementation repository; repository existence is not an independent reproduction. The model/backend dependency prevents exact reproduction from the published open artifacts.

8. Correction/integrity/conflicts

The arXiv feed exposes v1–v3 chronology and no withdrawal marker. A bounded Crossref title search did not return the canonical work. UNKNOWN: exhaustive correction/retraction status because OpenReview API access returned HTTP 403. No integrity concern is issued. Affiliations and support disclosed in the full text include Google/Princeton and NSF support.

9. Independent support/contradiction map

• OpenAlex reports 566 citing works and returns many later implementations/extensions. This establishes attention and transfer, not replication.
• AgentBench independently reports broad agent failures in long-term reasoning, decision-making, and instruction following, converging with ReAct's stated remaining limitations but not reproducing its tables.
• Bounded OpenAlex/arXiv searches for ReAct, ALFWorld, WebShop, failure, and related terms found no direct independent rerun of the exact benchmark comparisons. Label: NOT FOUND IN SEARCH, not proof none exists.

10. Evidence score and verdict

3/5 — PROMISING — UNREPLICATED, scoped to: interleaving explicit reasoning with actions improved the reported PaLM-540B results under the paper's four benchmark protocols. The design includes useful ablations and multiple tasks, but proprietary models, selective best-trial comparisons, missing uncertainty, and no located direct independent reproduction block a stronger verdict. Interpretability/trustworthiness claims remain 2/5.

11. Harvestable mechanism and constraints

Mechanism: expose environment observations inside a reasoning/action loop and use sparse reasoning to maintain task state. Constraints: trace faithfulness is unproven; loops/retrieval failures remain common; reasoning text can expand attack surface and latency.

12. Unknowns and decisive next check

Run a preregistered reproduction on current open and API models using frozen ALFWorld/WebShop revisions, identical prompt-selection rules, multiple seeds, mean and interval reporting, act-only and state-machine controls, and contamination checks. The verdict moves up only if gains survive independent implementation and model families.

13. Fetched sources

1. arXiv metadata, v3 — primary metadata, accessed 2026-08-03.
2. ar5iv full text — primary paper rendering, accessed 2026-08-03.
3. OpenAlex canonical record — index metadata, accessed 2026-08-03.
4. Official GitHub repository metadata — implementation metadata, accessed 2026-08-03.
5. OpenAlex citation graph — follow-up index, accessed 2026-08-03.
6. AgentBench arXiv metadata — independent benchmark context, accessed 2026-08-03.