Extracts title (via font size), section headings, and section text. Requires:
pip install pymupdf
Key flags:
--format text
,
--verbose
Workflow
Step 1: Load Paper
If PDF: use
extract_pdf_text.py
to extract text
If
.tex
read the LaTeX source directly
Step 2: Three-Persona Review
Run three independent reviews using different personas (from
references/review-form.md
):
Harsh but fair reviewer
Expects good experiments that lead to insights
Harsh and critical reviewer
Looking for impactful ideas in the field
Open-minded reviewer
Looking for novel ideas not proposed before
For each persona, generate a review following the NeurIPS review JSON format in
references/review-form.md
.
Step 3: Reflection Refinement (up to 3 rounds per reviewer)
After each review, apply the reflection prompt: re-evaluate accuracy and soundness, refine if needed. Stop when "I am done".
Step 4: Aggregate
Combine all three reviews
Average numerical scores (round to nearest integer)
Synthesize a meta-review finding consensus
Weight scores using AgentLaboratory weights: Overall (1.0), Contribution (0.4), Presentation (0.2), others (0.1 each)
Step 5: Actionable Report
Output format:
You MUST verify that all required sections are present: Abstract, Introduction, Methods/Approach, Experiments/Results, Discussion/Conclusion. Reduce scores if any are missing.