Skip to content
alyn
lingzhi227

Self Review skill

Automatically review an academic paper using the NeurIPS review form with three reviewer personas, ensemble scoring, and reflection refinement. Extracts text from PDF, runs structured review, and outputs actionable feedback. Use when the user wants to review a paper before submission or get feedback on a draft.

$npx skills add lingzhi227/agent-research-skills --skill self-review
View this skill on GitHublingzhi227/agent-research-skills/skills/self-review/SKILL.md
Pack stars
462
Pack installs
60k
Alyn Score
49/99
Updated
9 months ago
– views – installs via Alyn

lingzhi227

Self Review

Research Documents

Install Self Review

Pick your agent. Every command is ready to paste.

$npx skills add lingzhi227/agent-research-skills --skill self-review

The open skills CLI detects your agents (Claude Code, Cursor, Codex and 70+ more) and installs to the right folder. Add -g to install globally.

01

Install it

Run the command above, or upload the folder in Claude.

02

Ask naturally

Describe the task. Your agent loads self-review when the request matches its description.

03

Name it if needed

If it does not trigger, say “use the self-review skill”. In Codex, type $self-review.

The skill itself

SKILL.md

FolderGitHub

Self-Review

Review an academic paper using a structured review form with multiple reviewer personas.

Input

  • $ARGUMENTS — Path to PDF file or .tex file

Scripts

Extract text from PDF

python ~/.claude/skills/self-review/scripts/extract_pdf_text.py paper.pdf --output paper_text.txt
python ~/.claude/skills/self-review/scripts/extract_pdf_text.py paper.pdf --format markdown

Tries pymupdf4llm (best) → pymupdf → pypdf. Install: pip install pymupdf4llm pymupdf pypdf

Parse PDF into structured sections

python ~/.claude/skills/self-review/scripts/parse_pdf_sections.py \
  --pdf paper.pdf --output sections.json

Extracts title (via font size), section headings, and section text. Requires: pip install pymupdf Key flags: --format text, --verbose

Workflow

Step 1: Load Paper

  • If PDF: use extract_pdf_text.py to extract text
  • If .tex: read the LaTeX source directly

Step 2: Three-Persona Review

Run three independent reviews using different personas (from references/review-form.md):

  1. Harsh but fair reviewer: Expects good experiments that lead to insights
  2. Harsh and critical reviewer: Looking for impactful ideas in the field
  3. Open-minded reviewer: Looking for novel ideas not proposed before

For each persona, generate a review following the NeurIPS review JSON format in references/review-form.md.

Step 3: Reflection Refinement (up to 3 rounds per reviewer)

After each review, apply the reflection prompt: re-evaluate accuracy and soundness, refine if needed. Stop when "I am done".

Step 4: Aggregate

  • Combine all three reviews
  • Average numerical scores (round to nearest integer)
  • Synthesize a meta-review finding consensus
  • Weight scores using AgentLaboratory weights: Overall (1.0), Contribution (0.4), Presentation (0.2), others (0.1 each)

Step 5: Actionable Report

Output format:

## Review Summary
- **Overall Score**: X/10 (Weighted: Y/10)
- **Decision**: Accept / Reject
- **Confidence**: Z/5

## Strengths (consensus across reviewers)
1. ...
2. ...

## Weaknesses (consensus across reviewers)
1. ...
2. ...

## Questions for Authors
1. ...

## Specific Suggestions for Improvement
1. [Section X, Page Y]: ...
2. [Section Z, Page W]: ...

## Score Breakdown
| Dimension | R1 | R2 | R3 | Avg |
|-----------|----|----|-----|-----|
| Overall | ... | ... | ... | ... |
| Contribution | ... | ... | ... | ... |
| ... | ... | ... | ... | ... |

References

  • NeurIPS review form, scoring weights, personas, reflection prompts: ~/.claude/skills/self-review/references/review-form.md
  • PDF text extraction: ~/.claude/skills/self-review/scripts/extract_pdf_text.py

Missing Sections Check

You MUST verify that all required sections are present: Abstract, Introduction, Methods/Approach, Experiments/Results, Discussion/Conclusion. Reduce scores if any are missing.

Tips for Self Review

  • • Start a fresh session after installing so your agent picks up the new skill.
  • • This skill ships scripts. Read them before the first run, and run it in a project without secrets first.
  • • It bundles reference files. The agent reads them only when needed, so they cost no context until then.
  • • It is part of a pack with 30 skills. Install only the ones you need with --skill to keep triggers precise.
  • • If two skills overlap, mention the one you want by name.

Questions about Self Review

What does the Self Review skill do?

Automatically review an academic paper using the NeurIPS review form with three reviewer personas, ensemble scoring, and reflection refinement. Extracts text from PDF, runs structured review, and outputs actionable feedback. Use when the user wants to review a paper before submission or get feedback on a draft.

How do I install Self Review?

Run "npx skills add lingzhi227/agent-research-skills --skill self-review" in your project. The skills CLI installs it for Claude Code, Cursor, Codex and 70+ other agents. In Claude on the web, upload the skill folder as a ZIP under Customize > Skills.

Does Self Review work in Cursor and Codex?

Yes. Self Review uses the open SKILL.md format, so it works in Claude Code, Claude, Cursor, OpenAI Codex, Gemini CLI, GitHub Copilot and other agents that support agent skills.

Is Self Review free?

Self Review is open source on GitHub. It is free to install; check the license before commercial use.

Who made Self Review?

Self Review is published by lingzhi227 in the lingzhi227/agent-research-skills repository, together with 29 other skills.

Similar skills. From other creators.