refereekit documentation
refereekit helps you referee a paper with a language model, inside the AI agent you chat with. You ask questions about the paper. The model answers, and links each statement to evidence, such as a quotation with its page. refereekit checks that evidence against the PDF before you see the answer.
One check, start to finish
Section titled “One check, start to finish”Say you ask what the paper studies. The model answers that the paper builds its basic object from a set of nodes. It backs this with a quotation from page 1: “a finite set of nodes”. refereekit looks for those exact words on page 1 of the PDF. They are there, so the quotation comes back PASS. Your private view shows:
> The paper builds its basic object from a set of nodes. e1 quotation: PASS: the quoted words occur on the named pageA PASS means the quoted words occur on the named page, and nothing more. It does not mean the answer is true. The agent’s model learns only the count: one PASS. The paper’s words, and yours, appear only in a private view on your own screen.
Then you give your verdict. The model drafts a report and an editor letter from the checked evidence, and you edit them. The verdict is always yours.
Three ways in
Section titled “Three ways in”| You want to | Read, in order |
|---|---|
| Review a paper | Before you start → Install → Your first review |
| Try it first, with no key and no account | Install → Tutorial |
| Decide whether to trust it | What verification means → Confidentiality |