Tillyard Research
How proposals are scored
Reviewers read each proposal against these six questions. The score for each is 0 to 3, and what every score looks like is written out so two readers land close together.
Every proposal is read against the same six questions, each scored 0 to 3. The score steps are written out so two readers looking at the same proposal land close together. Scores help; people decide, and the reasons are sent to the author.
1. A question worth chasing
Is there one clear question that makes people curious, and can this project get somewhere real with it in the time and money asked for? Any kind of research counts: an experiment, field work, interviews, a survey, building something, digging through archives.
- 0 Not there
- No question, or only a topic.
- 1 Started
- A question is there, but it is too big or too vague to get anywhere with in the time.
- 2 Solid
- A clear question that makes you want to know the answer, and that probably fits the timeline.
- 3 Strong
- A sharp question that sparks real curiosity, with a clear way to get somewhere with it in the time and budget.
2. Value to people outside the team
Does it say who would use the answer, and for what?
- 0 Not there
- Not said.
- 1 Started
- Helps the author or the field in general, with nobody named.
- 2 Solid
- Names who would use it.
- 3 Strong
- Names who would use it, what they could change, and how the results will reach them.
3. A method someone could repeat
Are the steps written down well enough for another student to follow?
- 0 Not there
- No method.
- 1 Started
- Methods are named but not described.
- 2 Solid
- The steps are described with a few gaps (who, how many, or how it will be analysed).
- 3 Strong
- Who, how many, what is collected and how it becomes an answer are all written down.
4. Timeline and budget that agree
Do the milestones fit the dates, and does every budget line have a reason?
- 0 Not there
- No timeline or no budget.
- 1 Started
- Either the timeline or the budget is missing reasons or does not match the method.
- 2 Solid
- Mostly consistent, with one or two lines that are hard to justify.
- 3 Strong
- Every line has a reason, milestones are real and in order, and the total matches what the method needs.
5. Open results
Is there a real plan to publish for free under CC BY 4.0 and to share data where it is safe?
- 0 Not there
- No plan.
- 1 Started
- Says it will publish, with no place or date.
- 2 Solid
- Names where it will be published and when, and confirms CC BY 4.0.
- 3 Strong
- Also names where data and code go, or explains clearly why they cannot be shared.
6. Care for people, and conflicts
If people are studied, is ethics approval in place? Are conflicts of interest stated?
- 0 Not there
- People are studied and no approval route is given.
- 1 Started
- Approval is mentioned but unclear, or conflicts are not addressed.
- 2 Solid
- Approval or exemption is confirmed (or no people are studied) and conflicts are stated.
- 3 Strong
- As solid as 2, and privacy and consent are described in the method.
The total is a guide. A person decides, and says why.
Reviewers also say in their own words what they saw. A person at Tillyard then decides to fund, ask for changes or decline, and the author is sent the reasons. Reviewers who know an applicant, or who are connected to Tillyard as trustees, officers or staff, don't score that proposal.