Tillyard
Donate

Tillyard Research

How proposals are scored

Reviewers read each proposal against these six questions. The score for each is 0 to 3, and what every score looks like is written out so two readers land close together.

Every proposal is read against the same six questions, each scored 0 to 3. The score steps are written out so two readers looking at the same proposal land close together. Scores help; people decide, and the reasons are sent to the author.

1. A question worth chasing

Is there one clear question that makes people curious, and can this project get somewhere real with it in the time and money asked for? Any kind of research counts: an experiment, field work, interviews, a survey, building something, digging through archives.

0 Not there
No question, or only a topic.
1 Started
A question is there, but it is too big or too vague to get anywhere with in the time.
2 Solid
A clear question that makes you want to know the answer, and that probably fits the timeline.
3 Strong
A sharp question that sparks real curiosity, with a clear way to get somewhere with it in the time and budget.

2. Value to people outside the team

Does it say who would use the answer, and for what?

0 Not there
Not said.
1 Started
Helps the author or the field in general, with nobody named.
2 Solid
Names who would use it.
3 Strong
Names who would use it, what they could change, and how the results will reach them.

3. A method someone could repeat

Are the steps written down well enough for another student to follow?

0 Not there
No method.
1 Started
Methods are named but not described.
2 Solid
The steps are described with a few gaps (who, how many, or how it will be analysed).
3 Strong
Who, how many, what is collected and how it becomes an answer are all written down.

4. Timeline and budget that agree

Do the milestones fit the dates, and does every budget line have a reason?

0 Not there
No timeline or no budget.
1 Started
Either the timeline or the budget is missing reasons or does not match the method.
2 Solid
Mostly consistent, with one or two lines that are hard to justify.
3 Strong
Every line has a reason, milestones are real and in order, and the total matches what the method needs.

5. Open results

Is there a real plan to publish for free under CC BY 4.0 and to share data where it is safe?

0 Not there
No plan.
1 Started
Says it will publish, with no place or date.
2 Solid
Names where it will be published and when, and confirms CC BY 4.0.
3 Strong
Also names where data and code go, or explains clearly why they cannot be shared.

6. Care for people, and conflicts

If people are studied, is ethics approval in place? Are conflicts of interest stated?

0 Not there
People are studied and no approval route is given.
1 Started
Approval is mentioned but unclear, or conflicts are not addressed.
2 Solid
Approval or exemption is confirmed (or no people are studied) and conflicts are stated.
3 Strong
As solid as 2, and privacy and consent are described in the method.

The total is a guide. A person decides, and says why.

Reviewers also say in their own words what they saw. A person at Tillyard then decides to fund, ask for changes or decline, and the author is sent the reasons. Reviewers who know an applicant, or who are connected to Tillyard as trustees, officers or staff, don't score that proposal.