UPDATED on September 9, 2013:
These tools were again revised, with the current version on my Research Tools page.
Feedback is always appreciated.
UPDATED on August 21, 2013:
Based on some very helpful feedback, I revised these two tools:
- Qualitative Research Evaluation Tool for Articles in the Social Sciences (DRAFT v12)
- Quantitative Research Evaluation Tool for Articles in the Social Sciences (DRAFT v6)
As before, feedback will be most appreciated.
ORIGINAL POST:
I am in the process of creating 2 tools to help my graduate research students assess and evaluate research studies, and am interested in getting some feedback on them. They are:
- Qualitative Research Evaluation Tool for Articles in the Social Sciences (DRAFT v10)
- Quantitative Research Evaluation Tool for Articles in the Social Sciences (DRAFT v4)
While I have seen various tools for specific purposes, I have not seen many that were intended for general use in the social sciences. Furthermore, while these cannot be applied to every qualitative or quantitative study in the social sciences, they are intended to be applicable to most of them.
Do these work? Are they helpful? Is there anything major missing or that should be combined, edited, or refined? Any feedback at all will be most appreciated.
Once I finalize these, I will make them freely available under a Creative Commons license.
@JeffreyKeefer this is actually great. I use a similar document but yours is more comprehensive. Nice!
RT @JeffreyKeefer: Research Evaluation Tools for Articles in the Social Sciences (DRAFT) http://t.co/9Rd6X7m6RW – FEEDBACK REQUESTED #phdch…
@JeffreyKeefer That looks good, but most of my RM teaching has been with first years. They could use parts early on + build up.
@JeffreyKeefer had passed it to 2 colleagues but they barely responded *Must check for signs of life*
My suggestions on the Qual research tool: #9 could be clearer eg: Has the problem that led to the research being undertaken been stated clearly?
And perhaps #11 Does the introduction identify how this study is situated in relation to the literature?
For the Quant tool, as with my comment above, just wondered about simplifying the language of literature deficiencies.
My colleague who works in this area responded to me with: “I do like the evaluation docs eg Do the authors have the necessary qualifications! “
Revising my Qualitative & Quantitative Research Evaluation Tools; any other feedback? http://t.co/z8ht8z9z1P #phdchat #AdjunctChat #ECRchat
RT @JeffreyKeefer: Revising my Qualitative & Quantitative Research Evaluation Tools; any other feedback? http://t.co/z8ht8z9z1P #phdchat #A…
@JeffreyKeefer Let me take a look back at the process I used during my qual research to see if I have anything more you can add. Great idea!
RT @JeffreyKeefer: Revising my Qualitative & Quantitative Research Evaluation Tools; any other feedback? http://t.co/z8ht8z9z1P #phdchat #A…
@JeffreyKeefer I’d be happy to have a look, too, thanks!
RT @JeffreyKeefer: Revising my Qualitative & Quantitative Research Evaluation Tools; any other feedback? http://t.co/z8ht8z9z1P #phdchat #A…
I just revised my 2 Research Evaluation tools based on lots of feedback; I hope they are a bit improved http://t.co/z8ht8z9z1P
@JeffreyKeefer http://t.co/ssRIBZl7fi
For anybody interested in seeing the revised Research Evaluation Tools based on feedback, I hope they are improved http://t.co/z8ht8z9z1P
RT @JeffreyKeefer: For anybody interested in seeing the revised Research Evaluation Tools based on feedback, I hope they are improved http:…
@JeffreyKeefer Re: Qualitative Tool. Is weighting of each section meant to reflect journal article content? if so, seems a bit front-loaded.
@JeffreyKeefer Methodological aspects important but tend to be squeezed in journal articles. More on findings / implications perhaps?
@JeffreyKeefer Just a thought… but looks great 🙂
Qualitative Research News and Notes: Silence and Voice: “Research Evaluation Tools for Articles in the Social… http://t.co/6JsL1w7WaO
Research Evaluation Tools for Articles in the Social Sciences (DRAFT) http://t.co/SegPlqYErj
Research Evaluation Tools for Articles in the Social Sciences (DRAFT) http://t.co/Z2OcIgB9bU via @jeffreykeefer
@JeffreyKeefer commented versions emailed – they look good but could be tightened up in a couple of areas perhaps…
@JeffreyKeefer Quant tool “Is there a summary to help the reader understand take-aways” that’s @GrubHub https://t.co/9l2b1Ec6cV isn’t it?;-)
RT @JeffreyKeefer Revising my Qualitative & Quantitative Research Evaluation Tools; any other feedback?
http://t.co/AKTFeY6TA9 – Good stuff!
Research Evaluation Tools for Articles in the Social Sciences (DRAFT) http://t.co/2YDmbhvUAg
Could be useful – Research Evaluation Tools for Articles in the Social Sciences (DRAFT) http://t.co/oIeiPAaXoT via @jeffreykeefer