Blog

Read our latest articles for tips, tricks, advice and news about research techniques and solutions.

How to Minimize Dropout Rate on Mechanical Turk

Leib Litman, PhD
March 8, 2015

How to Minimize Dropout Rate on Mechanical Turk

It is generally thought that pay rate does not affect data quality on Mechanical Turk. For example (Buhrmester, Kwang, & Gosling, 2011) showed that whether Workers are paid 5 cents or one dollar for a survey study, the internal reliability of the surveys does not change. They did show however that fewer Workers will take the surveys that pay less. We recently replicated these findings for both US and India-based Workers (Litman et al, 2014).

Read More >
Determining Completion Rate and Dropout Rate on Mechanical Turk

Leib Litman, PhD
March 6, 2015

Determining Completion Rate and Dropout Rate on Mechanical Turk

What is the completion rate and dropout rate? Dropout rate is defined as the percentage of participants who start taking a study but do not complete it. Dropout rate is sometimes referred to as attrition rate, and is the opposite...

Read More >
Why Use CloudResearch Panels?

Leib Litman, PhD
February 20, 2015

Why Use CloudResearch Panels?

MTurk Requesters are often interested in studying specific groups of people. For example, a researcher may be interested in men over 40, Republicans, people who are concerned about the cleanliness of sponges, or cancer survivors. CloudResearch Panels utilizes various techniques...

Read More >
System Qualification Enhancements – US State Qualifications

Jonathan Robinson, PhD
January 30, 2015

System Qualification Enhancements – US State Qualifications

Amazon just announced that their Worker Qualification now supports US State locations. It is currently available through their API and is also available through their Web Interface. It is great to see that Amazon is adding features to their API;...

Read More >

SUBSCRIBE TO RECEIVE UPDATES

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.