Blog

Read our latest articles for tips, tricks, advice and news about research techniques and solutions.

Reverse Rejections

Jonathan Robinson, PhD
May 13, 2015

Reverse Rejections

Problem: How can a Requester who rejected an assignment in error undo his mistake? A rejected assignment affects the Worker negatively and will often impact the Requester with negative feedback which can damage the Requester’s online reputation which lowers Worker...

Read More >
Maximizing HIT Participation

Jonathan Robinson, PhD
May 13, 2015

Maximizing HIT Participation

Problem: How can you increase Amazon Mechanical Turk HIT Worker participation rates and speed completion of a HIT? This is particularly an issue with HITs that have a large number of required participants or have Qualifications that limit the number...

Read More >
Qualtrics Studies Run on Mechanical Turk Can Be Integrated With CloudResearch

Jonathan Robinson, PhD
May 8, 2015

Qualtrics Studies Run on Mechanical Turk Can Be Integrated With CloudResearch

Run Qualtrics Surveys on MTurk using CloudResearch Running Qualtrics surveys on CloudResearch streamlines several major pain-points researchers using MTurk have dealt with: Researchers can setup a dynamic secret code so that each Worker receives a unique code upon completing the study....

Read More >
Exclude Workers With One Click

Jonathan Robinson, PhD
May 7, 2015

Exclude Workers With One Click

Problem: Suppose you’re running a Mechanical Turk survey and need to exclude workers who took a previous survey. How can you quickly set this up. Some of the currently used solutions require following multiple steps to set things up and...

Read More >
Longitudinal and Follow Up Surveys on Mechanical Turk

Jonathan Robinson, PhD
May 7, 2015

Longitudinal and Follow Up Surveys on Mechanical Turk

Problem: Suppose you need to run a survey on Mechanical Turk and follow up with the same workers a week, month or year later. A few issues come up: How can I limit the follow up surveys to survey takers...

Read More >
Finding More Mechanical Turk Workers Faster with CloudResearch Restart HIT

Jonathan Robinson, PhD
March 24, 2015

Finding More Mechanical Turk Workers Faster with CloudResearch Restart HIT

Problem: Suppose you need to run a HIT with 1000 Workers. Or a HIT that is only open to Workers who have an approval Rating of 95% or more and have completed 500 HITs or more. Although when you launched...

Read More >
Creating Mechanical Turk Custom Panels With CloudResearch Worker Groups

Jonathan Robinson, PhD
March 23, 2015

Creating Mechanical Turk Custom Panels With CloudResearch Worker Groups

Problem: Suppose you need to run a group of HITs open only to participants who are women under 50. You previously ran a HIT and know the Worker IDs that you want to reach, but have no way to email...

Read More >
IRB Template for Mechanical Turk and TurkPrime

Leib Litman, PhD
March 13, 2015

IRB Template for Mechanical Turk and TurkPrime

An IRB will generally request a description of how participants will be recruited, reimbursed and interacted with. Additionally IRBs always request information about how anonymity of the participants is protected. Members of the IRB board may not be familiar with Amazon Turk, and it may be helpful to include a brief description of MTurk in your IRB application.

Read More >
The New New Demographics on Mechanical Turk: Is there Still a Gender Gap?

Leib Litman, PhD
March 12, 2015

The New New Demographics on Mechanical Turk: Is there Still a Gender Gap?

In this blog, we report on the demographics of Mechanical Turk workers by reviewing 75 studies conducted with US-based Workers in 2013 and 2014. From a total of 32,595 Workers, we found 15,324 were female (47%).

Read More >
A Simple Formula for Predicting the Time to Complete a Study on Mechanical Turk

CloudResearch
March 9, 2015

A Simple Formula for Predicting the Time to Complete a Study on Mechanical Turk

We describe a general formula for predicting the time it takes Workers to complete survey studies on MTurk. The average Worker takes 10.3 seconds to answer a single question. This means that a study with 60 questions should take approximately 10 minutes.

Read More >

SUBSCRIBE TO RECEIVE UPDATES

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.