Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>Update 5/20/2016: Go with PsiTurk instead. See the answer by @John McDonnel</p> <p>Update 6/25/2013: This answer is quite old. See <a href="http://solomonmessing.wordpress.com/2013/06/24/streamline-your-mechanical-turk-workflow-with-mturkr/" rel="nofollow">Solomon Messing's blog post on MTurk in Social science for a starting point</a>.</p> <p>Given the amount of psych research that is starting to appear on AMT, you'd think they would add this as an option! </p> <p>To the best of my knowledge, you can't do this with the web interface without:</p> <ol> <li>Creating a bunch of templates (form A, form B, form C, form D).</li> <li>Running the first form (form A). </li> <li>Paying the workers and then blocking all of them. </li> <li>Running the second form (form B). </li> <li>Paying the workers and the blocking all from step 1 and step 2. </li> <li>And repeating until you are done. </li> </ol> <p>This is bad for a couple of reasons. The first being that you have to manually create the different forms. The second being that by blocking the workers who are doing good work, you are negatively impacting their reputation on the site. Your IRB will not likely look kindly on this. </p> <p>The "best" way to solve this is to not use the web interface, but use the command line tools (CLT) to create ExternalQuestions. That way, you write a webapp that can handle the details of the randomization, give the workers an informed consent without relying on a qualification, and "politely block" workers who have already done the work. (The workers who have already participated would get a short message asking them to return the HIT.) </p> <p>If you are interested in taking that path, I have some <a href="http://nathanvan.wordpress.com/2011/02/09/general-purpose-amt-webapp-based-on-web2py/" rel="nofollow">details on my blog</a> about how I've done it. </p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    2. VO
      singulars
      1. This table or related slice is empty.
    3. VO
      singulars
      1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload