sennoma's Feed

About « Experimental Turk

sennoma — Fri, 04 Dec 2009 01:25:00 -0500

About The goal of this blog is reporting evidence concerning the reliability of Amazon Mechanical Turk as an online subject pool for experiments in economics, psychology, and social sciences in general. Using AMT to run web-based experiments allows researchers to obtain large quantities of data in a cheap and efficient way. However, there is lack of evidence regarding the actual reliability of AMT’s workforce as a subject pool; as any new instrument, AMT requires to be tested thoroughly in order to be used confidently. This blog aims at collecting any individual effort made in order to validate AMT as a research tool. It reports results from experiments that increase or decrease the reliability of AMT as an online subject pool, as well as general guidance for running experiments through this service. Tagged by sennoma under mechanicalturk, x-phi,

Experimenting on Mechanical Turk: 5 How Tos - PARC blog

sennoma — Sat, 25 Jul 2009 04:49:00 -0400

Performing human-subjects experiments on Amazon Mechanical Turk offers many benefits, including very low experiment costs, quick turn-around rates, and relatively simple approvals from human subjects boards. But you have to be careful to avoid bias and error; we describe some techniques below. Tagged by sennoma under mechanicalturk,

TurKit Homepage

sennoma — Thu, 02 Jul 2009 02:43:00 -0400

TurKit is a Java/JavaScript API for running iterative tasks on Mechanical Turk. Tagged by sennoma under mechanicalturk, tools,

http://www.people.fas.harvard.edu/~horton/markets.html

sennoma — Fri, 12 Jun 2009 04:21:00 -0400

Tagged by sennoma under open.foo, mechanicalturk,

A Computer Scientist in a Business School

sennoma — Tue, 02 Jun 2009 05:08:00 -0400

Tagged by sennoma under mechanicalturk,

A Computer Scientist in a Business School: How good are you, Turker?

sennoma — Sun, 25 Jan 2009 03:58:00 -0500

Tagged by sennoma under mechanicalturk, webtools,