From 471d9518b5cf5b8ac43150887f70c8627a119f41 Mon Sep 17 00:00:00 2001 From: jaseweston Date: Tue, 2 May 2017 22:26:02 -0400 Subject: [PATCH] Update README.md --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 374bdd2f8e4..067e4d74da5 100644 --- a/README.md +++ b/README.md @@ -240,6 +240,12 @@ To add your own task: ### MTurk +An important part of ParlAI is seamless integration with Mechanical Turk for data collection, training and evaluation. +Human Turkers are also viewed as agents in ParlAI and hence person-person, person-bot, or multiple people and bots in group chat can all converse within the standard framework, switching out the roles as desired with no code changes to the agents. This is because Turkers also receive and send via a (pretty printed) version of the same interface, using the fields of the observation/action dict. +We provide two examples in the first release, collecting data, and human evaluation of a bot. + +

+ The mturk library contains the following directories and files: - **core**: this directory contains the core code for setting up AWS backend that supports the MTurk chat interface, and code for HIT creation and approval.