Why do most requesters choose the US for their research? For many, it\u2019s the easiest way to ensure their work is done by a fluent English speaker. But in doing this, they narrow their demographic and miss out on some quality workers in the Mturk community. They also skip right over the fact that being in the US is not actually a guarantee that the worker is a fluent English speaker.<\/p>\n
The bot checks available today may answer the \u201care you human\u201d question, but maybe there are checks that could also open the requester to countries beyond the US. This would diversify their response pool and give them more dynamic data.<\/p>\n
By asking simple questions with unique English identifiers in them, you could weed out those that may not be the best suited for your study. Let us consider a few different ways this can be done.<\/p>\n
A few examples are that a study could include identifying idioms, keeping in mind idioms will exclude those not good with figurative speech. One could try mixing up the subject, object, and verb order as many non-English languages are subject, verb, and object. \u201cThe red car\u201d vs \u201cThe car red\u201d<\/p>\n
Many languages can skip the subject completely as it\u2019s inferred from the verb conjugation. English does not allow for this as easily. As an example: Question: \u201cWhat did you do this weekend?\u201d Answer:\u201d Went to the mall.\u201d Well, Who went to the mall? Just you, you and a friend, your family? English does not specify and thus to be clear, the subject must be present. Asking what is wrong with or missing from a phrase like \u201cWent to the mall\u201d could help verify a native\/fluent speaker.<\/p>\n
A sentence could simply leave out the first few words that define a comment, called a left-edge ellipsis, and then ask the worker to fill it in. For example: \u201cYou want coffee or tea?\u201d Most English speakers would understand the sentence, but a native\/fluent speaker would know that if grammar is a concern, the sentence should be \u201c[Do] you want coffee or tea?\u201d<\/p>\n
Omitting preceding auxiliaries from the main verb and asking if the sentence is correct is another option as many other languages do not use them. For example: \u201cI going to the bank.\u201d leaves out a preceding auxiliary, a native\/fluent speaker would know the phrase should read \u201cI [am] going to the bank\u201d<\/p>\n
So requesters, if you would gain from having data outside of the US, consider including the unique aspects of the English language in your attention checks and bring other countries into your data.<\/p>\n","protected":false},"excerpt":{"rendered":"
Why do most requesters choose the US for their research? For many, it\u2019s the easiest way to ensure their work is done by a fluent English speaker. But in doing this, they narrow their demographic and miss out on some quality workers in the Mturk community. They also skip right over the fact that being … <\/p>\n