Task Builder lets you get a dataset annotated by participants on Prolific, all in one workflow. This guide shows you how to build your task, set up your study, and publish it.
Before you start, you’ll need a dataset in CSV or JSON format. You can upload a file or paste JSON directly. For help formatting your data, read our guide on preparing your CSV file for Task Builder.
Part 1: Build your task
1.1 Add your dataset
Add your dataset in CSV or JSON format, or paste JSON and select "Apply JSON" to create tasks.
Here's an example of what your CSV file might look like:
1.2 Map your dataset
After you upload your file, Task Builder shows the “Dataset Mapping” section. It lists each column in your file as a field, with a sample value from your data underneath.
Check the “Fields” and “Items” counts at the top right. They show how many columns and rows Task Builder found in your file
For each field, open the dropdown and choose how Task Builder uses it. Task Builder suggests an option based on your data and shows it below the dropdown, for example “Suggested: Text”
Select the checkbox to confirm you’ve read and agreed to the Task Builder Terms and Conditions
Select “Next”
1.3 Add your task details
After you map your dataset, Task Builder asks for the details participants see before they start your task.
Enter a “Task name”
Add a “Task introduction” to explain what your task is about
Add “Task steps” with clear, detailed instructions for what participants need to do
Select “Next” to continue
1.4 Build your task experience
After you add your task details, Task Builder opens the visual builder. Drag components onto the page to design what participants see and do. You only need to build your layout once. Task Builder applies it to every task created from your dataset.
The “Task components” panel has three groups:
Questions: Collect responses from participants
Question types include “Multiple selection,” “Free text,” “Free text w/ unit,” “Multiple selection w/ free text,” “File upload,” “Star rating,” and “Video narration"
Content: Add images or formatted text
Dataset fields: Show data from your uploaded file, such as prompts, model responses, or audio files
To build your task:
Drag a dataset field, such as “Prompt,” onto “Page 1” to show that data to participants
Add any extra context with an “Image” or “Rich text” component
Drag a question component for each response you need, such as “Star rating” or “Multiple selection”
Select the plus icon next to “Page 1” to add more pages
Select “+ Intro” or “+ Outro” to add a welcome or closing page
Check the counts on the right to see how many questions, content blocks, and pages you’ve added
Select “Preview as participant” to see your task the way participants will
Select “Save as draft” to finish later, or select “Save & set up study” to continue
Dataset fields can sit next to each other, such as two model responses, so participants can compare them side by side.
To edit, duplicate, or delete a component, select the three dots on it. To manage your pages, select the three dots next to a page name to duplicate or delete it, and select a page tab to switch between pages.
Part 2: Set up and publish your study
2.1 Set the number of tasks per participant
When you’re ready to set up your study, choose how many tasks each participant can complete in one session. This is a maximum, not a minimum. For example, if you set the limit to five, a participant can complete up to five tasks. The limit counts annotations, not time spent.
Saving this limit locks your task design and the number of tasks per participant. You can't change either after you save, so double-check both before you continue.
2.2 Choose a project
After you set your task limit, Task Builder asks which project to add your batch to.
Choose “Existing project” and select a project from the dropdown, or choose “New project”
Select “Set up study”
2.3 Select your batch and annotators
On the study setup page, go to the “Task Builder” section, then:
Keep “Batch annotation” selected under “Task format”
Check the “Select your batch” dropdown shows the batch you just built
Enter how many participants should annotate each task
A batch is the set of tasks Task Builder creates from your dataset.
2.4 Publish your study
Once you’ve finished setting up your study, you’re ready to publish. For help with the rest of your study settings, read our step-by-step guide to setting up a study.
2.5 Download your data
Download your annotated data once participants have completed your tasks. You can access the annotation data directly from the submissions page. Additionally, you can download demographic data in a separate file.








