Cavity-Nesting Bird Freelists from Rural Children
List native cavity-nesting birds with the free_list scheme and ordered entry for salience analysis. The respondent slots are illustrative.
Get This Design
Clone or download from the repository
Quick start:
git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/text/computational-social-science/freelist-cavity-nesting-birds
potato start config.yamlAbout this dataset
Bonaparte, Ibarra, Liefländer, Sosa, and Cockle (2024) studied rural children's knowledge of native cavity-nesting birds in the Atlantic Forest of Misiones, Argentina. The abstract reports freelists and draw-and-explain activities with 235 children from 19 rural schools, a list of 93 taxa of native cavity-nesting birds, and a comparison with a four-year field dataset of trees and tree-cavity nests. The data are deposited on Dryad under CC0.
The Methods details below are quoted from the Dryad dataset page. In the freelist activity each child received a sheet with ten numbered rows and was asked to write down the ten species of native birds the child knew that lived in the wild on farms that first came to mind. A child who knew fewer could write as many as the child could, and a child who knew more could keep writing on the back. The paper then computes the salience of each item from the rank of each item within the list. The design reproduces the list-writing step with Potato's free_list scheme, which stores the items in the order the items were typed. The prompt is the paper's reported instruction in second person, the list has no maximum, and typing replaces pencil and paper.
The highlighting step, in which children marked the listed birds that the children thought nest in tree cavities, is left out because Potato has no scheme that shows a participant the participant's own list for a second pass. The drawing activity and the tree comparison are not reproduced either. The dataset's dissimilarity file compares tree groups, so the design has no triad test. The sample items are ten respondent slots rather than real respondents, because the raw free lists could not be downloaded without Dryad API credentials. Potato's cultural_domain export computes item salience from the stored lists. No trainer in Potato consumes free_list answers, so the design has no model_training block.
- Children (abstract)
- 235 from 19 rural schools
- Ages (Methods, Dryad page)
- 10 to 13 years
- Native cavity-nesting bird taxa listed (abstract)
- 93
- Field dataset (abstract)
- 328 trees and 164 tree-cavity nests
- Licence (DataCite rights)
- CC0 1.0
Configuration File
This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.
# Free-listing native cavity-nesting birds, after Bonaparte et al. 2024
#
# Dataset: Bonaparte, Ibarra, Liefländer, Sosa, and Cockle (2024). "Rural
# children know cavity-nesting birds of the Atlantic Forest but may
# underappreciate their critical habitat." Dryad dataset, version 5.
# DOI: 10.5061/dryad.kkwh70sd8
# https://datadryad.org/dataset/doi:10.5061/dryad.kkwh70sd8
# Licence: CC0 1.0 (DataCite rights record "Creative Commons Zero v1.0
# Universal").
# Paper: Bonaparte, E. B., Ibarra, J. T., Liefländer, A. K., Sosa, M. H., and
# Cockle, K. L. (2024). Ornithological Applications 127. Oxford University
# Press. DOI: 10.1093/ornithapp/duae052
# https://doi.org/10.1093/ornithapp/duae052
#
# What the study did (Methods text as given on the Dryad dataset page; the
# article itself could not be fetched, so these quotes are not checked
# against the OUP article):
# Each child received "a sheet of paper with spaces to write their name, age,
# and grade, followed by ten numbered rows to write the names of bird
# species." The children were instructed "to write down the ten species of
# native birds they knew that lived in the wild on farms that first came to
# mind." Children who knew fewer than ten "could write down as many as they
# could", and children who knew more "had the option to continue writing on
# the back of the paper." Afterward each child received a highlighter and was
# asked "to highlight only the species on their lists that they considered
# to nest in tree cavities." The abstract reports 235 children from 19 rural
# schools; the Methods text on the Dryad page says 236 students aged 10 to 13.
#
# Analysis the list format supports: the paper computes the salience of each
# item as (n + 1 - k) / n, where n is the number of birds listed and k is
# the rank at which an item was listed, then Smith salience across lists.
# The free_list scheme keeps the order each item was typed in, which is the
# data that formula needs. Potato's cultural_domain export computes salience
# from the stored lists:
# python -m potato.export --config <this file> --format cultural_domain \
# --output out/cultural-domain
#
# Adaptations (the original protocol was pencil on paper at schools):
# - The prompt below is the paper's reported instruction put into second
# person. The children's actual wording on the day is not in the paper,
# which is written in English, and the dataset README was not readable
# when this design was built.
# - The original sheet had ten numbered rows and let children write more.
# Here min_items is 1 and no maximum is set, which matches "as many as
# they could" and the option to keep writing.
# - Typing replaces handwriting. normalize: true lowercases and trims items
# in the export only; the stored list is what the participant typed.
# - The highlighting step (marking which listed birds nest in tree
# cavities) is left out. Potato has no scheme that shows a participant
# their own free list for a follow-up marking pass.
# - Sample items are respondent slots, not real respondents. The raw
# free lists in the Dryad deposit (freelist_rawdata.csv) are CC0 but the
# file could not be downloaded without Dryad API credentials, so no real
# responses are shown here.
# - The paper's drawing activity and its comparison with field data on
# trees and nests are not reproduced. The dataset's trees_dissimilarity
# file is a Morisita dissimilarity between tree-taxon groups, not a triad
# task, so no triad_test is included.
#
# No model_training block. Potato has no trainer that consumes free_list
# answers, so this design collects lists and exports them for salience
# analysis and does not train anything.
annotation_task_name: "Free-Listing Native Cavity-Nesting Birds (Atlantic Forest)"
task_dir: "."
data_files:
- sample-data.json
item_properties:
id_key: "id"
text_key: "text"
output_annotation_dir: "annotation_output/"
export_annotation_format: "jsonl"
port: 8000
annotation_schemes:
- annotation_type: free_list
name: native_birds
description: "Write down the native birds you know that live in the wild on farms, the ones that first come to mind."
instructions: >-
Type one bird name, then press Enter. Write the birds in the order they
come to mind, because the order is part of the answer. If you know fewer
than ten, write as many as you can. If you know more than ten, keep
going.
min_items: 1
normalize: true
label_requirement:
required: true
user_config:
allow_all_users: true
users: []
annotation_instructions: |
This is a free-listing task. You will see a respondent slot and one list box. Write the native birds you know that live in the wild on farms, in the order they come to mind. There are no right or wrong answers, and nobody is scored on the list.
Sample Data
[
{
"id": "fl_001",
"text": "Respondent slot 1 of 10. Write this respondent's list of native birds that live in the wild on farms."
},
{
"id": "fl_002",
"text": "Respondent slot 2 of 10. Write this respondent's list of native birds that live in the wild on farms."
}
]
// ... and 8 more itemsGet This Design
Clone or download from the repository
Quick start:
git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/text/computational-social-science/freelist-cavity-nesting-birds
potato start config.yamlDataset & paper
Bonaparte et al., Ornithological Applications 2024
- Paper DOI
- 10.1093/ornithapp/duae052
- Dataset DOI
- 10.5061/dryad.kkwh70sd8
Citation (BibTeX)
@article{Bonaparte_2024,
title = {Rural children know cavity-nesting birds of the Atlantic Forest but may underappreciate their critical habitat},
volume = {127},
ISSN = {2732-4621},
url = {http://dx.doi.org/10.1093/ornithapp/duae052},
DOI = {10.1093/ornithapp/duae052},
number = {1},
journal = {Ornithological Applications},
publisher = {Oxford University Press (OUP)},
author = {Bonaparte, Eugenia Bianca and Ibarra, José Tomás and Liefländer, Anne K and Sosa, Marcos Hugo and Cockle, Kristina L},
year = {2024},
month = oct
}
@misc{Bonaparte_2024_dryad,
doi = {10.5061/DRYAD.KKWH70SD8},
url = {https://datadryad.org/dataset/doi:10.5061/dryad.kkwh70sd8},
author = {Bonaparte, Eugenia Bianca and Ibarra, José Tomás and Liefländer, Anne K. and Sosa, Marcos Hugo and Cockle, Kristina L.},
title = {Rural children know cavity-nesting birds of the Atlantic Forest but may underappreciate their critical habitat},
publisher = {Dryad},
year = {2024},
copyright = {Creative Commons Zero v1.0 Universal}
}Details
Annotation Types
Domain
Use Cases
Tags
Found an issue or want to improve this design?
Open an Issue(opens in a new tab)Related Designs
Binarized Scoring Rule Belief Elicitation
Report probabilities on a 0 to 100 slider in an urn task paid by the binarized scoring rule through Potato's incentives block, on illustrative scenarios.
Gallup Most Important Problem: Open-Ended Answer Coding with the Policy Agendas Codebook
Deductive coding of open-ended answers to Gallup's "most important problem" question into the Policy Agendas Project major topics, with a fixed codebook, two independent coders per answer, Krippendorff's alpha on the admin dashboard, private memos, and adjudication of disagreements. The Policy Agendas data are yearly topic shares and carry no individual answers, so the ten sample answers are synthetic.
Vote-Buying List Experiment for Sensitive Questions
Run a list experiment on vote buying with conditions assigning control or treatment. The interview slots are illustrative, and no respondent data is included.