POLAR: Detecting Multilingual, Multicultural and Multievent Online Polarization

# POLAR: Detecting Multilingual, Multicultural and Multievent Online Polarization
# Based on Naseem et al., SemEval-2026 Task 9
# Paper: https://aclanthology.org/2026.semeval-1.453/
# Task page: https://polar-semeval.github.io/
#
# Given a social-media post (one of 22 languages), judge whether it is
# polarized. The shared task has three subtasks:
#   - Subtask 1: binary polarization detection (polarized / not)
#   - Subtask 2: polarization type (the social dimension involved)
#   - Subtask 3: manifestation categories (how polarization is expressed)
# The organizers characterize polarization as encompassing stereotyping,
# vilification, dehumanization, and intolerance toward social groups; those
# form the manifestation labels below. This showcase collects the binary
# label, the manifestation(s), and the polarization type as free text
# (the official type inventory is defined by the task).

annotation_task_name: "POLAR - Online Polarization"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
export_annotation_format: "jsonl"

port: 8000

annotation_schemes:
  - annotation_type: radio
    name: polarized
    description: "Is this post polarized?"
    labels:
      - name: "Polarized"
        key_value: "1"
      - name: "Not polarized"
        key_value: "2"

  - annotation_type: multiselect
    name: manifestation
    description: "If polarized, how is it manifested? (Select all that apply)"
    labels:
      - name: "Stereotyping"
        tooltip: "Attributing fixed, oversimplified traits to a group"
      - name: "Vilification"
        tooltip: "Portraying a group as evil, blameworthy, or threatening"
      - name: "Dehumanization"
        tooltip: "Denying a group's humanity (e.g. comparing to animals/objects)"
      - name: "Intolerance"
        tooltip: "Rejecting a group's right to exist, speak, or participate"

  - annotation_type: text
    name: polarization_type
    description: "If polarized, what is the target dimension/type (e.g. political, religious, ethnic, gender)? - optional"
    textarea: false
    required: false

annotation_instructions: |
  Read the social-media post (an English gloss is provided for reference).
  First decide whether it is polarized. If it is, select how the
  polarization is manifested (stereotyping, vilification, dehumanization,
  intolerance) and note the target dimension (e.g. political, religious,
  ethnic, gender).

user_config:
  allow_all_users: true
max_annotations_per_user: 50
num_annotators_per_item: 3