SenseRel: Denotational and Connotational Meaning Relations

# SenseRel — Denotational and Connotational Meaning Relations
# Based on the SenseRel benchmark:
#   Cassotti, Baes, De Pascale, Martins Camboim de Sá, Periti, Haslam,
#   Geeraerts, and Tahmasebi (2026), "SenseRel: A Sense-Level Benchmark for
#   Denotational and Connotational Meaning Relations."
#   ACL 2026 (Vol. 1: Long Papers), pp. 499-515.
#   Paper: https://aclanthology.org/2026.acl-long.20/
#   Project (code on GitHub, data on Zenodo): https://www.changeiskey.org/publication/2026-acl/
#
# Each item shows a word with two senses (an original sense and a related sense),
# each given as a definition with an example. Annotators record:
#   1. the DENOTATIONAL relation between the senses — one of five types
#      (generalization, specialization, metonymy, metaphor, homonymy);
#   2. the CONNOTATIONAL difference between the senses along two affective
#      dimensions, valence and arousal, on a Same / Small / Big difference scale
#      (the paper's pair-comparison "Difference" setting, Table 2).

annotation_task_name: "SenseRel - Meaning Relations"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "word"

output_annotation_dir: "annotation_output/"
export_annotation_format: "jsonl"

port: 8000

annotation_schemes:
  - annotation_type: radio
    name: denotational_relation
    description: "What is the denotational (conceptual) relation from Sense A (original) to Sense B (new)?"
    labels:
      - name: "Generalization"
        tooltip: "Sense A is a sub-case of Sense B (broadening/widening), e.g. calf: young cow -> young of various large mammals"
      - name: "Specialization"
        tooltip: "Sense B is a sub-case of Sense A (narrowing/restriction), e.g. escort: any companion -> a specific kind of companion"
      - name: "Metonymy"
        tooltip: "Sense B's referent is related to Sense A's by contiguity, e.g. head: body part -> the mind/intellect"
      - name: "Metaphor"
        tooltip: "Sense B's referent is related to Sense A's by figurative similarity, e.g. wing: bird's wing -> wing of a building"
      - name: "Homonymy"
        tooltip: "Sense B is etymologically unrelated to Sense A (different lexemes that happen to share a form) - a control case"

  - annotation_type: radio
    name: valence_difference
    description: "How much do the two senses differ in VALENCE (pleasantness / good-bad)?"
    labels:
      - name: "Same"
        tooltip: "No meaningful difference in pleasantness between the senses"
      - name: "Small"
        tooltip: "A small shift in pleasantness/unpleasantness"
      - name: "Big"
        tooltip: "A large shift in pleasantness/unpleasantness"

  - annotation_type: radio
    name: arousal_difference
    description: "How much do the two senses differ in AROUSAL (energy / calm-excited)?"
    labels:
      - name: "Same"
        tooltip: "No meaningful difference in arousal/energy between the senses"
      - name: "Small"
        tooltip: "A small shift in arousal/energy"
      - name: "Big"
        tooltip: "A large shift in arousal/energy"

annotation_instructions: |
  Each item shows a WORD and two of its senses: Sense A (the original meaning)
  and Sense B (a related, newer meaning), each with a short definition and an
  example.

  First, choose the denotational relation that best describes how Sense B relates
  to Sense A: generalization, specialization, metonymy, metaphor, or homonymy
  (see the tooltips for definitions and examples). Note that generalization and
  specialization are mirror images that depend on which sense is taken as the
  starting point.

  Then judge how much the two senses differ in affective meaning: valence
  (pleasant vs. unpleasant) and arousal (calm vs. excited), each as Same, Small,
  or Big difference.

user_config:
  allow_all_users: true
max_annotations_per_user: 40
num_annotators_per_item: 3