Skip to content
beginnertext

Emphasis Selection for Written Text

Select words or phrases in short written text that should be emphasized (e.g., bolded or highlighted) to convey the author's intended meaning most effectively, based on SemEval-2020 Task 10 (Shirani et al.).

PERORGLOCPERORGLOCDATESelect text to annotate

Configuration Fileconfig.yaml

This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.

yaml
# Emphasis Selection for Written Text
# Based on Shirani et al., SemEval 2020
# Paper: https://aclanthology.org/2020.semeval-1.184/
# Dataset: https://github.com/RiTUAL-UH/SemEval2020_Task10_Emphasis_Selection
#
# Annotators select which words or phrases in a short text should be
# emphasized (e.g., bolded, highlighted) to best convey the intended
# meaning when displayed in visual media like posters or advertisements.

annotation_task_name: "Emphasis Selection for Written Text"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

port: 8000
server_name: localhost

annotation_schemes:
  - annotation_type: span
    name: emphasis_spans
    description: "Highlight the words or phrases that should be emphasized to best convey the intended meaning."
    labels:
      - "Emphasis"

annotation_instructions: |
  You will see a short text that could appear on a poster, advertisement, or
  social media graphic. Your task is to:
  1. Read the text carefully and understand its intended message.
  2. Select the words or phrases that should be visually emphasized (bolded,
     highlighted, or made larger) to most effectively communicate the message.
  3. Choose words that carry the most meaning and would draw the reader's
     attention to the key point.

  Typically, 1-4 words per sentence should be emphasized. Focus on the most
  impactful words rather than selecting entire phrases.

html_layout: |
  <div style="padding: 15px; max-width: 800px; margin: auto;">
    <div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
      <strong style="color: #0369a1;">Text:</strong>
      <p style="font-size: 18px; line-height: 1.8; margin: 8px 0 0 0;">{{text}}</p>
    </div>
  </div>

allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false

Sample Datasample-data.json

json
[
  {
    "id": "emph_001",
    "text": "The only way to do great work is to love what you do."
  },
  {
    "id": "emph_002",
    "text": "In the middle of difficulty lies opportunity."
  }
]

// ... and 8 more items

Get This Design

View on GitHub

Clone or download from the repository

Quick start:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/semeval/2020/task10-emphasis-selection
potato start config.yaml

Dataset & paper

Shirani et al., SemEval 2020

Citation (BibTeX)

bibtex
@inproceedings{shirani-etal-2020-semeval,
    title = "{S}em{E}val-2020 {T}ask 10: {E}mphasis {S}election for {W}ritten {T}ext in {V}isual {M}edia",
    author = "Shirani, Amirreza  and Dernoncourt, Franck  and Lipka, Nedim  and Asente, Paul  and Echevarria, Jose  and Solorio, Thamar",
    booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",
    month = dec,
    year = "2020",
    address = "Barcelona (online)",
    publisher = "International Committee for Computational Linguistics",
    pages = "1360--1370",
    doi = "10.18653/v1/2020.semeval-1.184",
    url = "https://aclanthology.org/2020.semeval-1.184"
}

Details

Annotation Types

span

Domain

NLPSemEval

Use Cases

Emphasis SelectionTypographyText Presentation

Tags

semevalsemeval-2020shared-taskemphasistypographytext-design

Found an issue or want to improve this design?

Open an Issue