Emphasis Selection for Written Text
Select words or phrases in short written text that should be emphasized (e.g., bolded or highlighted) to convey the author's intended meaning most effectively, based on SemEval-2020 Task 10 (Shirani et al.).
Configuration Fileconfig.yaml
This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.
# Emphasis Selection for Written Text
# Based on Shirani et al., SemEval 2020
# Paper: https://aclanthology.org/2020.semeval-1.184/
# Dataset: https://github.com/RiTUAL-UH/SemEval2020_Task10_Emphasis_Selection
#
# Annotators select which words or phrases in a short text should be
# emphasized (e.g., bolded, highlighted) to best convey the intended
# meaning when displayed in visual media like posters or advertisements.
annotation_task_name: "Emphasis Selection for Written Text"
task_dir: "."
data_files:
- sample-data.json
item_properties:
id_key: "id"
text_key: "text"
output_annotation_dir: "annotation_output/"
output_annotation_format: "json"
port: 8000
server_name: localhost
annotation_schemes:
- annotation_type: span
name: emphasis_spans
description: "Highlight the words or phrases that should be emphasized to best convey the intended meaning."
labels:
- "Emphasis"
annotation_instructions: |
You will see a short text that could appear on a poster, advertisement, or
social media graphic. Your task is to:
1. Read the text carefully and understand its intended message.
2. Select the words or phrases that should be visually emphasized (bolded,
highlighted, or made larger) to most effectively communicate the message.
3. Choose words that carry the most meaning and would draw the reader's
attention to the key point.
Typically, 1-4 words per sentence should be emphasized. Focus on the most
impactful words rather than selecting entire phrases.
html_layout: |
<div style="padding: 15px; max-width: 800px; margin: auto;">
<div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
<strong style="color: #0369a1;">Text:</strong>
<p style="font-size: 18px; line-height: 1.8; margin: 8px 0 0 0;">{{text}}</p>
</div>
</div>
allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false
Sample Datasample-data.json
[
{
"id": "emph_001",
"text": "The only way to do great work is to love what you do."
},
{
"id": "emph_002",
"text": "In the middle of difficulty lies opportunity."
}
]
// ... and 8 more itemsGet This Design
Clone or download from the repository
Quick start:
git clone https://github.com/davidjurgens/potato-showcase.git cd potato-showcase/semeval/2020/task10-emphasis-selection potato start config.yaml
Dataset & paper
Shirani et al., SemEval 2020
Citation (BibTeX)
@inproceedings{shirani-etal-2020-semeval,
title = "{S}em{E}val-2020 {T}ask 10: {E}mphasis {S}election for {W}ritten {T}ext in {V}isual {M}edia",
author = "Shirani, Amirreza and Dernoncourt, Franck and Lipka, Nedim and Asente, Paul and Echevarria, Jose and Solorio, Thamar",
booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",
month = dec,
year = "2020",
address = "Barcelona (online)",
publisher = "International Committee for Computational Linguistics",
pages = "1360--1370",
doi = "10.18653/v1/2020.semeval-1.184",
url = "https://aclanthology.org/2020.semeval-1.184"
}Details
Annotation Types
Domain
Use Cases
Tags
Found an issue or want to improve this design?
Open an IssueRelated Designs
Aspect-Based Sentiment Analysis
Identification of aspect terms in review text with sentiment polarity classification for each aspect. Based on SemEval-2016 Task 5 (ABSA).
Causal Medical Claim Identification and PIO Frame Extraction
Identify causal medical claim spans in Reddit health posts (Subtask 1: Claim, Experience, Experience-based claim, Question) and extract PIO frames — Population, Intervention, Outcome (Subtask 2). Based on SemEval-2023 Task 8 (Khetan et al.).
Character Identification on Multiparty Dialogues
Identification and linking of character mentions in TV show dialogue, combining span annotation with entity resolution for the main cast of Friends. Based on SemEval-2018 Task 4.