beginnerevaluation
#HashtagWars - Learning a Sense of Humor
Humor ranking of tweets submitted to Comedy Central's @midnight #HashtagWars, classifying comedic quality. Based on SemEval-2017 Task 6.
配置文件config.yaml
# #HashtagWars - Learning a Sense of Humor
# Based on Potash et al., SemEval 2017
# Paper: https://aclanthology.org/S17-2004/
# Dataset: https://github.com/pppotash/SemEval-2017-Task-6
#
# This task asks annotators to rate the funniness of tweets submitted
# to Comedy Central's @midnight #HashtagWars segments.
#
# Humor Labels:
# - Funny (Winner): The tweet is genuinely funny and could win the competition
# - Somewhat Funny: The tweet has some humor but is not top-tier
# - Not Funny: The tweet is not funny or misses the mark
annotation_task_name: "#HashtagWars - Humor Rating"
task_dir: "."
data_files:
- sample-data.json
item_properties:
id_key: "id"
text_key: "text"
output_annotation_dir: "annotation_output/"
output_annotation_format: "json"
port: 8000
server_name: localhost
annotation_schemes:
- annotation_type: radio
name: humor_rating
description: "How funny is this tweet in response to the hashtag prompt?"
labels:
- "Funny (Winner)"
- "Somewhat Funny"
- "Not Funny"
keyboard_shortcuts:
"Funny (Winner)": "1"
"Somewhat Funny": "2"
"Not Funny": "3"
tooltips:
"Funny (Winner)": "The tweet is genuinely funny and stands out as a potential winner"
"Somewhat Funny": "The tweet has some humor but is not exceptional"
"Not Funny": "The tweet is not funny, too obvious, or misses the mark"
annotation_instructions: |
You will be shown a tweet that was submitted in response to a #HashtagWars prompt
from Comedy Central's @midnight show. Your task is to rate how funny the tweet is.
Consider creativity, wit, and comedic timing in your judgment.
html_layout: |
<div style="padding: 15px; max-width: 800px; margin: auto;">
<div style="background: #fefce8; border: 1px solid #fde68a; border-radius: 8px; padding: 12px; margin-bottom: 12px;">
<strong style="color: #a16207;">Hashtag Prompt:</strong>
<span style="font-size: 15px; font-weight: bold;">{{hashtag_prompt}}</span>
</div>
<div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
<strong style="color: #0369a1;">Tweet:</strong>
<p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
</div>
</div>
allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false
示例数据sample-data.json
[
{
"id": "humor_001",
"text": "My diet starts Monday. Just like it has every Monday since 2003.",
"hashtag_prompt": "#MyDietIn5Words"
},
{
"id": "humor_002",
"text": "Please stop talking about crossfit.",
"hashtag_prompt": "#ThingsYouSayAtThanksgiving"
}
]
// ... and 8 more items获取此设计
View on GitHub
Clone or download from the repository
快速开始:
git clone https://github.com/davidjurgens/potato-showcase.git cd potato-showcase/semeval/2017/task06-hashtagwars-humor potato start config.yaml
详情
标注类型
radio
领域
SemEvalNLPHumor DetectionSocial Media
应用场景
Humor DetectionComedy EvaluationSocial Media Analysis
标签
semevalsemeval-2017shared-taskhumorhashtagwarscomedytwitter
发现问题或想改进此设计?
提交 Issue相关设计
AfriSenti - African Language Sentiment
Sentiment analysis for tweets in African languages, classifying text as positive, negative, or neutral. Covers 14 African languages including Amharic, Hausa, Igbo, Yoruba, and Swahili. Based on SemEval-2023 Task 12 (Muhammad et al.).
radio
Detecting Stance in Tweets
Classification of stance expressed in tweets toward specific targets as favor, against, or neither. Based on SemEval-2016 Task 6 (Stance Detection).
radio
Detection and Interpretation of English Puns
Detection of puns in text with identification of the specific pun word, combining binary classification with span annotation. Based on SemEval-2017 Task 7.
radiospan