beginnerevaluation
#HashtagWars - Learning a Sense of Humor
Humor ranking of tweets submitted to Comedy Central's @midnight #HashtagWars, classifying comedic quality. Based on SemEval-2017 Task 6.
設定ファイルconfig.yaml
# #HashtagWars - Learning a Sense of Humor
# Based on Potash et al., SemEval 2017
# Paper: https://aclanthology.org/S17-2004/
# Dataset: https://github.com/pppotash/SemEval-2017-Task-6
#
# This task asks annotators to rate the funniness of tweets submitted
# to Comedy Central's @midnight #HashtagWars segments.
#
# Humor Labels:
# - Funny (Winner): The tweet is genuinely funny and could win the competition
# - Somewhat Funny: The tweet has some humor but is not top-tier
# - Not Funny: The tweet is not funny or misses the mark
annotation_task_name: "#HashtagWars - Humor Rating"
task_dir: "."
data_files:
- sample-data.json
item_properties:
id_key: "id"
text_key: "text"
output_annotation_dir: "annotation_output/"
output_annotation_format: "json"
port: 8000
server_name: localhost
annotation_schemes:
- annotation_type: radio
name: humor_rating
description: "How funny is this tweet in response to the hashtag prompt?"
labels:
- "Funny (Winner)"
- "Somewhat Funny"
- "Not Funny"
keyboard_shortcuts:
"Funny (Winner)": "1"
"Somewhat Funny": "2"
"Not Funny": "3"
tooltips:
"Funny (Winner)": "The tweet is genuinely funny and stands out as a potential winner"
"Somewhat Funny": "The tweet has some humor but is not exceptional"
"Not Funny": "The tweet is not funny, too obvious, or misses the mark"
annotation_instructions: |
You will be shown a tweet that was submitted in response to a #HashtagWars prompt
from Comedy Central's @midnight show. Your task is to rate how funny the tweet is.
Consider creativity, wit, and comedic timing in your judgment.
html_layout: |
<div style="padding: 15px; max-width: 800px; margin: auto;">
<div style="background: #fefce8; border: 1px solid #fde68a; border-radius: 8px; padding: 12px; margin-bottom: 12px;">
<strong style="color: #a16207;">Hashtag Prompt:</strong>
<span style="font-size: 15px; font-weight: bold;">{{hashtag_prompt}}</span>
</div>
<div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
<strong style="color: #0369a1;">Tweet:</strong>
<p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
</div>
</div>
allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false
サンプルデータsample-data.json
[
{
"id": "humor_001",
"text": "My diet starts Monday. Just like it has every Monday since 2003.",
"hashtag_prompt": "#MyDietIn5Words"
},
{
"id": "humor_002",
"text": "Please stop talking about crossfit.",
"hashtag_prompt": "#ThingsYouSayAtThanksgiving"
}
]
// ... and 8 more itemsこのデザインを取得
View on GitHub
Clone or download from the repository
クイックスタート:
git clone https://github.com/davidjurgens/potato-showcase.git cd potato-showcase/semeval/2017/task06-hashtagwars-humor potato start config.yaml
詳細
アノテーションタイプ
radio
ドメイン
SemEvalNLPHumor DetectionSocial Media
ユースケース
Humor DetectionComedy EvaluationSocial Media Analysis
タグ
semevalsemeval-2017shared-taskhumorhashtagwarscomedytwitter
問題を見つけた場合やデザインを改善したい場合は?
Issueを作成関連デザイン
AfriSenti - African Language Sentiment
Sentiment analysis for tweets in African languages, classifying text as positive, negative, or neutral. Covers 14 African languages including Amharic, Hausa, Igbo, Yoruba, and Swahili. Based on SemEval-2023 Task 12 (Muhammad et al.).
radio
Detecting Stance in Tweets
Classification of stance expressed in tweets toward specific targets as favor, against, or neither. Based on SemEval-2016 Task 6 (Stance Detection).
radio
Detection and Interpretation of English Puns
Detection of puns in text with identification of the specific pun word, combining binary classification with span annotation. Based on SemEval-2017 Task 7.
radiospan