Skip to content
Showcase/#HashtagWars - Learning a Sense of Humor
beginnerevaluation

#HashtagWars - Learning a Sense of Humor

Humor ranking of tweets submitted to Comedy Central's @midnight #HashtagWars, classifying comedic quality. Based on SemEval-2017 Task 6.

Submit

Configuration Fileconfig.yaml

# #HashtagWars - Learning a Sense of Humor
# Based on Potash et al., SemEval 2017
# Paper: https://aclanthology.org/S17-2004/
# Dataset: https://github.com/pppotash/SemEval-2017-Task-6
#
# This task asks annotators to rate the funniness of tweets submitted
# to Comedy Central's @midnight #HashtagWars segments.
#
# Humor Labels:
# - Funny (Winner): The tweet is genuinely funny and could win the competition
# - Somewhat Funny: The tweet has some humor but is not top-tier
# - Not Funny: The tweet is not funny or misses the mark

annotation_task_name: "#HashtagWars - Humor Rating"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

port: 8000
server_name: localhost

annotation_schemes:
  - annotation_type: radio
    name: humor_rating
    description: "How funny is this tweet in response to the hashtag prompt?"
    labels:
      - "Funny (Winner)"
      - "Somewhat Funny"
      - "Not Funny"
    keyboard_shortcuts:
      "Funny (Winner)": "1"
      "Somewhat Funny": "2"
      "Not Funny": "3"
    tooltips:
      "Funny (Winner)": "The tweet is genuinely funny and stands out as a potential winner"
      "Somewhat Funny": "The tweet has some humor but is not exceptional"
      "Not Funny": "The tweet is not funny, too obvious, or misses the mark"

annotation_instructions: |
  You will be shown a tweet that was submitted in response to a #HashtagWars prompt
  from Comedy Central's @midnight show. Your task is to rate how funny the tweet is.
  Consider creativity, wit, and comedic timing in your judgment.

html_layout: |
  <div style="padding: 15px; max-width: 800px; margin: auto;">
    <div style="background: #fefce8; border: 1px solid #fde68a; border-radius: 8px; padding: 12px; margin-bottom: 12px;">
      <strong style="color: #a16207;">Hashtag Prompt:</strong>
      <span style="font-size: 15px; font-weight: bold;">{{hashtag_prompt}}</span>
    </div>
    <div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
      <strong style="color: #0369a1;">Tweet:</strong>
      <p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
    </div>
  </div>

allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false

Sample Datasample-data.json

[
  {
    "id": "humor_001",
    "text": "My diet starts Monday. Just like it has every Monday since 2003.",
    "hashtag_prompt": "#MyDietIn5Words"
  },
  {
    "id": "humor_002",
    "text": "Please stop talking about crossfit.",
    "hashtag_prompt": "#ThingsYouSayAtThanksgiving"
  }
]

// ... and 8 more items

Get This Design

View on GitHub

Clone or download from the repository

Quick start:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/semeval/2017/task06-hashtagwars-humor
potato start config.yaml

Details

Annotation Types

radio

Domain

SemEvalNLPHumor DetectionSocial Media

Use Cases

Humor DetectionComedy EvaluationSocial Media Analysis

Tags

semevalsemeval-2017shared-taskhumorhashtagwarscomedytwitter

Found an issue or want to improve this design?

Open an Issue

Related Designs

AfriSenti - African Language Sentiment

Sentiment analysis for tweets in African languages, classifying text as positive, negative, or neutral. Covers 14 African languages including Amharic, Hausa, Igbo, Yoruba, and Swahili. Based on SemEval-2023 Task 12 (Muhammad et al.).

radio

Detecting Stance in Tweets

Classification of stance expressed in tweets toward specific targets as favor, against, or neither. Based on SemEval-2016 Task 6 (Stance Detection).

radio

Detection and Interpretation of English Puns

Detection of puns in text with identification of the specific pun word, combining binary classification with span annotation. Based on SemEval-2017 Task 7.

radiospan