Skip to content
Showcase/AfriSenti - African Language Sentiment
beginnertext

AfriSenti - African Language Sentiment

Sentiment analysis for tweets in African languages, classifying text as positive, negative, or neutral. Covers 14 African languages including Amharic, Hausa, Igbo, Yoruba, and Swahili. Based on SemEval-2023 Task 12 (Muhammad et al.).

Submit

配置文件config.yaml

# AfriSenti - African Language Sentiment
# Based on Muhammad et al., SemEval 2023
# Paper: https://aclanthology.org/2023.semeval-1.315/
# Dataset: https://github.com/afrisenti-semeval/afrisent-semeval-2023
#
# This task asks annotators to classify the sentiment of tweets written
# in African languages. The three-way classification covers positive,
# negative, and neutral sentiment.
#
# Sentiment Labels:
# - Positive: The tweet expresses positive sentiment, happiness, or approval
# - Negative: The tweet expresses negative sentiment, sadness, or disapproval
# - Neutral: The tweet is factual, balanced, or does not express clear sentiment

annotation_task_name: "AfriSenti - African Language Sentiment"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

port: 8000
server_name: localhost

annotation_schemes:
  - annotation_type: radio
    name: sentiment
    description: "What is the sentiment expressed in this tweet?"
    labels:
      - "Positive"
      - "Negative"
      - "Neutral"
    keyboard_shortcuts:
      "Positive": "1"
      "Negative": "2"
      "Neutral": "3"
    tooltips:
      "Positive": "The tweet expresses positive sentiment, happiness, satisfaction, or approval"
      "Negative": "The tweet expresses negative sentiment, sadness, frustration, or disapproval"
      "Neutral": "The tweet is factual, balanced, or does not express clear positive or negative sentiment"

annotation_instructions: |
  You will see a tweet written in an African language along with the language identifier.
  Classify the overall sentiment of the tweet as Positive, Negative, or Neutral.
  Focus on the emotional tone and attitude expressed, not just the topic.

html_layout: |
  <div style="padding: 15px; max-width: 800px; margin: auto;">
    <div style="background: #ecfdf5; border: 1px solid #a7f3d0; border-radius: 8px; padding: 12px; margin-bottom: 12px;">
      <strong style="color: #065f46;">Language:</strong>
      <span style="font-size: 15px; margin-left: 8px;">{{language}}</span>
    </div>
    <div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
      <strong style="color: #0369a1;">Tweet:</strong>
      <p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
    </div>
  </div>

allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 3
allow_skip: true
skip_reason_required: false

示例数据sample-data.json

[
  {
    "id": "afrisenti_001",
    "text": "Mun ji dadin abinda gwamnati ta yi mana. Sababbin hanyoyi da asibitoci sun taimaka sosai.",
    "language": "Hausa"
  },
  {
    "id": "afrisenti_002",
    "text": "Ihe a na-eme n'obodo anyi adi mma. Ndi isi obodo anaghi aru oru nke oma.",
    "language": "Igbo"
  }
]

// ... and 8 more items

获取此设计

View on GitHub

Clone or download from the repository

快速开始:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/semeval/2023/task12-afrisenti
potato start config.yaml

详情

标注类型

radio

领域

NLPSocial MediaSemEval

应用场景

Sentiment AnalysisMultilingual NLPLow-Resource Languages

标签

semevalsemeval-2023shared-tasksentimentafrican-languagesmultilinguallow-resource

发现问题或想改进此设计?

提交 Issue