Financial PhraseBank: Financial News Sentiment Dataset
Financial PhraseBank labels English financial news sentences as positive, negative, or neutral by their likely effect on the company's stock price. This Potato config reproduces the annotation task.
About this dataset
Financial PhraseBank is a sentiment-labeled corpus of English financial news sentences built by Malo, Sinha, Korhonen, Wallenius, and Takala at Aalto University School of Business. The work appeared in the Journal of the Association for Information Science and Technology in 2014.
The sentences were drawn from financial news on companies listed on OMX Helsinki, retrieved through LexisNexis. A team of 16 annotators with finance backgrounds judged each sentence, with 5 to 8 annotations per sentence. The dataset ships in four agreement-based subsets: 4,846 sentences at >=50% agreement, 4,217 at >=66%, 3,453 at >=75%, and 2,264 with full agreement.
Each sentence carries one of three labels: positive, negative, or neutral. Annotators rated sentiment from the investor's view, asking how the information would likely move the mentioned company's stock price rather than judging general tone. The dataset is a standard benchmark for financial sentiment models, including FinBERT.
The Potato config below reproduces the task with a radio scheme for the coarse positive/negative/neutral label and a select scheme for a five-point fine-grained scale, so annotators can record both the overall sentiment and its strength.
- Sentences (>=50% agree)
- 4,846
- Full-agreement subset
- 2,264
- Sentiment labels
- Positive, Negative, Neutral
- Annotators
- 16 (5-8 per sentence)
- Source
- OMX Helsinki news via LexisNexis
- Reference
- Malo et al., JASIST 2014
Configuration Fileconfig.yaml
This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.
# Financial PhraseBank - Sentiment Classification
# Based on Malo et al., JASIST 2014
# Paper: https://arxiv.org/abs/1307.5336
# Dataset: https://huggingface.co/datasets/financial_phrasebank
#
# This task classifies the sentiment of financial news sentences.
# Annotators assign both a fine-grained sentiment level (5-point scale)
# and a coarse-grained sentiment label (positive, negative, neutral)
# to each sentence from financial news articles.
#
# Fine-Grained Sentiment:
# - Strong Positive: Clear positive impact on company/market
# - Moderate Positive: Mild positive implications
# - Neutral: No sentiment or balanced positive/negative
# - Moderate Negative: Mild negative implications
# - Strong Negative: Clear negative impact on company/market
#
# Annotation Guidelines:
# 1. Read the sentence carefully in its financial context
# 2. Select the fine-grained sentiment level
# 3. Select the coarse-grained overall sentiment
# 4. Focus on investor/market perspective, not general sentiment
annotation_task_name: "Financial PhraseBank - Sentiment Classification"
task_dir: "."
data_files:
- sample-data.json
item_properties:
id_key: "id"
text_key: "text"
output_annotation_dir: "annotation_output/"
output_annotation_format: "json"
port: 8000
server_name: localhost
annotation_schemes:
- annotation_type: select
name: fine_grained_sentiment
description: "Select the fine-grained sentiment level of this financial sentence"
labels:
- "Strong Positive"
- "Moderate Positive"
- "Neutral"
- "Moderate Negative"
- "Strong Negative"
- annotation_type: radio
name: overall_sentiment
description: "What is the overall sentiment of this financial sentence?"
labels:
- "Positive"
- "Negative"
- "Neutral"
keyboard_shortcuts:
"Positive": "1"
"Negative": "2"
"Neutral": "3"
tooltips:
"Positive": "The sentence conveys positive financial news or outlook"
"Negative": "The sentence conveys negative financial news or outlook"
"Neutral": "The sentence is neutral or purely factual without sentiment"
annotation_instructions: |
You will be shown a sentence from a financial news article. Your task is to:
1. Determine the fine-grained sentiment (Strong Positive to Strong Negative).
2. Assign the overall sentiment label (Positive, Negative, or Neutral).
Important: Judge sentiment from an investor or market perspective, not general sentiment.
For example, "layoffs" might be negative generally but could be positive for investors
if it signals cost-cutting measures.
html_layout: |
<div style="padding: 15px; max-width: 800px; margin: auto;">
<div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
<strong style="color: #0369a1;">Financial News Sentence:</strong>
<p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
</div>
</div>
allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false
Sample Datasample-data.json
[
{
"id": "finphrase_001",
"text": "The company reported a 25% increase in quarterly revenue, exceeding analyst expectations by a significant margin."
},
{
"id": "finphrase_002",
"text": "Operating profit fell to EUR 35.4 million from EUR 68.1 million in the corresponding period last year."
}
]
// ... and 8 more itemsGet This Design
Clone or download from the repository
Quick start:
git clone https://github.com/davidjurgens/potato-showcase.git cd potato-showcase/text/financial/financial-phrasebank-sentiment potato start config.yaml
Dataset & paper
Malo et al., JASIST 2014
Citation (BibTeX)
@article{malo2014good,
title = "Good debt or bad debt: Detecting semantic orientations in economic texts",
author = "Malo, Pekka and Sinha, Ankur and Korhonen, Pekka and Wallenius, Jyrki and Takala, Pyry",
journal = "Journal of the Association for Information Science and Technology",
volume = "65",
number = "4",
pages = "782--796",
year = "2014",
url = "https://arxiv.org/abs/1307.5336"
}Details
Annotation Types
Domain
Use Cases
Tags
Found an issue or want to improve this design?
Open an IssueRelated Designs
KG-BERT Knowledge Graph Triple Validation
Validate knowledge graph triples for correctness and annotate relation types based on the KG-BERT framework. Annotators assess whether entity-relation-entity triples are valid, classify the relation type, and provide entity descriptions.
MS MARCO: Passage Ranking Benchmark
MS MARCO is a large-scale information retrieval benchmark of 8.8M passages and real Bing queries with relevance judgments. This Potato task reproduces graded passage-relevance annotation.
SemEval-2007 - Word Sense Disambiguation
Word sense disambiguation task based on the SemEval-2007 English lexical sample (Pradhan et al.). Annotators identify the correct sense of a target word in context from a provided list of sense definitions.