Skip to content
Showcase/Financial PhraseBank: Financial News Sentiment Dataset
beginnertext

Financial PhraseBank: Financial News Sentiment Dataset

Financial PhraseBank labels English financial news sentences as positive, negative, or neutral by their likely effect on the company's stock price. This Potato config reproduces the annotation task.

About this dataset

Financial PhraseBank is a sentiment-labeled corpus of English financial news sentences built by Malo, Sinha, Korhonen, Wallenius, and Takala at Aalto University School of Business. The work appeared in the Journal of the Association for Information Science and Technology in 2014.

The sentences were drawn from financial news on companies listed on OMX Helsinki, retrieved through LexisNexis. A team of 16 annotators with finance backgrounds judged each sentence, with 5 to 8 annotations per sentence. The dataset ships in four agreement-based subsets: 4,846 sentences at >=50% agreement, 4,217 at >=66%, 3,453 at >=75%, and 2,264 with full agreement.

Each sentence carries one of three labels: positive, negative, or neutral. Annotators rated sentiment from the investor's view, asking how the information would likely move the mentioned company's stock price rather than judging general tone. The dataset is a standard benchmark for financial sentiment models, including FinBERT.

The Potato config below reproduces the task with a radio scheme for the coarse positive/negative/neutral label and a select scheme for a five-point fine-grained scale, so annotators can record both the overall sentiment and its strength.

Sentences (>=50% agree)
4,846
Full-agreement subset
2,264
Sentiment labels
Positive, Negative, Neutral
Annotators
16 (5-8 per sentence)
Source
OMX Helsinki news via LexisNexis
Reference
Malo et al., JASIST 2014
Submit

Configuration Fileconfig.yaml

This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.

yaml
# Financial PhraseBank - Sentiment Classification
# Based on Malo et al., JASIST 2014
# Paper: https://arxiv.org/abs/1307.5336
# Dataset: https://huggingface.co/datasets/financial_phrasebank
#
# This task classifies the sentiment of financial news sentences.
# Annotators assign both a fine-grained sentiment level (5-point scale)
# and a coarse-grained sentiment label (positive, negative, neutral)
# to each sentence from financial news articles.
#
# Fine-Grained Sentiment:
# - Strong Positive: Clear positive impact on company/market
# - Moderate Positive: Mild positive implications
# - Neutral: No sentiment or balanced positive/negative
# - Moderate Negative: Mild negative implications
# - Strong Negative: Clear negative impact on company/market
#
# Annotation Guidelines:
# 1. Read the sentence carefully in its financial context
# 2. Select the fine-grained sentiment level
# 3. Select the coarse-grained overall sentiment
# 4. Focus on investor/market perspective, not general sentiment

annotation_task_name: "Financial PhraseBank - Sentiment Classification"
task_dir: "."

data_files:
  - sample-data.json

item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

port: 8000
server_name: localhost

annotation_schemes:
  - annotation_type: select
    name: fine_grained_sentiment
    description: "Select the fine-grained sentiment level of this financial sentence"
    labels:
      - "Strong Positive"
      - "Moderate Positive"
      - "Neutral"
      - "Moderate Negative"
      - "Strong Negative"

  - annotation_type: radio
    name: overall_sentiment
    description: "What is the overall sentiment of this financial sentence?"
    labels:
      - "Positive"
      - "Negative"
      - "Neutral"
    keyboard_shortcuts:
      "Positive": "1"
      "Negative": "2"
      "Neutral": "3"
    tooltips:
      "Positive": "The sentence conveys positive financial news or outlook"
      "Negative": "The sentence conveys negative financial news or outlook"
      "Neutral": "The sentence is neutral or purely factual without sentiment"

annotation_instructions: |
  You will be shown a sentence from a financial news article. Your task is to:
  1. Determine the fine-grained sentiment (Strong Positive to Strong Negative).
  2. Assign the overall sentiment label (Positive, Negative, or Neutral).

  Important: Judge sentiment from an investor or market perspective, not general sentiment.
  For example, "layoffs" might be negative generally but could be positive for investors
  if it signals cost-cutting measures.

html_layout: |
  <div style="padding: 15px; max-width: 800px; margin: auto;">
    <div style="background: #f0f9ff; border: 1px solid #bae6fd; border-radius: 8px; padding: 16px; margin-bottom: 16px;">
      <strong style="color: #0369a1;">Financial News Sentence:</strong>
      <p style="font-size: 16px; line-height: 1.7; margin: 8px 0 0 0;">{{text}}</p>
    </div>
  </div>

allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false

Sample Datasample-data.json

json
[
  {
    "id": "finphrase_001",
    "text": "The company reported a 25% increase in quarterly revenue, exceeding analyst expectations by a significant margin."
  },
  {
    "id": "finphrase_002",
    "text": "Operating profit fell to EUR 35.4 million from EUR 68.1 million in the corresponding period last year."
  }
]

// ... and 8 more items

Get This Design

View on GitHub

Clone or download from the repository

Quick start:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/text/financial/financial-phrasebank-sentiment
potato start config.yaml

Dataset & paper

Malo et al., JASIST 2014

Citation (BibTeX)

bibtex
@article{malo2014good,
    title = "Good debt or bad debt: Detecting semantic orientations in economic texts",
    author = "Malo, Pekka and Sinha, Ankur and Korhonen, Pekka and Wallenius, Jyrki and Takala, Pyry",
    journal = "Journal of the Association for Information Science and Technology",
    volume = "65",
    number = "4",
    pages = "782--796",
    year = "2014",
    url = "https://arxiv.org/abs/1307.5336"
}

Details

Annotation Types

selectradio

Domain

NLPFinance

Use Cases

Sentiment AnalysisFinancial NLPMarket Analysis

Tags

financialsentimentphrasebanknewsmarketfinbert

Found an issue or want to improve this design?

Open an Issue