Skip to content
advancedtext

Complex Named Entity Recognition (MultiCoNER)

Recognize complex and emerging named entities. Based on SemEval 2022/2023 MultiCoNER. Identify creative works, products, groups, and other challenging entity types.

PERORGLOCPERORGLOCDATESelect text to annotate

Configuration Fileconfig.yaml

This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.

yaml
# Complex Named Entity Recognition (MultiCoNER)
# Based on SemEval 2022/2023 MultiCoNER Shared Tasks
# Paper: https://aclanthology.org/2022.semeval-1.196/
#
# Traditional NER focuses on Person, Location, Organization.
# Complex NER handles challenging entities like:
# - Creative works ("Dial M for Murder", "Game of Thrones")
# - Products ("iPhone 15", "Tesla Model S")
# - Groups ("Anonymous", "BTS Army")
#
# Entity Types (Coarse-grained):
# - PER: Person names
# - LOC: Locations, facilities
# - CORP: Corporations, businesses
# - GRP: Other groups (bands, teams, movements)
# - PROD: Products (consumer goods, vehicles)
# - CW: Creative works (movies, books, songs)
#
# Challenges:
# - Creative works can be any linguistic form
# - Product names blend with common words
# - Group names may be descriptive phrases
# - Emerging entities lack context
#
# Annotation Guidelines:
# 1. Mark the full entity span including modifiers
# 2. Creative works include titles in any form
# 3. Products include brand + product name
# 4. When uncertain, consider: would this have a Wikipedia page?

annotation_task_name: "Complex Named Entity Recognition"
task_dir: "."

data_files:
  - sample-data.json
item_properties:
  id_key: "id"
  text_key: "text"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

annotation_schemes:
  - annotation_type: span
    name: entities
    description: "Highlight all named entities in the text"
    labels:
      - "Person"
      - "Location"
      - "Corporation"
      - "Group"
      - "Product"
      - "Creative Work"
    label_colors:
      "Person": "#3b82f6"
      "Location": "#22c55e"
      "Corporation": "#8b5cf6"
      "Group": "#f59e0b"
      "Product": "#06b6d4"
      "Creative Work": "#ec4899"
    tooltips:
      "Person": "Names of people (including fictional characters)"
      "Location": "Places, addresses, facilities, geographic features"
      "Corporation": "Companies, businesses, corporations"
      "Group": "Other groups: bands, sports teams, movements, organizations"
      "Product": "Consumer products: devices, vehicles, software, games"
      "Creative Work": "Movies, TV shows, books, songs, albums, artworks"
    allow_overlapping: false

allow_all_users: true
instances_per_annotator: 50
annotation_per_instance: 2
allow_skip: true
skip_reason_required: false

Sample Datasample-data.json

json
[
  {
    "id": "cner_001",
    "text": "I just finished watching Breaking Bad on Netflix. It's one of the best shows ever made."
  },
  {
    "id": "cner_002",
    "text": "Apple released the new iPhone 15 Pro Max yesterday at their headquarters in Cupertino."
  }
]

// ... and 8 more items

Try it live — no install

Boot the real Potato server in your browser (WebAssembly) and annotate with this exact config. Nothing leaves your machine.

▶ Run live in your browser

Get This Design

View on GitHub

Clone or download from the repository

Quick start:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/text/named-entity-recognition/complex-ner
potato start config.yaml

Dataset & paper

Malmasi et al., SemEval 2022

Citation (BibTeX)

bibtex
@inproceedings{malmasi-etal-2022-semeval,
    title = "{S}em{E}val-2022 Task 11: Multilingual Complex Named Entity Recognition ({M}ulti{C}o{NER})",
    author = "Malmasi, Shervin  and Fang, Anjie  and Fetahu, Besnik  and Kar, Sudipta  and Rokhlenko, Oleg",
    booktitle = "Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)",
    month = jul,
    year = "2022",
    address = "Seattle, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.semeval-1.196",
    pages = "1412--1437"
}

Details

Annotation Types

span

Domain

NLPInformation Extraction

Use Cases

Named Entity RecognitionInformation ExtractionKnowledge Base

Tags

nercomplex-entitiesmulticonersemeval2022creative-works

Found an issue or want to improve this design?

Open an Issue