Skip to content
intermediatetext

DocBank Document Layout Detection

Document layout analysis benchmark (Li et al., COLING 2020). Detect and classify document elements including titles, abstracts, paragraphs, figures, tables, and captions.

Try it live — no install

Boot the real Potato server in your browser (WebAssembly) and annotate with this exact config. Nothing leaves your machine.

Run live in your browser

Get This Design

View on GitHub(opens in a new tab)

Clone or download from the repository

Quick start:

bash
git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/image/specialized/docbank
potato start config.yaml

Configuration File

This Potato config reproduces the annotation task. Save it as config.yaml and run potato start config.yaml to try it.

yaml
# DocBank Document Layout Detection Configuration
# Based on Li et al., COLING 2020

annotation_task_name: "DocBank Document Layout Analysis"
task_dir: "."

data_files:
  - "sample-data.json"

item_properties:
  id_key: "id"
  text_key: "image_url"
  context_key: "context"

user_config:
  allow_all_users: true

annotation_schemes:
  - annotation_type: "multiselect"
    name: "document_elements"
    description: "Select all document elements visible"
    labels:
      - name: "abstract"
        tooltip: "Abstract section"
      - name: "author"
        tooltip: "Author names"
      - name: "caption"
        tooltip: "Figure/table captions"
      - name: "date"
        tooltip: "Publication date"
      - name: "equation"
        tooltip: "Mathematical equations"
      - name: "figure"
        tooltip: "Figures and images"
      - name: "footer"
        tooltip: "Page footer"
      - name: "header"
        tooltip: "Page header"
      - name: "list"
        tooltip: "Bulleted or numbered lists"
      - name: "paragraph"
        tooltip: "Body paragraphs"
      - name: "reference"
        tooltip: "Bibliography/references"
      - name: "section"
        tooltip: "Section headings"
      - name: "table"
        tooltip: "Tables"
      - name: "title"
        tooltip: "Document title"

  - annotation_type: "radio"
    name: "document_type"
    description: "What type of document is this?"
    labels:
      - name: "academic_paper"
        tooltip: "Academic/research paper"
      - name: "technical_report"
        tooltip: "Technical report"
      - name: "book_chapter"
        tooltip: "Book or chapter"
      - name: "news_article"
        tooltip: "News article"
      - name: "form"
        tooltip: "Form or application"
      - name: "invoice"
        tooltip: "Invoice or receipt"
      - name: "other"
        tooltip: "Other document type"

  - annotation_type: "radio"
    name: "layout_complexity"
    description: "How complex is the layout?"
    labels:
      - name: "single_column"
        tooltip: "Single column layout"
      - name: "double_column"
        tooltip: "Two column layout"
      - name: "multi_column"
        tooltip: "Three or more columns"
      - name: "mixed"
        tooltip: "Mixed column layouts"

  - annotation_type: "radio"
    name: "scan_quality"
    description: "Quality of the document image"
    labels:
      - name: "high"
        tooltip: "Clear, high-resolution"
      - name: "medium"
        tooltip: "Readable but some issues"
      - name: "low"
        tooltip: "Poor quality, hard to read"

  - annotation_type: "text"
    name: "element_boxes"
    description: "List bounding boxes: element_type,x1,y1,x2,y2 (one per line)"

interface_config:
  item_display_format: "<img src='{{text}}' style='max-width:100%; max-height:600px;'/><br/><small>{{context}}</small>"

output_annotation_format: "json"
output_annotation_dir: "annotations"

Sample Data

json
[
  {
    "id": "doc_001",
    "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/8/8f/Example_academic_paper.pdf/page1-424px-Example_academic_paper.pdf.jpg",
    "context": "Document page image. Identify all layout elements: title, abstract, sections, figures, tables, captions, etc."
  },
  {
    "id": "doc_002",
    "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/8/8f/Example_academic_paper.pdf/page1-424px-Example_academic_paper.pdf.jpg",
    "context": "Analyze document layout structure. Mark headers, paragraphs, lists, and other elements."
  }
]

// ... and 1 more items

Dataset & paper

Li et al., COLING 2020

Official dataset(opens in a new tab)Read the paper(opens in a new tab)

Citation (BibTeX)

bibtex
@inproceedings{li2020docbank,
    title = "{DocBank}: A Benchmark Dataset for Document Layout Analysis",
    author = "Li, Minghao  and Xu, Yiheng  and Cui, Lei  and Huang, Shaohan  and Wei, Furu  and Li, Zhoujun  and Zhou, Ming",
    booktitle = "Proceedings of the 28th International Conference on Computational Linguistics",
    pages = "949--960",
    year = "2020",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2020.coling-main.82/"
}

Details

Annotation Types

multiselectradiotext

Domain

Document AILayout Analysis

Use Cases

Document UnderstandingLayout DetectionInformation Extraction

Tags

docbankdocumentlayoutocrcoling2020

Found an issue or want to improve this design?

Open an Issue(opens in a new tab)

Related Designs

DocLayNet Document Layout Analysis

Document layout analysis with bounding box annotations. Annotators draw bounding boxes around layout elements (text blocks, tables, figures, headers, footers, lists) in document page images.

multiselectradio

OmniDocBench Comprehensive Document Parsing

Comprehensive document parsing annotation covering layout detection, text recognition, table structure, and formula recognition. Annotators draw bounding boxes and provide text transcriptions for document elements.

multiselectradio

Fact Verification

Verify claims as supported, refuted, or not enough information based on provided evidence.

likertmultiselect