Benchmark report · July 2025

Handwriting & form understanding accuracy evaluation.

We evaluated Axia's extraction engine on two established, publicly available benchmarks: a handwriting recognition dataset of 500 handwritten names, and the SROIE2019 form-understanding dataset of 347 real Malaysian receipts. Every comparison uses normalized data and quantitative similarity measures, and the evaluation code is open source.

93.2%

Handwriting recognition

500 samples

98.2%

Form understanding

347 receipts

99.9%

Financial amounts

SROIE2019

2.0s

Per document

handwriting

Methodology

Standardized datasets, measurable results.

Both evaluations rely on the Gestalt Pattern Matching algorithm (Python's difflib.SequenceMatcher) to score similarity between extracted text and human-annotated ground truth, from 0.0 (completely different) to 1.0 (identical). All comparisons run on case-normalized strings, so partial matches and common OCR errors are credited proportionally rather than all-or-nothing.

Field-specific evaluators handle each data type on its own terms: dates are normalized to ISO format with dual MM/DD vs DD/MM validation to absorb annotation inconsistencies in the dataset, and totals are converted to floats and compared exactly. Blurry and low-quality images were deliberately kept in the sample to reflect real-world conditions, and empty documents were tested for correct null detection.

DatasetDomainSample sizeKey challenges
Kaggle HandwritingHandwriting recognition500 samplesStyle variation, image blur, empty-field detection
SROIE2019Form understanding347 receiptsMulti-field extraction, mixed languages, format variations

Evaluation 1

Handwriting recognition: 93.2% accuracy.

500 samples of handwritten personal names — script, print, and hybrid styles, including deliberately blurry and low-quality images — were processed through a single-field extraction schema. Axia averaged a 93.2% string-similarity score against human annotations, at 2.0 seconds per document, and correctly returned null for images containing no text.

Axia schema configuration for handwriting name extraction
The single-field schema used for the handwriting evaluation.

Evaluation 2

Form understanding: 98.2% average accuracy.

347 real Malaysian business receipts from SROIE2019 — mixed Malay and English, varied layouts and print quality — were processed with a four-field schema extracting company name, date, address, and total amount, at 4.2 seconds per receipt.

Field typeAccuracy
Total amounts99.9%
Business addresses98.7%
Company names98.0%
Receipt dates96.3%
Overall average98.2%
Axia schema configuration for SROIE receipt extraction with company, date, address, and total fields
The four-field receipt schema used for the SROIE2019 evaluation.

Limitations

  • Handwriting accuracy varies with image quality degradation.
  • Date annotation inconsistencies in the source dataset require the dual-format validation described above.
  • Multi-field processing time increases with document complexity.

References

Test it on your documents.

Benchmarks are a starting point — the real test is your invoices, receipts, and forms.