Benchmark report · July 2025
Handwriting & form understanding accuracy evaluation.
We evaluated Axia's extraction engine on two established, publicly available benchmarks: a handwriting recognition dataset of 500 handwritten names, and the SROIE2019 form-understanding dataset of 347 real Malaysian receipts. Every comparison uses normalized data and quantitative similarity measures, and the evaluation code is open source.
93.2%
Handwriting recognition
500 samples
98.2%
Form understanding
347 receipts
99.9%
Financial amounts
SROIE2019
2.0s
Per document
handwriting
Methodology
Standardized datasets, measurable results.
Both evaluations rely on the Gestalt Pattern Matching algorithm (Python's difflib.SequenceMatcher) to score similarity between extracted text and human-annotated ground truth, from 0.0 (completely different) to 1.0 (identical). All comparisons run on case-normalized strings, so partial matches and common OCR errors are credited proportionally rather than all-or-nothing.
Field-specific evaluators handle each data type on its own terms: dates are normalized to ISO format with dual MM/DD vs DD/MM validation to absorb annotation inconsistencies in the dataset, and totals are converted to floats and compared exactly. Blurry and low-quality images were deliberately kept in the sample to reflect real-world conditions, and empty documents were tested for correct null detection.
| Dataset | Domain | Sample size | Key challenges |
|---|---|---|---|
| Kaggle Handwriting | Handwriting recognition | 500 samples | Style variation, image blur, empty-field detection |
| SROIE2019 | Form understanding | 347 receipts | Multi-field extraction, mixed languages, format variations |
Evaluation 1
Handwriting recognition: 93.2% accuracy.
500 samples of handwritten personal names — script, print, and hybrid styles, including deliberately blurry and low-quality images — were processed through a single-field extraction schema. Axia averaged a 93.2% string-similarity score against human annotations, at 2.0 seconds per document, and correctly returned null for images containing no text.

Evaluation 2
Form understanding: 98.2% average accuracy.
347 real Malaysian business receipts from SROIE2019 — mixed Malay and English, varied layouts and print quality — were processed with a four-field schema extracting company name, date, address, and total amount, at 4.2 seconds per receipt.
| Field type | Accuracy |
|---|---|
| Total amounts | 99.9% |
| Business addresses | 98.7% |
| Company names | 98.0% |
| Receipt dates | 96.3% |
| Overall average | 98.2% |

Limitations
- Handwriting accuracy varies with image quality degradation.
- Date annotation inconsistencies in the source dataset require the dual-format validation described above.
- Multi-field processing time increases with document complexity.
Test it on your documents.
Benchmarks are a starting point — the real test is your invoices, receipts, and forms.