This repository contains 3 datasets created within the POPP project ([Project for the Oceration of the Paris Population Census](https://popp.hypotheses.org/#ancre2)) for the task of handwriting text recognition.
These datasets have been publised in *Recognition and information extraction in historical handwritten tables: toward understanding early 20th century Paris census* at DAS 2022.
The 3 datasets are called "Generic dataset", "Belleville", and "Chaussée d'Antin" and contains lines made from the extracted rows of census table from 1926. Each table in the Paris census contains 30 rows, thus each page in these datasets corresponds to 30 lines.
This repository is a Git LFS repository which contain the image files.
The double pages were scanned at a resolution of 200dpi and saved as PNG images with 256 gray levels.
The line and page images are shared in the TIFF format, also with 256 gray levels.
Since the lines are extracted from table rows, we defined 4 special characters to describe the structure of the text:
- ¤ : indicates an empty cell
- / : indicates the separation into columns
- ? : indicates that the content of the cell following this symbol is written above the regular baseline
- ! : indicates that the content of the cell following this symbol is written below the regular baseline
The split for the *Generic Dataset* and *Belleville* have been made at the double-page level so that each writer only appears in one subset among train, evaluation and test. The following table summarizes the splits and the number of writers for each dataset:
| Dataset | train - # of lines| validation - # of lines | test - # of lines | # of writers |
- This dataset is made 4800 annotated lines extracted from 80 double pages of the 1926 Paris census.
- There is one double page for each of the 80 districts of Paris
- There is one writer per double page so the dataset contains 80 different writers.
## Belleville dataset
This dataset is a mono-writer dataset made of 1470 lines (49 pages) from the *Belleville* district census of 1926.
## Chaussée d'Antin dataset
This dataset is a multi-writer dataset made of 780 lines (26 pages) from the *Chaussée d'Antin* district census of 1926 and written by 10 different writers.
## Terms of Use and Citation Request
This dataset is for non-commercial research purpose.
License: This dataset and the corresponding annotations are licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International Public License.
If you publish material based on this database, we request you to include a reference to paper `Constum Thomas, Kempf Nicolas, Paquet Thierry, Traounez Pierrick, Chatelain Clément, Brée Sandra, Merveille François, 2022, “Recognition and information extraction in historical handwritten tables: toward understanding early 20th century Paris census", DAS 2022: 15th IAPR International Workshop on Document Analysis Systems`
