Webinar: "Information Retrieval Over Historical Scans with Non-trivial Layouts"

ODSC Data Science Boston
ODSC Data Science Boston
Public group

Cambridge Innovation Center

1 Broadway · Cambridge, MA

How to find us

5th floor, room - Havana

Location image of event venue


Join our webinar via this link: https://attendee.gotowebinar.com/register/2886825358506071563

6:00pm - 6:30pm - ODSC Intro
6:30pm - 7:20pm - Talk
7:20pm - 7:30pm - Q&A

Speaker: Zejiang Shen, Data Science Fellow at IQSS

Information Retrieval Over Historical Scans with Non-trivial Layouts - A Combination of Computer Vision and Natural Language Processing

Zejiang Shen is currently a data science fellow at the Institute for Quantitative Social Science (IQSS) at Harvard University. He is trying to use deep learning tools to distill important economic information for historical scans and analyze the extracted text. His research interest covers representation learning and computer vision.

Non-trivial layouts in book scans will disrupt Optical Character Recognition (OCR) outputs since it will misjoin texts from different sections. This limits the usability of extracted documents from historical scans and the following humanity research. Even recognized appropriately, the large bulk of natural texts prevents the subsequent analysis without appropriate processing. We propose a framework that helps extract structured information from such scans by combining computer vision and natural language processing approaches. With the help of our deep learning-based layout analysis method, our framework can understand the complicated layouts in the books and merge the extracted characters correctly. Moreover, we utilize named entity recognition and dependency parsing to breakdown original texts into structured feature tables for further analysis. This framework is verified on the Japanese Who is Who book in 1953 with high accuracy.

Use Meetup2020 unique discount code for your pass to ODSC East and ODSC Europe - https://odsc.com/

ODSC Links:
• Get free access to more talks like this at LearnAI:
• Facebook: https://www.facebook.com/OPENDATASCI
• Twitter: https://twitter.com/odsc & @odsc
• LinkedIn: https://www.linkedin.com/company/open-data-science
• Slack Channel: http://bit.ly/2RkOf9l
• East Conference Apr 13th - 17th 2020: https://odsc.com/boston
• India Conference Sept 9th – 12th 2020: https://india.odsc.com
• Code of conduct: https://odsc.com/code-of-conduct/