Digital Humanities (DH) researchers at the Indian Institute of Technology in Jodhpur (IITJ) are developing software to convert digital comics into videos – Comic-to-Video Network (C2VNet). The C2VNet evolves panel by panel into a comic book and ultimately produces a full video (with audio) of a digitized storybook.
In addition to the software, researchers at IIT Jodhpur have also proposed a dataset called “IMCDB: Indian Mythological Comic Dataset of Digitized Indian Comic Storybook” in English. This contains full annotations for the panels, bitmask of the text bubble, text files for each speech bubble, a narration box in a panel, and blueprints to make the dataset accessible to the public.
Chiranjoy Chattopadhyay, Assistant Professor, Department of Computer Science and Engineering, IITJ, said the C2VNet panel pull model has two internal networks to support video creation.
“CPENet developed by the team offers an accuracy of over 97%, and the SBSNet speech bubble segmentation model offers 98% accuracy with fewer parameters. Both have outperformed the top models. C2VNet is the first step towards the great future of automatic comic book multimedia creation and brings new comic book reading experiences, ”he said.