June 8, 2025 Dataset Open Access

Hussein Mohammed; Quang-Vinh Dang

JSON Export

{"conceptdoi":"10.25592/uhhfdm.17613","conceptrecid":"17613","created":"2025-08-11T18:21:32.971773+00:00","doi":"10.25592/uhhfdm.17808","id":17808,"links":{"badge":"https://www.fdr.uni-hamburg.de/badge/doi/10.25592/uhhfdm.17808.svg","conceptbadge":"https://www.fdr.uni-hamburg.de/badge/doi/10.25592/uhhfdm.17613.svg","conceptdoi":"http://doi.org/10.25592/uhhfdm.17613","doi":"http://doi.org/10.25592/uhhfdm.17808"},"metadata":{"access_right":"open","access_right_category":"success","communities":[{"id":"csmc"},{"id":"uhh"}],"creators":[{"affiliation":"Universit\u00e4t Hamburg","name":"Hussein Mohammed","orcid":"0000-0001-5020-3592"},{"affiliation":"Universit\u00e4t Hamburg","name":"Quang-Vinh Dang","orcid":"0000-0002-6715-7112"}],"description":"<p>This small test set consists of 30 images and one JSON file. The images are a few notebook pages from Rainer Maria Rilke, from the Deutsche Literaturarchiv Marbach (DLA), A:Rilke-Archiv Gernsbach. The JSON file was computationally generated using several AI models and contains information automatically extracted from the images about various visual properties of text, such as word location, colour, orientation, and writing implement.</p>\n\n<p><strong>What&rsquo;s new in this version:</strong></p>\n\n<ul>\n\t<li>\n\t<p>The annotations in this JSON file are generated using our enhanced models for improved accuracy in word detection, colour recognition, writing implement recognition, and orientation classification.</p>\n\t</li>\n</ul>\n\n<p>The structure of the JSON file is as follows:</p>\n\n<p>Root (object)<br>\n\u251c\u2500 info (object)<br>\n\u2502 &nbsp; \u251c\u2500 description &nbsp; : string<br>\n\u2502 &nbsp; \u251c\u2500 contributor &nbsp; : string<br>\n\u2502 &nbsp; \u251c\u2500 version &nbsp; &nbsp; &nbsp; : string<br>\n\u2502 &nbsp; \u251c\u2500 year &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;: integer<br>\n\u2502 &nbsp; \u2514\u2500 date_created &nbsp;: string &nbsp; &nbsp;# &quot;YYYY-MM-DD&quot;<br>\n\u2502<br>\n\u251c\u2500 images (array of object)<br>\n\u2502 &nbsp; \u2514\u2500 [image] (object)<br>\n\u2502 &nbsp; &nbsp; &nbsp; \u251c\u2500 id &nbsp; &nbsp; &nbsp; &nbsp;: integer<br>\n\u2502 &nbsp; &nbsp; &nbsp; \u251c\u2500 file_name : string<br>\n\u2502 &nbsp; &nbsp; &nbsp; \u251c\u2500 width &nbsp; &nbsp; : integer<br>\n\u2502 &nbsp; &nbsp; &nbsp; \u2514\u2500 height &nbsp; &nbsp;: integer<br>\n\u2502<br>\n\u2514\u2500 annotations (array of object)<br>\n&nbsp; &nbsp; \u2514\u2500 [annotation] (object)<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 id &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;: integer<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 image_id &nbsp; &nbsp; &nbsp;: integer<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 category_id &nbsp; : integer<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 bbox &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;: array of 4 numbers &nbsp; &nbsp; &nbsp;# [x, y, width, height]<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 area &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;: number &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; # float<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 segmentation &nbsp;: array of array of number &nbsp;# [[x1, y1, x2, y2, &hellip;]]<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 iscrowd &nbsp; &nbsp; &nbsp; : integer &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;# 0 or 1<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 score &nbsp; &nbsp; &nbsp; &nbsp; : number &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; # float<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 color_name &nbsp; &nbsp;: string<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 color_code &nbsp; &nbsp;: string &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; # e.g. &quot;145-144-122&quot;<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u251c\u2500 orientation &nbsp; : string &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; # e.g. &quot;hor&quot; or &quot;ver&quot;<br>\n&nbsp; &nbsp; &nbsp; &nbsp; \u2514\u2500 writing_tool &nbsp;: string &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; # e.g. &quot;pcl&quot;<br>\n&nbsp;</p>\n\n<p>See ScriptSight tool for examples of how this computational visual catalogue can be used.</p>\n\n<p><strong>Acknowledgements:&nbsp;</strong><br>\nThe research for this work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany&rsquo;s Excellence Strategy - EXC 2176 &lsquo;Understanding Written Artefacts: Material, Interaction and Transmission in Manuscript Cultures&rsquo;, project no. 390893796. The research was conducted within the scope of the Centre for the Study of Manuscript Cultures (CSMC) at Universit&auml;t Hamburg.</p>\n\n<p>The images are offered by the&nbsp;Deutsche Literaturarchiv Marbach (DLA) as a part of their collaboration with the CSMC.</p>","doi":"10.25592/uhhfdm.17808","keywords":["Computational visual catalogue"],"language":"eng","license":{"id":"CC-BY-4.0"},"publication_date":"2025-06-08","related_identifiers":[{"identifier":"10.25592/uhhfdm.17613","relation":"isVersionOf","scheme":"doi"}],"relations":{"version":[{"count":2,"index":1,"is_last":true,"last_child":{"pid_type":"recid","pid_value":"17808"},"parent":{"pid_type":"recid","pid_value":"17613"}}]},"resource_type":{"title":"Dataset","type":"dataset"},"title":"Computational Visual Catalogue (CVC) - Rilke's notebooks - Minimal Example","version":"1.5"},"owners":[96],"revision":3,"updated":"2025-08-12T08:10:00.557355+00:00"}