{"id":2243,"date":"2021-05-30T23:30:27","date_gmt":"2021-05-30T21:30:27","guid":{"rendered":"https:\/\/blog.factgrid.de\/?p=2243"},"modified":"2021-05-30T23:30:27","modified_gmt":"2021-05-30T21:30:27","slug":"philobiblon-from-siloed-databases-to-linked-open-data-via-wikibase-proof-of-concept","status":"publish","type":"post","link":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/archives\/2243","title":{"rendered":"PhiloBiblon: From Siloed Databases to Linked Open Data via Wikibase: Proof of Concept"},"content":{"rendered":"<p>We are very pleased to announce a pilot project funded by the U.S. federal government&#8217;s National Endowment of the Humanities (NEH): \u201cPhiloBiblon: From Siloed Databases to Linked Open Data via Wikibase: Proof of Concept.&#8221; It will begin June 1, 2021. and end May 30, 2022 and will be hosted by FactGrid.<\/p>\n<p>The project is focused on <a href=\"https:\/\/bancroft.berkeley.edu\/philobiblon\/\"><em>PhiloBiblon<\/em><\/a>. a forty-year-old database for the study of the medieval history and literatures of the Romance cultures of the Iberian Peninsula: Portuguese and Galician-Portuguese, Castilian, and Catalan. It contains four subsidiary databases:<\/p>\n<ul>\n<li><a href=\"https:\/\/bancroft.berkeley.edu\/philobiblon\/beta_en.html\">BETA<\/a>: Bibliograf\u00eda Espa\u00f1ola de Textos Antiguos: Medieval texts in Spanish.<\/li>\n<li><a href=\"https:\/\/bancroft.berkeley.edu\/philobiblon\/bipa_en.html\">BIPA<\/a>: Bibliograf\u00eda de la Poes\u00eda \u00c1urea: Golden Age (16th-17th c.) Poetry in Spanish.<\/li>\n<li><a href=\"https:\/\/bancroft.berkeley.edu\/philobiblon\/bitagap_en.html\">BITAGAP<\/a>: Bibliografia de Textos Antigos Galegos e Portugueses: Medieval texts in Galician, Galician-Portuguese, and Portuguese,<\/li>\n<li><a href=\"https:\/\/bancroft.berkeley.edu\/philobiblon\/biteca_en.html\">BITECA<\/a>: Bibliografia de Textos Antics Catalans, Valencians i Balears: Medieval texts in Catalan.<\/li>\n<\/ul>\n<p>The project is designed to solve one of the most vexing problems facing long-standing digital projects: maintainance of the software platform. PhiloBiblon started out in 1975 as an ancillary database of the Dictionary of the Old Spanish Language project, carried out at University of Wisconsin, Madison, by <a href=\"https:\/\/en.wikipedia.org\/wiki\/Lloyd_Kasten\">Lloyd Kasten<\/a> and his student, <a href=\"https:\/\/hiddenhistories.github.io\/author\/johnnitti\/\">John Nitti<\/a>. In Madison the database management system (DBMS) used was FAMULUS, created, ironically, in Berkeley in 1964, for the Pacific Southwest Forest and Range Experiment Station. Since then, technological transformation has been a constant: from the CD-ROM discs of <a href=\"http:\/\/www.admyte.com\/e_historia.htm\">ADMYTE<\/a> (<strong>A<\/strong>rchivo <strong>D<\/strong>igital de <strong>M<\/strong>anuscritos y <strong>T<\/strong>exts Espa\u00f1oles ) to a first web version in 1997 to the current 2014 version. Each transformation has usually required multiple grant applications to agencies and foundations, especially to NEH.<\/p>\n<p><em>PhiloBiblon<\/em> currently runs under Windows on Revelation Technology\u2019s MultiValue database, <a href=\"https:\/\/en.wikipedia.org\/wiki\/OpenInsight\">OpenInsight<\/a>. <em>PhiloBiblon<\/em>\u2019s 1987 implementation was designed on Revelation G., the ancestor of OpenInsight, by John May, a graduate student in History of Science who eventually left the academy for a business career. John has maintained and enhanced the <em>PhiloBiblon<\/em> DBMS for more than 35 years, building it out to encompass ten relational tables (texts, witnesses, primary source manuscripts and imprints, copies of imprints, persons, institutions, toponyms, and secondary references). Among them these ten tables contain 1246 data elements (fields), 98 controlled vocabulary lists with more than 3000 properties, 110 search indexes, and 30 data entry screens.<\/p>\n<p><em>PhiloBiblon<\/em> and its relational DBMS existed before Tim Berners-Lee invented the Worldwide Web at CERN in Geneva in 1989. It was evident from the advent of the first really useful commercial browser, <a href=\"https:\/\/es.wikipedia.org\/wiki\/Netscape_Navigator\">Netscape<\/a>, that the WWW offered a vastly superior vehicle for making information available to students and scholars, much better than print and CD-ROM. In <em>PhiloBiblon<\/em>\u2019s first web version (1997), data were exported from the OpenInsight DBMS and uploaded to a web server at Berkeley in <a href=\"https:\/\/www.w3.org\/XML\/\">HTML<\/a> format. Users could search only for authors, titles, or keywords; and the result of the search was just a list of manuscripts or editions, each of which had to be opened, one-by-one, to find the item of interest.<\/p>\n<p>In the current version OpenInsight data is still exported\u2014usually every two or three months\u2014and uploaded to a web server at Berkeley (and to a <a href=\"http:\/\/philobiblon.upf.edu\/philobiblon\/index.html\">mirror site<\/a> at the Universitat Pompeu Fabra in Barcelona) in ten separate files, one for each table, in the more advanced <a href=\"https:\/\/www.w3.org\/XML\/\">XML<\/a> format. On the server the <a href=\"https:\/\/xtf.cdlib.org\/\">eXtensible Text Framework<\/a> (XTF) program, created by the California Digital Library of the University of California, parses each file into individual records, indexes them, and serves them to users as a result of a search request from the <em>PhiloBiblon<\/em> web site. The search mechanisms are much more powerful, offering not only keyword searching but also a set of search boxes tailored to each entity.<\/p>\n<p>Thus for texts (works): keyword (simple search), author, title, incipit, explicit, associate person, date and place of composition, subject.<\/p>\n<p><a href=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2254\" src=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page.png\" alt=\"\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page.png 2560w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page-300x169.png 300w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page-1024x576.png 1024w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page-768x432.png 768w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page-1536x864.png 1536w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Work-search-page-2048x1152.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/a><\/p>\n<p>For manuscripts and editions: City and library holding the item, shelfmark, date and place of production, printer and publisher, scribe and patron, previous owner or other associated person:<\/p>\n<p><a href=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2253\" src=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page.png\" alt=\"\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page.png 2560w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page-300x169.png 300w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page-1024x576.png 1024w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page-768x432.png 768w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page-1536x864.png 1536w, https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-content\/uploads\/2021\/05\/PB-Ms-Ed-search-page-2048x1152.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/a><\/p>\n<p>The time lag between data input and its appearance on the web is annoying. Moreover, the process required to export data and upload it to the web to the web is is neither elegant nor efficient. Aside from this and from the problem of maintaining and enhancing both the Windows DBMS and the web software, the most urgent issue facing <em>PhiloBiblon<\/em> is its status as an information silo, with no organic relationship with other information sources. The web 3.0, the <a href=\"https:\/\/www.w3.org\/standards\/semanticweb\/\">semantic web<\/a>, is designed to make use of <a href=\"https:\/\/www.w3.org\/egov\/wiki\/Linked_Open_Data\">Linked Open Data<\/a> and the <a href=\"https:\/\/www.w3.org\/RDF\/\">Resource Description Framework<\/a> (LD\/RDF) in order to make possible automatic links to other information resources, like the <a href=\"http:\/\/viaf.org\/\">Virtual International Authority File<\/a> (VIAF).<\/p>\n<p>Since 2014 the <em>PhiloBiblon<\/em> research teams have prepared a series of unsuccessful grant proposals, separately as well as in collaboration with other projects, to NEH and to Spanish, Catalan, and European agencies and foundations with the goal of funding the transformation of <em>PhiloBiblon<\/em> into an LD\/RDF resource.<\/p>\n<p>Last year, instead of proposing the creation <em>ex professo<\/em> of a new web-based DBMS for <em>PhiloBiblon<\/em>, on the advice of our neighbors at Stanford University, the University of California, Davis, and the international library consortium <a href=\"https:\/\/www.oclc.org\/en\/home.html\">OCLC<\/a>, we decided to explore a radically different solution: to incorporate <em>PhiloBiblon<\/em> into the wiki world. <em>PhiloBiblon<\/em> already cites Wikipedia constantly, more than 1400 times in nine different languages. Of more interest than Wikipedia as a model, however, is the more structured but still open environment of Wikidata. Wikidata, however, is <em>too<\/em> open. <em>PhiloBiblon<\/em> requires more control over the individuals who can contribute to it.<\/p>\n<p>This led us to FactGrid, which is ideal for our purposes. Open only to members, it offers a perfect sandbox for the PhiloBiblon staff to explore the relationship between <em>PhiloBiblon<\/em>\u2019s highly structured data model and the elegant and infinitely extensible model of triplestores based on Q# entities and P# properties. We are enormously grateful to <a href=\"https:\/\/www.uni-erfurt.de\/en\/forschungszentrum-gotha\/ueber-uns\/personen\/externe\/olaf-simons\">Olaf Simons<\/a> not only for his generous offer to make it available for this purpose but also for agreeing to serve on the Advisory Board of the current NEH project.<\/p>\n<p>When this project ends May 31, 2022, we hope to have shown that the Wikidata model is viable for <em>PhiloBiblon<\/em> over the long term and that we can make use of its standard input processes, modified as necessary, to map <em>PhiloBiblon<\/em>\u2019s 421,000 records into the corresponding FactGrid entities and properties, creating new ones as necessary. This work will be carried out primarily by data analyst <a href=\"https:\/\/www.linkedin.com\/in\/adam-anderson-58a67658\">Adam Anderson<\/a>, whose academic specialization is Assyriology and cuneiform studies. He will also study Wikibase\u2019s LD access points to and from libraries and archives and test the Wikibase data export module for <a href=\"https:\/\/json-ld.org\/\">JSON-LD<\/a>, RDF, and XML on PhiloBiblon data.<\/p>\n<table cellpadding=\"1\">\n<tbody>\n<tr bgcolor=\"#efefef\">\n<td align=\"left\">TABLA<\/td>\n<td align=\"center\">BETA<\/td>\n<td align=\"center\">BITAGAP<\/td>\n<td align=\"center\">BITECA<\/td>\n<td align=\"center\">BIPA<\/td>\n<td bgcolor=\"white\" width=\"100px&quot;\"><\/td>\n<\/tr>\n<tr>\n<td>ANALYTIC (witnesses)<\/td>\n<td align=\"right\">14692<\/td>\n<td align=\"right\">52084<\/td>\n<td align=\"right\">12239<\/td>\n<td align=\"right\">89926<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>REFERENCES<\/td>\n<td align=\"right\">7270<\/td>\n<td align=\"right\">21558<\/td>\n<td align=\"right\">5976<\/td>\n<td align=\"right\">472<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>PERSONS<\/td>\n<td align=\"right\">7423<\/td>\n<td align=\"right\">32309<\/td>\n<td align=\"right\">3473<\/td>\n<td align=\"right\">3418<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>GEOGRAPHY<\/td>\n<td align=\"right\">1814<\/td>\n<td align=\"right\">4759<\/td>\n<td align=\"right\">840<\/td>\n<td align=\"right\">211<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>INSTITUTIONS<\/td>\n<td align=\"right\">794<\/td>\n<td align=\"right\">3297<\/td>\n<td align=\"right\">585<\/td>\n<td align=\"right\">4<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>LIBRARIES<\/td>\n<td align=\"right\">915<\/td>\n<td align=\"right\">455<\/td>\n<td align=\"right\">420<\/td>\n<td align=\"right\">119<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>MANUSCRIPTS &amp; IMPRINTS<\/td>\n<td align=\"right\">5168<\/td>\n<td align=\"right\">5886<\/td>\n<td align=\"right\">1971<\/td>\n<td align=\"right\">1572<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>COPIES OF PRINTED BOOKS<\/td>\n<td align=\"right\">4157<\/td>\n<td align=\"right\">1146<\/td>\n<td align=\"right\">1473<\/td>\n<td align=\"right\">137<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>SUBJECT HEADINGS<\/td>\n<td align=\"right\">339<\/td>\n<td align=\"right\">34<\/td>\n<td align=\"right\">149<\/td>\n<td align=\"right\">126<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>WORKS (texts)<\/td>\n<td align=\"right\">6034<\/td>\n<td align=\"right\">31962<\/td>\n<td align=\"right\">6173<\/td>\n<td align=\"right\">89913<\/td>\n<td><\/td>\n<\/tr>\n<tr bgcolor=\"#efefef\">\n<td>TOTAL<\/td>\n<td align=\"right\">48606<\/td>\n<td align=\"right\">153490<\/td>\n<td align=\"right\">33299<\/td>\n<td align=\"right\">185898<\/td>\n<td align=\"right\">421293<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In addition, software engineer <a href=\"https:\/\/es.linkedin.com\/in\/josep-maria-forment%C3%AD-43a1866\">Josep Mar\u00eda Forment\u00ed<\/a> (Barcelona), after evaluating the Wikibase data entry module and report format, will create prototypes of more user-friendly query and data entry screens and report formats.<\/p>\n<p>All of this work will be carried out in collaboration with the twenty members of the <em>PhiloBiblon<\/em> volunteer academic staff and, we hope, numerous volunteers from the Hispano-medievalist community.<\/p>\n<hr \/>\n<p>Image: Rueland Frueauf the Elder (1440\u20131507) <em>The Education of the Infant Christ<\/em> (1506) <a href=\"https:\/\/commons.wikimedia.org\/wiki\/File:Rueland_Frueauf,_the_Elder_-_The_Education_of_the_Infant_Christ_-_49.1076_-_Museum_of_Fine_Arts.jpg\">Wikimedia Commons<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are very pleased to announce a pilot project funded by the U.S. federal government&#8217;s National Endowment of the Humanities (NEH): \u201cPhiloBiblon: From Siloed Databases to Linked Open Data via Wikibase: Proof of Concept.&#8221; It will begin June 1, 2021. and end May 30, 2022 and will be hosted by FactGrid. The project is focused &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/archives\/2243\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;PhiloBiblon: From Siloed Databases to Linked Open Data via Wikibase: Proof of Concept&#8221;<\/span><\/a><\/p>\n","protected":false},"author":8,"featured_media":2257,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22,23],"tags":[33,227,230,267,331],"ppma_author":[468],"class_list":["post-2243","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-medieval","category-philobiblon","tag-adam-anderson","tag-john-nitti","tag-josep-maria-formenti","tag-lloyd-kasten","tag-philobiblon"],"authors":[{"term_id":468,"user_id":8,"is_guest":0,"slug":"charles-faulhaber","display_name":"Charles Faulhaber","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/3928537519dcd541365f08eda85389512b3e58bb8b4953c3e2b0dbdc40e07c91?s=96&d=mm&r=g","author_category":"","first_name":"Charles","last_name":"Faulhaber","user_url":"","job_title":"","description":""}],"_links":{"self":[{"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/posts\/2243","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/comments?post=2243"}],"version-history":[{"count":0,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/posts\/2243\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/media\/2257"}],"wp:attachment":[{"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/media?parent=2243"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/categories?post=2243"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/tags?post=2243"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/factgrid-tools.geschichte.uni-halle.de\/blog\/wp-json\/wp\/v2\/ppma_author?post=2243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}