Skip to content

Digital Treasures

European Digital Treasures: Management of centennial archives in the 21st century

Digital Treasures
  • News
  • About
    • Objectives
    • Consortium
    • Video
  • Activities
    • WP1: New Business Models for European Archives in the XXI Century
    • WP 2 – Stories of the History – Roaming Exhibitions and Storytelling
    • WP 3 – Working with New Target Audiences
    • WP 4 – Communication and Dissemination
  • Exhibition Materials
  • Product Gallery
    • Product catalog
  • Contact
Posted on February 21, 2022February 17, 2022 by Tatjana Hölzl

St. George on a bike: Enrichment of metadata of Cultural Heritage Objects using deep learning. – by Artem Reshetnikov

The European Digital Treasures team continues with the presentations of the experts who participated in the workshop “New Digital Exponential Technologies Towards The Generation Of Business Models” on 2nd and 3rd of September, 2021 at the Provincial Historical Archive of Alicante (Spain). 

Artem Reshetnikov.

The second speech was held by Artem Reshetnikov who is a deep learning researcher at Barcelona Supercomputing Center. Working in several companies and research centers, he received big experience in Computer Vision and Natural Language Processing and applying it to the tasks of different domains. For a long time, he was thinking about how to combine his two main passions: machine learning and art. The solution is the project where he works now: Saint George on a Bike is a project about the enrichment of metadata of paintings using Deep Learning and NLP approaches. 

Abstract.“Saint George on a Bike” project proposes several novel approaches to enrichment of metadata (captions, tags, relationships between objects, iconographic description) for the Cultural Heritage domain, which relies on combining Deep Learning and semantic metadata about paintings. Working with cultural heritage presents challenges not existent for every-day images. Models for objects detection or caption generation are usually trained with datasets that contain correct descriptions of current images or labels for objects, which were generated manually. Apart from this conceptual problem, the paintings are limited in number and represent the same concept in potentially very different styles. Finally, the metadata associated with the images is often poor or inexistent, which makes it hard to properly generate quality metadata. Our approach can assist in generation of metadata for different tasks. By taking into account an exiting metadata of Cultural heritage objects and additional techniques, we can generate tags, relationships between objects or descriptive text which is likely to be directly related to the scene depicted in an image.

You can watch the whole session on YouTube here and read the manuscript paper here!

Written by Artem Reshetnikov & the European Digital Treasures Team.

CategoriesArchive, Workshop Tags#BarcelonaSupercomputingCenter, #culturalheritage, #deeplearning, #eudigitaltreasures, #EuropeanArchives, #metadata

Post navigation

Previous PostPrevious Exhibition Opening at the Várkert Bazár in Budapest: European Discoveries
Next PostNext ICARUS Convention #28 in Paris with European Digital Treasures workshop

Recent Posts

  • EDT Workshop New Business & Conceptual Models: Introduction & first speech “Identification of potential for revenue generation”
  • ‘Travelling booklet’ (Wanderbuch) of Jakab Modern, tool smith journeyman
  • Exhibition II: Opening in St. Pölten – Austria
  • Workshop: New Business & Conceptual Models
  • MANAGING WATER IN TOLEDO: Artificio Juanelo

Twitter

Archivos Estatales@ArchivosEst·

✨Aprende a utilizar una herramienta abierta y gratuita para enseñar a los estudiantes a realizar investigación con #FondosArchivísticos✨

➕ sobre #eudigitaltreasures:
➡️https://cutt.ly/mZWNA6a

@icaruseu @Arkivverket @culturagob @Malta_Archives @MTU_TEL_Team @ArchivesPortal

Twitter 1554417233593499648
Archivos Estatales@ArchivosEst·

👩‍🏫Eres #profe?💡Necesitas ideas para septiembre?

📢Te dejamos una👉𝗧𝘂𝘁𝗼𝗿𝗶𝗮𝗹 𝗱𝗲𝗹 𝗖𝘂𝗿𝘀𝗼 𝗱𝗲 𝗔𝗹𝗳𝗮𝗯𝗲𝘁𝗶𝘇𝗮𝗰𝗶𝗼́𝗻 𝗔𝗿𝗰𝗵𝗶𝘃𝗶́𝘀𝘁𝗶𝗰𝗮 𝗱𝗲 #𝗲𝘂𝗱𝗶𝗴𝗶𝘁𝗮𝗹𝘁𝗿𝗲𝗮𝘀𝘂𝗿𝗲𝘀‼️
🔗https://youtu.be/j0-hFO-iGP4

@educaINTEF @educaciongob @Edudesarrollo

Twitter 1554417227872485377
Archivos Estatales@ArchivosEst·

👀Have a look at the summary and video of the #eudigitaltreasures encounter in Cork 🇮🇪 with the winners of 𝐓𝐫𝐞𝐚𝐬𝐮𝐫𝐞𝐬 𝐢𝐧 𝐀𝐫𝐜𝐡𝐢𝐯𝐞𝐬👇
https://cutt.ly/zZsULin

@Malta_Archives @ArchivosEst @MTU_TEL_Team @Arkivverket
#ContructionofEurope #documentary #shortfilm

Twitter 1552616104840814592
Jo Baines@octavosaurus·

Typing up my (many) notes from #dcdc22 and I am in slight awe of how beautifully straightforward the #eudigitaltreasures website is: https://www.digitaltreasures.eu/

Twitter 1552321370448592896
IC Archival Research@icaruseu·

📽️📽️📽️ Check the #recordings of the #eudigitaltreasures workshop on the ICARUS #YouTube Channel 😍

EDT blog with the latest NEWS:
🔗 https://www.digitaltreasures.eu/workshop3/
YouTube channel:
🔗https://cutt.ly/kZtEHsN

@Arkivverket @culturagob @Malta_Archives @MTU_TEL_Team @ArchivosEst

Twitter 1551635898160123904
Load More...

Imprint

Ministry of Culture and Sport
General Subdirectorate of the Spanish State Archives
Plaza del Rey nº 1, planta 0
28004-Madrid (Spain)

“This Project has been funded with support from the European Commission. This Webpage reflects the views only of the Author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.”

  • Twitter
  • Instagram