How can we represent data such that the resulting semantic structures become useful in a deep model? Usefulness, has a twofold connotation: intrinsically, it concerns a quantifiable improvement in the performance of the deep model; extrinsically, it’s related to how semantic representations of data can augment the explainability of the deep model that uses it. The Semantic Technology community, is more and more interested in the problem of integrating ontologies with deep models. In this regard, ontologies can be viewed as a tool or source of insight for overcoming the key challenges of heterogeneous multi-modal representation, fusion, translation, alignment, and co-learning.

This breakout-session aims at exposing existing solutions towards injecting structured knowledge into deep models, their limitations and the potential benefits of semantic technologies to address them. The presenters will introduce the notion of multi-modal learning, focusing on examples from industrial use cases at Bosch. The second part will focus on the most relevant techniques in the state of the art, highlighting best practices and limitations. Finally, we will illustrate how semantic web technologies can be used to complement machine learning systems, opening the discussion to the attendants.