INVITED SPEAKER SEMINAR - Decentralized Cloud/Edge DNN Architectures

Date: Wednesday, December 18, 2024, from 9:00 a.m.
Location: EV 3.309

Abstract

This lecture overviews decentralized and distributed DNN architectures and their implementation in cloud/edge environments. Big data analysis can be greatly facilitated if decentralized/distributed DNN architectures are employed that interact with each other for DNN training and/or inference using the human Teacher-Student education paradigm. A novel Learning-by-Education Node Community (LENC) framework is presented that facilitates communication and knowledge exchange among diverse Deep Neural Networks (DNN) agents, undertaking the role of a student or teacher DNN by offering or absorbing knowledge respectively. The framework enables efficient and effective knowledge transfer among participating DNN agents while enhancing their learning capabilities and fostering their collaboration among diverse networks. The proposed framework addresses the challenges of handling diverse training data distributions and the limitations of individual DNN agent learning abilities. The LENC framework ensures the exploitation of the best available teacher knowledge upon learning a new task and protects the DNN agents from catastrophic forgetting. The experiments demonstrate the LENC framework functionalities on multiple teacher-student learning techniques and their integration with lifelong learning. Our experiments manifest the LEMA framework’s ability to maximize the accuracy of all participating DNN agents in classification tasks by leveraging the collaborative knowledge of the framework. A LENC framework implementation in cloud/edge environments is also overviewed.

Biography

Dr. Ioannis Pitas (IEEE fellow, IEEE Distinguished Lecturer, EURASIP fellow) received the Diploma and PhD degree in Electrical Engineering, both from the Aristotle University of Thessaloniki (AUTH), Greece. Since 1994, he has been a Professor at the Department of Informatics of AUTH and Director of the Artificial Intelligence and Information Analysis (AIIA) lab. He served as a Visiting Professor at several Universities.

His current interests are in the areas of computer vision, machine learning, autonomous systems, intelligent digital media, image/video processing, human-centered computing, affective computing, 3D imaging and biomedical imaging. He has published over 970 papers, contributed to 46 books in his areas of interest and edited or (co-)authored another 15 books. He has also been a member of the program committee of many scientific conferences and workshops. In the past he served as Associate Editor or co-Editor of 23 international journals and General or Technical Chair of 5 international conferences. He delivered 129 keynote/invited speeches worldwide. He co-organized 38 conferences and participated in technical committees of 291 conferences. He participated in 75+ R&D projects, primarily funded by the European Union and is/was principal investigator in 47 such projects. He is the coordinator of the Horizon Europe R&D project TEMA , AUTH principal investigator in H2020 R&D projects Aerial Core, AI4Media and Horizon Europe R&D projects AI4Europe, SIMAR.

He is chair of the International AI Doctoral Academy (AIDA). He was chair and initiator of the IEEE Autonomous Systems Initiative. He has 37800+ citations for his work and h-index 91+. According to https://research.com/ he is ranked first in Greece and 319 worldwide in the field of Computer Science.