Research | AAU Campus

Project: Enabling the Big Data Pipeline Lifecycl...

Master data

English

Title:	Enabling the Big Data Pipeline Lifecycle on the Computing Continuum
Description:	DataCloud provides a novel paradigm covering the complete lifecycle of managing Big Data pipelines through discovery, design, simulation, provisioning, deployment, and adaptation across the Computing Continuum. Big Data pipelines in DataCloud interconnect the end-to-end industrial operations of collecting preprocessing and filtering data, transforming and delivering insights, training simulation models, and applying them in the cloud to achieve a business goal. DataCloud delivers a toolbox of new languages, methods, infrastructures, and prototypes for discovering, simulating, deploying, and adapting Big Data pipelines on heterogeneous and untrusted resources. DataCloud separates the design from the run- time aspects of Big Data pipeline deployment, empowering domain experts to take an active part in their definitions. The main exploitation targets the operation and monetization of the toolbox in European markets, and in the Spanish-speaking countries of Latin America. Its aim is to lower the technological entry barriers for the incorporation of Big Data pipelines in organizations’ business processes and make them accessible to a wider set of stakeholders regardless of the hardware infrastructure. DataCloud validates its plan through a strong selection of complementary business cases offered by SMEs and a large company targeting higher mobile business revenues in smart marketing campaigns, reduced production costs of sport events, trustworthy eHealth patient data management, and reduced time to production and better analytics in Industry 4.0 manufacturing. The balanced consortium consists of 11 partners from eight countries. It has three strong university partners specialised in Big Data, distributed computing, and high-productivity languages, led by a research institute. DataCloud gathers six SMEs and one large company (as technology providers and stakeholders/users/early adopters) that prioritise the business focus of the project in achieving high business impacts.
Keywords:	Big Data pipelines, data management, high-productivity

Short title:	DataCloud
Period:	01.01.2021 - 31.12.2023
Contact e-mail:	radu.prodan@aau.at
Homepage:	https://datacloudproject.eu/

Employees

Role

Time period

(internal)

Project leader
(Authorised Person)

01.01.2021 - 31.12.2023

(internal)

Research staff
Project leader

01.01.2021 - 31.12.2023
01.01.2021 - 31.12.2023

(internal)

Research staff
PhD student

01.03.2022 - 31.12.2023
01.03.2022 - 31.12.2023

(internal)

Student staff

01.01.2022 - 31.03.2023

(internal)

Research staff

01.01.2022 - 30.04.2022

(internal)

Research staff
PhD student

01.07.2022 - 31.01.2023
01.07.2022 - 31.01.2023

Assignment

Organisational unit

Fakultät für Technische Wissenschaften

Categorisation

Project type	Research funding (on request / by call for proposals)
Funding type	§27
Research type	Fundamental research Applied research
Subject areas	1020 - Computer Sciences
Research Cluster	No research Research Cluster selected
Gender aspects	Genderrelevance not selected
Project focus	Science to Science (Quality indicator: I) Classification raster of the assigned organisational units: Institut für Informationstechnologie
working groups	Distributed Multimedia Systems

Funding

Funding program

Organisation: European Commission

Cooperations

Organisation

Address

General Ramírez de Madrid 8
ES - 28020 Madrid

Rua Eng. Frederico Ulrich 2650
PT - 4470-605 Maia

SP Falerina km 7,200
IT - 01034 Fabrica di Roma VT

Lensmannslia 4
NO - 1386 Asker

Robert-Bosch-Platz 1
DE - 70839 Gerlingen-Schillerhöhe

Rue Jules Valensaut
FR - 69008 Lyon

MITHRIDATOU 36-38
GR - 11632 Athen

Strindvegen 4
NO - 7034 Trondheim

SE Stockholm

Piazzale Aldo Moro 5
IT - 00185 Rom

Research activities

All related research activities to this project are shown here. With the link below, you can view them in the search view where you are also able to export them.

Projects	No related projects
Publications	A Traffic-sign recognition IoT-based Application A Traffic-sign recognition IoT-based Application (2022) N. Mehran, D. Kimovski, Z. Najafabadi Samani, R. Prodan HiPEAC Info Nr. 66 No Publisher selected to publication MPEC2: Multilayer and Pipeline Video Encoding on the Computing Continuum MPEC2: Multilayer and Pipeline Video Encoding on the Computing Continuum (2022) S. Afzal, Z. Najafabadi Samani, N. Mehran, C. Timmerer, R. Prodan NCA 2022 Proceedings of the IEEE 21st International Symposium on Network Computing and Applications No Publisher selected to publication Smart Data Placement Using Storage-as-a-Service Model for Big Data Pipelines Smart Data Placement Using Storage-as-a-Service Model for Big Data Pipelines (2023) A. Khan, N. Nikolov, M. Matskin, R. Prodan, D. Roman, B. Sahin, C. Bussler, A. Soylu Sensors No Publisher selected to publication Preemptive Online Scheduling in the Computing Continuum Preemptive Online Scheduling in the Computing Continuum (2023) H. Platter, D. Kimovski UCC 2022 Proceedings of the IEEE/ACM 15th International Conference on Utility and Cloud Computing No Publisher selected to publication Incremental Multilayer Resource Partitioning for Application Placement in Dynamic Fog Incremental Multilayer Resource Partitioning for Application Placement in Dynamic Fog (2023) Z. Samani, N. Mehran, D. Kimovski, S. Benedikt, N. Saurabh, R. Prodan IEEE Transactions on Parallel and Distributed Systems (TPDS) No Publisher selected to publication DataCloud: Enabling the Big Data Pipelines on the Computing Continuum DataCloud: Enabling the Big Data Pipelines on the Computing Continuum (2021) D. Roman, N. Nikolov, B. Elvesater, A. Soylu, R. Prodan, D. Kimovski, A. Marrella, F. Leotta, D. Benvenuti, M. Matskin, G. Ledakis, A. Simonet-Boulogne, F. Perales, E. Kharlamov, A. Ulisses , A. Solberg, R. Ceccarelli RCIS '21 Proceedings of the 15th International Conference on Research Challenges in Information Science No Publisher selected to publication Big Data Pipelines on the Computing Continuum: Tapping the Dark Data Big Data Pipelines on the Computing Continuum: Tapping the Dark Data (2022) D. Roman, R. Prodan, N. Nikolov, A. Soylu, M. Matskin, A. Marrella, D. Kimovski, B. Elvesaeter, A. Simonet-Boulogne, G. Ledakis, H. Song, F. Leotta, E. Kharlamov Computer No Publisher selected to publication DataCloud: Resource provisioning, scheduling and deployment of big-data pipelines DataCloud: Resource provisioning, scheduling and deployment of big-data pipelines (2023) N. Mehran, D. Kimovski, R. Prodan, S. Sengupta, A. Simonet-Boulogne, I. Plakas, G. Ledakis, D. Roman HiPEAC Info Nr. 68 No Publisher selected to publication Handover authentication latency reduction using mobile edge computing and mobility patterns Handover authentication latency reduction using mobile edge computing and mobility patterns (2021) F. Abdullah, D. Kimovski, R. Prodan, K. Munir Computing No Publisher selected to publication Container-Based Data Pipelines on the Computing Continuum for Remote Patient Monitoring Container-Based Data Pipelines on the Computing Continuum for Remote Patient Monitoring (2023) N. Nikolov, A. Solberg, R. Prodan, A. Soylu, M. Matskin, D. Roman Computer No Publisher selected to publication MESDD: A Distributed Geofence-Based Discovery Method for the Computing Continuum MESDD: A Distributed Geofence-Based Discovery Method for the Computing Continuum (2023) K. Horvath, D. Kimovski, C. Uran, H. Wöllik, R. Prodan Euro-Par 2023: Parallel Processing: Proceedings of the 29th International Conference on Parallel and Distributed Computing No Publisher selected to publication Beyond von Neumann in the Computing Continuum: Architectures, Applications, and Future Directions Beyond von Neumann in the Computing Continuum: Architectures, Applications, and Future Directions (2023) D. Kimovski, N. Saurabh, M. Jansen, A. Aral, A. Al-Dulaimy, A. Bondi, A. Galletta, A. Papadopoulos, A. Iosup, R. Prodan IEEE Internet Computing No Publisher selected to publication Big Data Pipelines on the Computing Continuum: Ecosystem and Use Cases Overview Big Data Pipelines on the Computing Continuum: Ecosystem and Use Cases Overview (2021) D. Roman, N. Nikolov, A. Soylu, B. Elvesaeter, H. Song, R. Prodan, D. Kimovski, A. Marrella, F. Leotta, M. Matskin, G. Ledakis, K. Theodosiou, A. Simonet-Boulogne, F. Perales, E. Kharlamov, A. Ulisses , A. Solberg, R. Ceccarelli ISCC 2021 Proceedings of the IEEE Symposium on Computers and Communications No Publisher selected to publication Smart Data Placement for Big Data Pipelines: An Approach based on the Storage-as-a-Service Model Smart Data Placement for Big Data Pipelines: An Approach based on the Storage-as-a-Service Model (2023) A. Khan, N. Nikolov, M. Matskin, R. Prodan, H. Song, D. Roman, A. Soylu UCC 2022 Proceedings of the IEEE/ACM 15th International Conference on Utility and Cloud Computing No Publisher selected to publication Proactive SLA-aware Application Placement in the Computing Continuum Proactive SLA-aware Application Placement in the Computing Continuum (2023) Z. Najafabadi Samani, N. Mehran, D. Kimovski, R. Prodan IPDPS 2023 Proceedings of the IEEE International Parallel and Distributed Processing Symposium No Publisher selected to publication Big Data Pipeline Scheduling and Adaptation on the Computing Continuum Big Data Pipeline Scheduling and Adaptation on the Computing Continuum (2022) D. Kimovski, C. Bauer, N. Mehran, R. Prodan COMPSAC'22 Proceedings of the 2022 IEEE 46th Annual Computers, Software, and Applications Conference No Publisher selected to publication Mobility-Aware IoT Applications Placement in the Cloud Edge Continuum Mobility-Aware IoT Applications Placement in the Cloud Edge Continuum (2021) D. Kimovski, N. Mehran, C. Kerth, R. Prodan IEEE Transactions on Services Computing No Publisher selected to publication A Two-Sided Matching Model for Data Stream Processing in the Cloud – Fog Continuum A Two-Sided Matching Model for Data Stream Processing in the Cloud – Fog Continuum (2021) N. Mehran, D. Kimovski, R. Prodan CCGrid '21 Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing No Publisher selected to publication Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum (2022) N. Mehran, Z. Najafabadi Samani, D. Kimovski, R. Prodan CLUSTER '22 Proceedings of the IEEE International Conference on Cluster Computing No Publisher selected to publication An elastic and traffic-aware scheduler for distributed data stream processing in heterogeneous clusters An elastic and traffic-aware scheduler for distributed data stream processing in heterogeneous clusters (2022) H. Hadian, M. Farrokh, M. Sharifi, A. Jafari Journal of Supercomputing No Publisher selected to publication Towards Graph-based Cloud Cost Modelling and Optimisation Towards Graph-based Cloud Cost Modelling and Optimisation (2023) A. Khan, N. Nikolov, M. Matskin, R. Prodan, C. Bussler, D. Roman, A. Soylu COMPSAC '23 Proceedings of the IEEE 47th Annual Computers, Software, and Applications Conference No Publisher selected to publication CNN-assisted Road Sign Inspection on the Computing Continuum CNN-assisted Road Sign Inspection on the Computing Continuum (2023) N. Mehran, R. Prodan UCC 2022 Proceedings of the IEEE/ACM 15th International Conference on Utility and Cloud Computing No Publisher selected to publication Towards Cloud Storage Tier Optimization with Rule-Based Classification Towards Cloud Storage Tier Optimization with Rule-Based Classification (2023) A. Khan, N. Nikolov, M. Matskin, R. Prodan, C. Bussler, D. Roman, A. Soylu ESOCC 2023 Proceedings of the European Conference on Service-Oriented and Cloud Computing No Publisher selected to publication
Events	IEEE International Workshop on Big Data Processing on the Computing Continuum (BDPROC2022) IEEE International Workshop on Big Data Processing on the Computing Continuum (BDPROC2022) M. Matskin, D. Roman, R. Prodan, A. Marrella Torino/online , Italien 27.06.2022 - 01.07.2022 To event First Workshop on Serverless, Extreme-Scale, and Sustainable Graph Processing Systems First Workshop on Serverless, Extreme-Scale, and Sustainable Graph Processing Systems A. Iosup, R. Prodan Coimbra , Portugal on 15.04.2023 To event 2024: The Second Workshop on Serverless, Extreme-Scale, and Sustainable Graph Processing Systems 2024: The Second Workshop on Serverless, Extreme-Scale, and Sustainable Graph Processing Systems A. Iosup, R. Prodan, A. Varbanescu London , Großbrit. u. Nordirland 07.05.2024 - 08.05.2024 To event
Lectures	Computing in the Cloud Continuum: Technological challenges, killer applications and future trends Computing in the Cloud Continuum: Technological challenges, killer applications and future trends R. Prodan since 16.04.2023 To Lecture A Traffic-sign recognition IoT-based Application A Traffic-sign recognition IoT-based Application N. Mehran, D. Kimovski, Z. Najafabadi Samani, R. Prodan since 26.04.2022 To Lecture DataCloud: Enabling the Big Data Pipeline Lifecycle on the Computing Continuum DataCloud: Enabling the Big Data Pipeline Lifecycle on the Computing Continuum R. Prodan since 19.05.2022 To Lecture DataCloud: Enabling the big data pipeline lifecycle on the computing continuum DataCloud: Enabling the big data pipeline lifecycle on the computing continuum D. Kimovski since 10.05.2023 To Lecture Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum N. Mehran, Z. Najafabadi Samani, D. Kimovski, R. Prodan since 07.09.2022 To Lecture Proactive SLA-aware Application Placement in the Computing Continuum Proactive SLA-aware Application Placement in the Computing Continuum Z. Najafabadi Samani, N. Mehran, D. Kimovski, R. Prodan since 17.05.2023 To Lecture Preemptive online scheduling in the computing continuum Preemptive online scheduling in the computing continuum H. Platter, D. Kimovski since 08.12.2022 To Lecture MESDD: A Distributed Geofence-Based Discovery Method for the Computing Continuum MESDD: A Distributed Geofence-Based Discovery Method for the Computing Continuum K. Horvath, D. Kimovski, C. Uran, H. Wöllik, R. Prodan since 01.09.2023 To Lecture Big Data Pipeline Scheduling and Adaptation on the Computing Continuum Big Data Pipeline Scheduling and Adaptation on the Computing Continuum D. Kimovski, C. Bauer, N. Mehran, R. Prodan since 28.06.2022 To Lecture CNN-assisted Road Sign Inspection on the Computing Continuum CNN-assisted Road Sign Inspection on the Computing Continuum N. Mehran, R. Prodan since 06.12.2022 To Lecture Introduction to graph data Introduction to graph data R. Prodan since 24.07.2023 To Lecture A Two-Sided Matching Model for Data Stream Processing in the Cloud – Fog Continuum A Two-Sided Matching Model for Data Stream Processing in the Cloud – Fog Continuum N. Mehran, D. Kimovski, R. Prodan since 12.05.2021 To Lecture