Publikation: Smart Data Placement for Big Data Pipel...
Stammdaten
Titel: | Smart Data Placement for Big Data Pipelines: An Approach based on the Storage-as-a-Service Model |
Untertitel: | |
Kurzfassung: | The development of big data pipelines is a challenging task, especially when data storage is considered as part of the data pipelines. Local storage is expensive, hard to maintain, comes with several challenges (e.g., data availability, data security, and backup). The use of cloud storage, i.e., Storageas-a-Service (StaaS), instead of local storage has the potential of providing more flexibility in terms of such as scalability, fault tolerance, and availability. In this paper, we propose a generic approach to integrate StaaS with data pipelines, i.e., computation on an on-premise server or on a specific cloud, but integration with StaaS, and develop a ranking method for available storage options based on five key parameters: cost, proximity, network performance, the impact of server-side encryption, and user weights. The evaluation carried out demonstrates the effectiveness of the proposed approach in terms of data transfer performance and the feasibility of dynamic selection of a storage option based on four primary user scenarios. |
Schlagworte: | Storage-as-a-service, big data pipelines, data locality, data placement strategies, software containers |
Publikationstyp: | Beitrag in Proceedings (Autorenschaft) |
Erscheinungsdatum: | 14.03.2023 (Online) |
Erschienen in: |
UCC 2022 Proceedings of the IEEE/ACM 15th International Conference on Utility and Cloud Computing
UCC 2022 Proceedings of the IEEE/ACM 15th International Conference on Utility and Cloud Computing
(
IEEE Xplore Digital Library;
)
zur Publikation |
Titel der Serie: | - |
Bandnummer: | - |
Erstveröffentlichung: | Ja |
Version: | - |
Seite: | S. 317 - 320 |
Versionen
Keine Version vorhanden |
Erscheinungsdatum: | 12.2022 |
ISBN: |
|
ISSN: | - |
Homepage: | https://ieeexplore.ieee.org/document/10061837 |
Erscheinungsdatum: | 14.03.2023 |
ISBN (e-book): | - |
eISSN: | - |
DOI: | http://dx.doi.org/10.1109/ucc56403.2022.00056 |
Homepage: | https://ieeexplore.ieee.org/document/10061837 |
Open Access |
|
Wibi-relevante Version |
AutorInnen
Akif Quddus Khan (extern) |
Nikolay Nikolov (extern) |
Mihhail Matskin (extern) |
Radu Aurel Prodan (intern) |
Hui Song (extern) |
Dumitru Roman (extern) |
Ahmet Soylu (extern) |
Zuordnung
Organisation | Adresse | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Kategorisierung
Sachgebiete | |
Forschungscluster | Kein Forschungscluster ausgewählt |
Peer Reviewed |
|
Publikationsfokus |
Klassifikationsraster der zugeordneten Organisationseinheiten:
|
Arbeitsgruppen |
|
Kooperationen
Organisation | Adresse | ||||
---|---|---|---|---|---|
Norwegian University of Science and Technology
|
NO
- 7491
Trondheim |
||||
SINTEF Digital
|
NO
Oslo |
||||
Royal Institute of Technology
|
SE
Stockholm |
||||
Oslo Metropolitan University
|
NO - 0130 Oslo |
Forschungsaktivitäten
(Achtung: Externe Aktivitäten werden im Suchergebnis nicht mitangezeigt)
Projekte: |
|
Publikationen: | Keine verknüpften Publikationen vorhanden |
Veranstaltungen: |
|
Vorträge: | Keine verknüpften Vorträge vorhanden |