Dynamically Partitioning Workflow over Federated Clouds For Optimising the Monetary Cost and Handling Run-Time Failures

Wen, Zhenyu, Qasha, Rawaa, Li, Zequn, Ranjan, Rajiv, Watson, Paul and Romanovsky, Alexander (2020) Dynamically Partitioning Workflow over Federated Clouds For Optimising the Monetary Cost and Handling Run-Time Failures. IEEE Transactions on Cloud Computing, 8 (4). pp. 1093-1107. ISSN 2168-7161

[img]
Preview
Text
07553525.pdf - Accepted Version

Download (2MB) | Preview
Official URL: https://doi.org/10.1109/TCC.2016.2603477

Abstract

Several real-world problems in domain of healthcare, large scale scientific simulations, and manufacturing are organised as workflow applications. Efficiently managing workflow applications on the Cloud computing data-centres is challenging due to the following problems: (i) they need to perform computation over sensitive data (e.g. Healthcare workflows) hence leading to additional security and legal risks especially considering public cloud environments and (ii) the dynamism of the cloud environment can lead to several run-time problems such as data loss and abnormal termination of workflow task due to failures of computing, storage, and network services. To tackle above challenges, this paper proposes a novel workflow management framework call DoFCF (Deploy on Federated Cloud Framework) that can dynamically partition scientific workflows across federated cloud (public/private) data-centres for minimising the financial cost, adhering to security requirements, while gracefully handling run-time failures. The framework is validated in cloud simulation tool (CloudSim) as well as in a realistic workflow-based cloud platform (e-Science Central). The results showed that our approach is practical and is successful in meeting users security requirements and reduces overall cost, and dynamically adapts to the run-time failures.

Item Type: Article
Uncontrolled Keywords: Scheduling, Cloud Federation, Scientific Workflow Optimisation, Deployment, Security, Monetary Cost
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Mathematics, Physics and Electrical Engineering
Depositing User: Paul Burns
Date Deposited: 10 Oct 2016 11:13
Last Modified: 06 Feb 2023 16:15
URI: https://nrl.northumbria.ac.uk/id/eprint/27955

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics