Federated clouds address many problems of scientific and industrial applications, such as legal restrictions and efficient access to data. Despite these benefits, its natural geographic distribution and its complex software stack challenge developers and operators seeking to take advantage of this type of infrastructure.

The infrastructure used in this demonstration is composed of several cloud providers that are geographically distributed. The perfect federation of these providers is implemented through the use of the Fogbow middleware and federated Fogbow networks (https://www.atmosphere-eubrazil.eu/use-cases/using-fogbow-federate-netwo... -providers). It consists of a federated deployment of several sites on both sides of the Atlantic Ocean that integrates a small number of resources, sufficient for the validation of deployment services.

This demonstration shows the work developed in the ATMOSPHERE project (https://www.atmosphere-eubrazil.eu/) to deploy self-managed elastic clusters in federated clouds using the EC3 and IM frameworks of cloud orchestrator (https: //www.atmosphere - eubrazil.eu/im-tosca). In particular, a Mesos cluster will be shown in the demonstration, but other cluster administrators are also supported, such as Torque, SLURM, and Kubernetes. Our approach can automatically expand or reduce managed resources and ensure communication and execution through different IaaS providers. In particular, two different cloud providers are used. Initially, only the front-end node starts at the first provider that uses the EC3 client (https://github.com/grycap/ec3/). As requested by the cluster workload, the new WNs are deployed to the first provider. When the WN number in the first provider reaches a predetermined threshold (specified by the user), the subsequent WNs are implemented in the second provider. To enable connectivity between all the virtual machines in the infrastructure, a federated network is created. Not only does it allow connectivity without the need for public IPs in WNs, but also the encryption of communications to guarantee security.

 

Relevance for Cloudscape Brazil 2018: 

Cloudscape Brazil pursues the collaboration among European and Brazilian research centres and industry in the area of Clouds and advanced ICT. This demo showcases a successful collaboration in this frame.

Authors: 

Amanda Calatrava Arroyo - Universitat Politècnica de València

Year: 
2019