Call for research pilots on public cloud (AWS)
This call is aimed at research projects from SURF member research institutes and closes on 1 November 2020.
The well-known top 3 cloud providers Amazon Web Services (AWS), Microsoft Azure and Google Cloud are among the largest companies of the world. Together they have revenues which are more than half of the Dutch GDP. They have a vast amount of resources in terms of hardware, workforce, and services. Furthermore, they offer many innovative services in a user-friendly manner. For example, AWS at the moment offers more than 200 services that can easily be combined to form complex architectures.
The grand scale at which the public clouds operate allows them to offer these services in a cost-efficient manner. SURF users can benefit from this as well. Their pay-as-you-go model can be used to reduce costs dramatically by cleverly selecting services that minimize running costs and switch of the services when not in use. As such, we see great potential in using these hyperscale capabilities for research purposes.
The challenges of using the public cloud are well known. One of these risks is that the companies behind it become too powerful and customers find themselves in a vendor lock-in. Having an exit strategy ready is, in our opinion, a prerequisite for going to the cloud. Security is another one of these challenges. Security in public clouds, like in any architecture, requires a focus directly from the design phase onwards.
Expertise at SURF
The Scalable Data Analytics Group at SURF uses cloud native solutions to process and analyze (streaming) big data for research and data science. The group has certified AWS solution architects and has expertise and experience with open source tools such as Docker containers, Kubernetes (container orchestration), Apache Kafka and Spark. With these and other tools, we built platforms to process, store and/or analyze (streaming) data. These solutions allow for maximum portability and can either be deployed on SURF’s own private cloud or on any of the public clouds.
Call for pilots
The public clouds provide a great opportunity for research as many of these new services and their speed of development can accelerate research. Also, we feel that the only way to cope with the aforementioned challenges, is to start using public clouds. That is why we organize this call for researchers who share our interest in the public cloud and the great opportunities it can bring.
In this call a maximum of 4 pilot projects will be chosen to develop a solution on AWS. The reason for using AWS is our experience with it (by certified AWS solution architects) and the opportunities for research environment architectures it currently has. SURF will provide design and implementation support (for a maximum of 160 hours per selected project) and the AWS resources are subsidized by NWO (fair use principle).
This call is really meant for pilot projects. We will help to develop a Proof of Concept (PoC) for your research environment in AWS and advice you on how to continue after the funded pilot project. All viable projects should have a need for data intensive processing, possibly in combination with data analytics, data storage, data sharing or streaming data. Past and present examples of the SDA group are solutions to process the data of IoT-devices, traffic data or large amounts of Twitter data, but we are open to explore other application areas as well. From the description of your research it has to be clear that you have a data-intensive project.
Do you like what you read? Write a proposal which describes your project and that meets our description before 1 November:
- The project is a Proof of Concept (PoC) in which we demonstrate a component or service of AWS that can be used by your research project. The proposal has to describe your research and the high-level requirements for the service you want to develop. Do not forget to describe the data intensive component of your project and the application area at the research section.
- The project can take up to 3 months maximum. Give a rough planning in the proposal.
- Sufficient participation of the applicant: the applicant should have an idea and preferably his/her own resources with at least basic cloud skills to actively co-develop with us. The proposal should describe your available resources (number of individuals, available workforce, skillsets, and available time) and explain how you would like to collaborate with us.
- We help creating components or services, but will not maintain them after the project. If you have an idea, describe your vision how to continue the components or service after the project.
- The total budget for AWS resources is approximately 5K per project. To meet budget restraints, we may develop the PoC in a scaled-down version. Describe if you can your estimated need for compute and storage during the project such that it is possible to derive cost from it.
- Use of AWS public cloud standard-, managed - or serverless services. If you have an idea, describe the AWS services you want to use.
- First round of projects will start 16 November 2020. The deadline of the first round, the written proposals, is 1 November 2020.
- Preferably the components or services of the PoC results are reusable. Describe if applicable which parts of your research environment might be of interest to other researchers.
- You accept and will actively collaborate in the creation of a use case after completion of the pilot project which SURF may use to demonstrate value of public clouds among Dutch and international researchers.
Furthermore, the same criteria apply as for small NWO Computing Time on National Computer facilities applications. Researchers may submit an application if they are employed (i.e. hold a salaried position) at one of the following organizations:
- Universities established in the Kingdom of the Netherlands;
- University Medical Centers;
- NWO and KNAW institutes;
- Dutch universities of applied sciences;
- the Netherlands Cancer Institute;
- the Max Planck Institute for Psycholinguistics in Nijmegen;
- the DUBBLE beam line at the ESRF in Grenoble;
- the Princess Máxima Centre for paediatric oncology;
- NCB Naturalis;
- the institutes participating in the SURF Cooperative: KNMI, RIVM, TNO, the National Archives, the National Library, University of Humanistic Studies and the Police Academy.
Note: applications from researchers with a temporary position may need a signature as guarantee from a supervising staff member with a permanent contract. By signing the application, the supervising staff member declares that they are responsible for the awarded computing time after the expiration date of the project.
Procedure of selecting the projects
From the written proposal we make a first selection of projects. Then, in a second round we will invite the selected projects from the first round (assessment phase) to further explain their projects. The second round will take place between 1 and 16 November.
Submit your proposal
If you are interested, please send your idea to email@example.com. No correspondence will be entered into.