Evolve Newsletter 1
With carefully designed middleware, API and connectors, Evolve is already able to accelerate Spark applications in a fully transparent manner, to containerize parallel file system in Docker and allow Zeppelin notebooks to access the supercomputer. Already one of the Pilot application with complex workflow including MPI parallel code and AI can be orchestrated on the platform taking advantage of the diversity of the computing resources.
Much is still ongoing: resource management and monitoring, data protecting, articulation between Kubernetes and Slurm or even deeper storage hierarchies. Several external partners have already been engaged to test and validate the Evolve system and help us to mature the solution.