CLUES (CLUster Energy Saving) INDIGO Extensions
CLUES is an elasticity manager system for HPC clusters and Cloud infrastructures that features the ability to power on/deploy working nodes as needed (depending on the job workload of the cluster) and to power off/terminate them when they are no longer needed.
CLUES has been extended in the INDIGO-DataCloud project with new plugins to support the PaaS Orchestrator and to introduce elasticity capabilities to both HTCondor and Apache Mesos (including its frameworks Chronos and Marathon). These are the plugins:
- indigo_orchestrator.py: CLUES plugin to connect with the INDIGO orchestrator.
- condor.py: CLUES plugin to connect with HTCondor.
- mesos.py: CLUES plugin to connect with Mesos, Chronos, and Marathon.
- Release Notes v. 0.8.0
Release Notes v. 0.9.0
Highlights of INDIGO-2 version:
- Add IAM token management
- Ubuntu 14.04, 16.04 / CentOS 7
List of RfCs
- IAM token expiration -> https://github.com/indigo-dc/clues-indigo/issues/19
- Manage authentication for Mesos/Marathon/Chronos endpoints -> https://github.com/indigo-dc/clues-indigo/issues/20
- Orchestrator plugin does not correctly manage more than one master node -> https://github.com/indigo-dc/clues-indigo/issues/21
- Enable to detect mesos slaves by ip -> https://github.com/indigo-dc/clues-indigo/issues/23
- CPU and memory of mesos nodes are hardcoded when the nodes are off -> https://github.com/indigo-dc/clues-indigo/issues/25
- CPU and Memory used are not updated -> https://github.com/indigo-dc/clues-indigo/issues/26
- Orchestrator plugin does not correct manage SSL connections -> https://github.com/indigo-dc/clues-indigo/issues/29
- Problems updating infrastructure with queued requests-> https://github.com/indigo-dc/clues-indigo/issues/33
- Error in orchestrator plugin -> https://github.com/indigo-dc/clues-indigo/issues/35
- Error detecting unexisting jobs in mesos -> https://github.com/indigo-dc/clues-indigo/issues/45
- Error getting correct uuid when powering on a new node -> https://github.com/indigo-dc/clues-indigo/issues/42
- Ansible Role: https://github.com/indigo-dc/ansible-role-clues
List of Artifacts