Seventh Update of INDIGO-1

The Seventh Update of INDIGO-1 release contains:

CloudProviderRanker v.0.5.2

What's new

  • This release provides new functionality like the abbility to retrieve and set of priority and normalization parameters by mean of 4 new APIs:

    • /custom-paas-parameters

    • /get-paas-parameters

    • /get-sla-parameters

    • /custom-sla-parameters

List of RfCs

Installation & Configuration

  • It is enough to upgrade the package and restart the service:</BR>

    /etc/init.d/cloudproviderranker (stop/start)

  • Service Reference Card is available here

Artefacts

Packages:

CloudInfoProvider: cloud-info-provider-indigo, v 0.10.0 & cloud-info-provider: 0.7.0

What's new

  • This update provides repositories and packaging refactoring:

    • INDIGO-related content has been moved to a dedicated repository and the cloud-info-provider is now using the stock version as features developed in the context of INDIGO have been merged in it.

    • With this update it is possible to have only the cloud-info-provider package to register site information in both the CMDB and a Site BDII just by using different arguments and templates.

    • INDIGO-related templates are deployed by the cloud-info-provider-indigo package.

List of RfCs

  • #28 - Splitting repositories/packages

  • Documentation update related to new splitted packages

  • Ansible role update to use new splitted packages

Installation & Configuration

  • No manual intervention should be needed, but in case there are existing cron tasks they will have to take into account the following changes:

    • cloud-info-provider-indigo-service has been renamed to cloud-info-provider-service as cloud-info-provider is now using the stock version

    • /etc/cloud-info-provider-indigo has been renamed to /etc/cloud-info-provider as cloud-info-provider is now using the stock version. If needed copy any customization to the new directory.

  • RHEL</br>

    yum clean all && yum update cloud-info-provider-indigo

  • Ubuntu</br>

    apt-get update && apt-get install -V python-cloud-info-prov

Artefacts

Infrastructure Manager v 1.5.0

What's new

  • The updated version of the IM provides several bugfixes and improvements like:

    • Remove DATA_FILE from configuration. Only DB now.

    • Remove use of insecure Pickle data.

    • Support for Understanding VPC-related Network Information.

    • Support INDIGO Openstack sites as single site.

    • Several improvements and bugfixes.

List of RfCs

  • Issue #188 - Add support for OpenStack pool name in OCCI connector

  • Issue #148 - Add FW creation support in GCE connector

  • Issue #175 - Kubernetes errors

  • Issue #171 - Improve Docker connection with network management

  • Issue #167 - Bugfix killing child processes

  • Issue #161 - Error in GCE connector in case of multiples nodes

  • Issue #140 - Move connectors from httplib to requests lib

  • Issue #110 - Improve data management in DB to enable HA

  • Issue #141 - Move Azure connector to Resource Groups API:

  • Issue #134 - Try to change not maintainer SOAPpy lib

  • Issue #129 - Save IM data in JSON format

  • Issue #111 - Use Vault to improve security in recipes management:

  • Issue #119 - Set restrictive permissions in the master VM data dir:

  • Issue #132 - Support for Understanding VPC-related Network Information

  • Issue #122 - Support INDIGO Openstack sites as single site

Installation & Configuration

  • To upgrade to the last version first you have to install the new version using yum or apt tool: # yum update IM # apt install python-im

  • As there is a change in the DB format. Old 1.4.X data must be updated. Use the script: db_1_4_to_1_5.py to update the DB format:

    • In case that you were using a DATA_FILE to store the IM data (the default option in old version of IM), define the DATA_DB in the im.cfg file.

    • Execute the script db_1_4_to_1_5.py (https://raw.githubusercontent.com/grycap/im/master/scripts/db_1_4_to_1_5.py).

      • In case that you were using a DATA_FILE you have to specify it as the first parameter of the script.

      • If you were using a DATA_DB to store your data this parameter is not needed.

    • The data will be moved to the new format and old data will be renamed as table inf_list_XXXXXX.

  • For containers

    • Stop the old container:

      # sudo docker stop im

    • Remove the old container:

      # sudo docker rm im

    • Pull the new image version:

      # sudo docker pull indigodatacloud/im

    • Start the new version:

      # sudo docker run -d -p 8899:8899 -p 8800:8800 -e IM_DATA_DB=mysql://username:password@server/db_name --name im indigodatacloud/im

Artefacts

Ophidia v. 0.11.0

What's new

  • This version includes stronger support for custom missing values, the new "watch” command for the terminal to repeat periodically the submission (e.g. useful to control workflow status), a simplified configuration and some bug fixes and optimizations for massive and interactive operations.

List of RfCs

  • Fixed:

    • Bug regarding metadatakey table update on cube deletion

    • Bug #9

    • Bug #7

    • Bug #5

    • Unit tests

    • Bug that raises an error message at the end of leaf tasks

    • Bug when an interactive task is terminated by OPH_CANCEL

    • Bugs in building the list of cubes to be processed by 'exit action’

    • Bug in oph_sub_array, oph_div_array, oph_dump ans oph_to_bin primitives

  • Added:

    • Max and min operations to OPH_INTERCUBE operator

    • Argument 'status_filter' to OPH_RESUME operator XML file

    • Support for missing values to several operators and primitives

    • Support for base64-encoded dimensions #10

    • Watch command

    • Use of BASE_SRC_PATH as prefix of files involved in massive and interactive operations

    • Changed:

    • OPH_EXPORTNC2 to handle multiple row selection and export

    • OPH_INTERCUBE operator to allow comparison of cubes stored on different IO nodes

    • Configuration parameters names in oph_configuration (framework) and ophidiadb.conf (server)

    • Disabled usage of libSSH by default

    • Number of cores to execute each light task of final task to 1

    • View command to filter jobs based on their status

  • Removed:

    • oph_dim_configuration from framework file (unified with oph_configuration)

    • OPH_IMPORTNC and OPH_IMPORTNC2 operators (deprecated)

  • For more details please read the Release Notes of Ophidia-0.11.0-0

Installation & Configuration

Artefacts

Packages:

Monitoring - Zabbix-probes v. 1.02

What's new

  • The current update provides new probes - Mesos cluster probes which includes probes for Mesos, Marathon and Chronos

List of RfCs

  • New feature:

    • Implemented Mesos, Chronos and Marathon probes

Installation & Configuration

Artefacts

Synergy Service, v. 1.4.0 and Scheduler Manager, v. 2.3.0

What's new

This update brings the support for the OpenStack Mitaka version and many new features and bug fixes like

  • new Synergy Service features:

    • Synergy CLI command enhanced to support SSL

  • new Synergy Schedule Manager features:

    • Retry mechanism improved

    • Added support for the automatic recycle of DB connections

    • Added support for Keystone domains

    • Added support for AMQP HA to NovaManager

    • Enable SSL for OpenStack Trust

    • NovaManager and KeystoneManager enhanced to support SSL

List of RfCs

Installation & Configuration

Artefacts

Packages:

TOSCA-parser v. 0.7.1

What's new

  • The updated version of TOSCA-parser addresses minor bug fixes and integrates the changes made upstream (in openstack/tosca-parser v.0.7).

Installation & Configuration

In order to update the packages please use:

  • For CentOS 7:

    # yum clean all && yum update tosca-parser

  • For Ubuntu 14:04:

    # apt-get update && apt-get install python-tosca-parser

Artefacts

udocker v. 1.0.1

What's new

  • udocker version 1.0.1 provides support for private docker repositories, better support for docker registry v2 API, verification of image layers integrity, improved download handling, Improved message handling, and packages for CentOS 7 and Ubuntu 14.04.

List of RfCs

  • Bug fixes

    • Minor bugfixes

    • Executable name changed from udocker.py to udocker

    • Insecure flag fixed

  • New features and improvements

    • Added support for login into docker repositories

    • Added support for private repositories

    • Added support for listing of v2 repositories catalog

    • Added checksum verification for sha256 layers

    • Improved download handling for v1 and v2 repositories

    • Improved installation tarball structure

    • Address seccomp change introduced on kernels >= 4.8.8

    • Utilities for packaging

    • #24 - Improved verbose levels, messaging and output

    • #29 - Fully implement support for registry selection --registry parameter

    • #30 - Provide support for private repositories e.g. gitlab registries

    • #31 - Provide --insecure command line parameter for SSL requests

Installation & Configuration

  • in addition a udocker.1 man page is also distributed

  • How to update/upgrade an already deployed service

    • The information is available in the installation_manual in GitBook

    • For the users using the tarball</br>

      curl http://repo.indigo-datacloud.eu/repository/indigo/1/centos7/x86_64/tgz/udocker-1.0.1.tar.gz > udocker-1.0.1.tar.gz

      export UDOCKER_TARBALL=$(pwd)/udocker-1.0.1.tar.gz

      tar xzvf $UDOCKER_TARBALL udocker

      ./udocker # automatically updates the installation from the tarball

Artefacts

TTSc -> WaTTSon v. 1.0.0

What's new

  • WaTTSon is a complete reimplementation of the TTS client in the Go programming language.

List of RfCs

Installation & Configuration

Last updated