Third Update of INDIGO-2

The Third Update of INDIGO-2 release contains:

CMDB v. 0.4

What's new

  • Some of the features of the new release are:

    • management of following CI: providers, computing and storage services, images

    • support for public cloud providers

    • access control on relevant level

    • support of IAM authentication

    • support of hierarchical ownership in authorization schema (support of federated organizations)

      possibility to extend CI schema

  • Depends on other components features:

    • IAM

  • Other componets dependent on new features:

    • SLAM

    • Monitoring

    • CloudInfoProvider

Installation & Configuration

Artefacts

Kubernetes

What's new

  • Updated documentation on how to setup a Kubernetes Cluster together with a shell script and Ansible playbook for the installation, uploaded to the git: https://github.com/indigo-dc/kubernetes

    • Feature hub between versions Kybernetes 1.2, 1.3, 1.5

    • repeatable Installation Guide (already uploaded in Git)

Artefacts

Monitoring - Zabbix-probes v. 1.1

What's new

  • Some of the highlights of the new versions are:

    • Openstack and OCCI Probe contain the integration with IAM.

    • new IM probe

    • Zabbix-wrapper validates the hostgroups belonging to hosts

List of RfCs

  • N/A

Installation & Configuration

The only upgraded probe is the OCCI probe. To upgrade just install the new probe packages over the old ones. It should work in the same way however:

  • The IAM information is needed in the configuration file as explained in the Configuration section of the documentation.

  • The CMDB content should have the extra information needed by the new version of the probe or the probe should be set to standalone as explained in the Configuration section of the documentation.

Artefacts

Onedata v. 17.06.0-rc2

What's new

  • The new version of Onedata includes major performance upgrades, stability improvements and many highly demanded new features.

List of RfCs

  • Enabled native GlusterFS support on OSX

  • Multiuser tests implemented

  • add additional logging to performance tests

  • Fix space support with missing storage ID

  • setup luma when adding storage

  • Increase default RAM quota of couchbase buckets

  • Improve dbsync changes filtering and queue size control

  • Remove file_location links.

  • Move periodic cleanup of permission cache to fslogic_worker, refactor file_meta.

  • Adjust changes stream test to delayed creation of file_location.

  • implementation of reverse_luma and luma_cache_behaviour, update of luma tests

  • Enabled native GlusterFS support on OSX

    VFS-3458 Make sure user's connected accounts are popagated through subscriptions, - use md5 rather than base64 to encode user and group ids

  • User base64 url rather than base64 in user id encoding

  • Fix a bug in groups encoding from SAML assertions, do base64 of user ids from IdPs

  • Update esaml reference to point to repo in onedata's github

  • Add support for GlusterFS

  • Update couchbase version to 4.5.1

  • Improve dbsync changes aggregation

    Make sure that new permissions can be safely added to the system without breaking - gui compliance

  • Remove deprecated privilege names

  • Fix dbsync recovery stream

  • Decode cacert from pem into der format, when opening websocket connection.

  • Make sure user aliases in subscriptions are precomputed every time a space name - changes, decrease changes intervals

  • Cluster_worker update (update node monitoring logging)

  • Showing hashes for conflicting space, group and provider names in Onezone

  • Truncating long provider names in sidebar

  • Loader indicator when creating space

  • New support space modal with support token, deploy provider command and expose - data command

  • Extend oneclient fsync with flushing events and fsyncing files on provider side.

  • Add flush of all event streams

  • Add support for sig v2 to AWS S3 helper

  • Moved extended attribute messages from provider to fuse namespace

  • Added extended attributes support

  • Add copy/remove tests.

  • Check if mtime and ctime are equal after rename (in previous implemetation of - rename they were greater).

  • Use only storage ID in space support request

  • Change provider deregistration behaviour

  • Update provider name after modify

  • Copy/remove files during move when non posix storage is used

  • Implement rename operation.

  • Rewrite current remove implementation and delete rename operation.

  • Rename auth_rhea module to auth_keycloak module

  • Add support for RHEA KeyCloak OpenID Connect

  • Disable storage helpers buffering

  • Integrate with new datastore

  • Integrate with refactored datastore

  • Handle chmod, truncate and updating timestamps in storage_sync

  • Refactor storage_import and space_sync_worker

  • Update datastore models to use new datastore API

  • Remove space-storage mapping on space support revoke

  • Enable release docker to log to stdout

  • Add libcouchbase package dependency

  • Create new test files while verifying storage availability

  • Display Provider software version

  • Displaying Zone name and version in Onezone and login view

  • Fix blocking message when at least one provider is offline

  • Added RHEA social icon

Installation & Configuration

Artefacts

Ophidia v. 1.1.0

What's new

  • This Ophidia minor release fixes several bugs and provides the following new main features:

    • WPS-enabled oph_term;

    • support for OpenID authZ/authN;

    • support for FITS data format;

    • operator for file system browsing;

    • multi-user installation;

    • and monitoring of workflow status.

List of RfCs

Installation & Configuration

Artefacts

Packages:

Orchestrator v. 1.4.0-FINAL

What's new

  • Support for the deployment of hybrid clusters has been added; Users can also retrieve their own deployents through REST APIs

List of RfCs

  • Improvements:

    • Issue #232 - Fix IM header generation for IAM federated OpenStacks

    • Issue #231 - Support for deployment of hybrid clusters

    • Issue #230 - [Docker] Validate DB connection before starting wildfly

    • Issue #229 - Add information of who created the deployments in REST response

    • Issue #222 - Allow filtering of deployment though param in REST APIs

Installation & Configuration

No special operations will be required for the upgrade. Thus, the upgrade operations are:

  • Stop the old container:</br>

    sudo docker stop orchestrator</br>

  • Remove the old container:</br>

    sudo docker rm orchestrator</br>

  • Pull the new image version:

    sudo docker pull indigodatacloud/orchestrator:1.4.0-FINAL</br>

  • Start the new version:</br>

    docker run ...*parameters*... indigodatacloud/orchestrator:1.4.0-FINAL</br>

  • More details are available in the Upgrade guide: https://indigo-dc.gitbooks.io/indigo-paas-orchestrator/content/how_to_upgrade.html

Artefacts

SLAM v. 1.2.2

What's new

  • Some of the highlights of this update are:

    • UX has been greatly improved

    • added possibility to specify preference of the user using drag-and-drop technique

    • the current version is compliant with CMDB v0.4

    • improvement in authorization on REST API

    • some minor fixes in business logic and QoS

List of RfCs

  • N/A

Installation & Configuration

  • It is enough to replace service docker, with databases from old version.

Artefacts

PreviousFourth Update of INDIGO-2NextSecond Update of INDIGO-2

Last updated