README

Onedata

This is the main code repository of Onedata - a global data management system, providing easy access to distributed storage resources, supporting wide range of use cases from personal data management to data-intensive scientific computations.

Onedata is composed of several components:

• Onezone - allows to connect multiple storage providers into a larger distributed domain and provides users with Graphical User Interface for typical data management tasks,

• Oneprovider - the main data management component of Onedata, deployed at each storage provider site, responsible for unifying and controlling access to data over low level storage resources of the provider,

• Oneclient - command line tool which enables transparent access to users data spaces through Fuse virtual filesystem,

• Onepanel - administration and configuration interface for Onezone and Oneprovider components,

• LUMA - service which allows mapping of between Onedata user accounts and local storage ID's, here we provide an example implementation of this service.

This repository combines these components into one source package, which can be used to build and test complete Onedata platform. Each of the components consists of the following submodules of this repository:

Common components

Submodule	URL	Description
Cluster Manager	https://github.com/onedata/cluster-manager	Common Onedata component shared between Onezone and Oneprovider, which monitors and controls Onedata worker processes at site level.
Cluster Worker	https://github.com/onedata/cluster-worker	Common Onedata worker process implementation, shared between Onezone and Oneprovider.

Onezone

Submodule	URL	Description
Onezone worker	https://github.com/onedata/oz-worker	Main Onezone functional component, based on the Cluster Worker framework.

Oneprovider

Submodule	URL	Description
Oneprovider worker	https://github.com/onedata/op-worker	Main Oneprovider functional component, based on the Cluster Worker framework.

Oneclient

Submodule	URL	Description
Oneclient	https://github.com/onedata/oneclient	Oneclient command line tool implementation.

Onepanel

Submodule	URL	Description
Onepanel	https://github.com/onedata/onepanel	Onepanel administration service implementation.

LUMA

Submodule	URL	Description
LUMA	https://github.com/onedata/luma	Local User MApping service reference implementation.

Other

Submodule	URL	Description
Appmock	https://github.com/onedata/appmock	Appmock is used during testing to mock any service which exposes REST API.
Bamboo scripts	https://github.com/onedata/bamboos	Bamboos is used for automating test deployments in bamboo during Onedata integration tests.
Tests	https://github.com/onedata/tests	Main Onedata tests repository.

In order to initialize all submodules please use:

make submodules

instead of directly invoking Git submodule commands.

Getting Started

The easiest way to get started with using or deploying Onedata is to start with our official documentation.

In order to try deploying Onedata, or specific components we have prepared a set of example configurations and scenarios.

Building

The best way to use Onedata is to use our Docker images available at Docker Hub or the binary packages available here. Currently the binary packages are only available for Oneclient component.

This repository can be also used to build entire Onedata system by invoking:

make

The build process itself is fully based on Docker containers, so no other prerequisites other than Docker should be necessary. In case of problems with Docker cache, please set NO_CACHE=1 environment variable.

Support

Please use GitHub issues mechanism as the main channel for reporting bugs and requesting support or new features.

For more detailed support and discussions online please contact as at our public HipChat channel, however our availability at this channel is a on a best effort basis.

More information about support can be found here.

Copyright and license

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.