Projects tagged ‘distributed’ and ‘storage’

Distributed filesystem. Sprays files around and deals with all sorts of failures. Easily add/remove commodity machines and community disks.

AFS is a distributed filesystem product, pioneered at Carnegie Mellon University and supported and developed as a product by Transarc Corporation (now IBM Pittsburgh Labs). It offers a client-server ... [More] architecture for file sharing, providing location independence, scalability, security, and transparent migration capabilities for data. IBM branched the source of the AFS product, and made a copy of the source available for community development and maintenance. They called the release OpenAFS. [Less]

Cleversafe provides a dispersed data storage solution.

Distributed, content-addressable storage system with repository backends for Memcached, SFTP, Amazon S3, etc.

HiveDB is an open source framework for horizontally partitioning MySQL systems. HiveDB uses a partition-by-key scheme to manage sharded data stored in separate MySQL databases. Out of the box HiveDB ... [More] supports simple JDBC or HIbernate via HIbernate Shards. [Less]

Sector is a system infrastructure software that provides functionality for distributed data storage, access, and analysis/processing. It automatically manages large volumetric data across servers or ... [More] clusters, even those over distributed wide area high speed networks. Sector provides simple tools and APIs to access and/or process the data. Data and server locations are transparent to users, as the whole Sector network is a single networked super computer to the users. [Less]

Design goals: A Python object storage system, which aims at handling relational data expressed as python objects. Offers a simple ORM interface for client to create, query objects and delete ... [More] them. Focuses on data scalability across network forming a distributed python object storage system. In-built support for sharding data across different machines by using consistent hashing to handle the nodes in the object store cluster. User can tune the consistent hashing parameters to change the sharding behavior. [Less]

A virtual storage system to exploit and manage the unused portions of existing PC storage devices and make it reliably accessible to users and applications.

distributed key-value storage and compute system

概述E2dynamo采用Erlang进行开发，实现一个amazon dynamo类似的分布式key-value存储系统。 特性分布式数据持久存储 数据高可用性，容错性强 ... [More] 快速的读写操作(99.9%请求再100ms内完成) 小规模集群(推荐1024节点) 方便的加入删除节点 友好的管理界面 易安装部署 基于Erlang易于扩展 当前状态处于编码调试阶段，代码将在近期发布(version 0.1) 因为平日工作较忙,所以本项目更新缓慢, 敬请谅解,期待有兴趣的朋友能够加入! 参考资料：amazon's Dynamo Kai – OpenSource key-value store distributerl [Less]