Projects tagged ‘storage’

Filesystem in Userspace is a simple interface for userspace programs to export a virtual filesystem to the Linux kernel. It also aims to provide a secure method for non privileged users to create and mount their own filesystem implementations.

smartmontools contains utilities that control and monitor storage devices using the Self-Monitoring, Analysis, and Reporting Technology (S.M.A.R.T.) system built into ATA and SCSI hard drives. This is used to check the reliability of the hard drive ... [More] and to predict drive failures. It is meant to be an up-to-date replacement for the ucsc-smartsuite and smartsuite packages, and is derived from that code. [Less]

Bacula is a set of programs that allow you to manage the backup, recovery, and verification of computer data across a network of different computers. It is based on a client/server architecture and is efficient and relatively easy to use, while ... [More] offering many advanced storage management features that make it easy to find and recover lost or damaged files. [Less]

The Zope Object Database provides an object-oriented database for Python that provides a high-degree of transparency. Applications can take advantage of object database features with few, if any, changes to application logic. ZODB includes features such as a plugable storage interface, rich transaction support, and undo.

Amanda is a backup system that allows the administrator to set up a single master backup server to back up multiple hosts over network to tape drives/changers or disks or optical media. Amanda uses native dump and/or GNU tar facilities and can back ... [More] up a large number of workstations running multiple versions of Unix. Amanda uses Samba or Cygwin to back up Microsoft Windows desktops and servers. See http://wiki.zmanda.com for more information. [Less]

JFire is an ERP, CRM, eBusiness, and SCM/SRM solution for business enterprises. It uses JavaEE, JDO, and Eclipse RCP, and is designed to be highly customizable. It is a complete and extensible solution that fulfills business needs like user ... [More] management, online trade with business partners, points of sale, various distribution channels forming a distribution network, store management, etc. [Less]

Distributed filesystem. Sprays files around and deals with all sorts of failures. Easily add/remove commodity machines and community disks.

The Enterprise Volume Management System (EVMS) Project has the goal of providing unparalleled flexibility and extensibility in managing storage. It represents a new approach to logical volume management, as the architecture introduces a plug-in model that allows for easy expansion or customization of various levels of volume management.

FreeNAS is a free NAS (Network-Attached Storage) server, supporting: CIFS (samba), FTP, NFS, Unison, RSYNC protocols, local user authentication, Software RAID (0,1,5) with a Full WEB configuration interface. FreeNAS takes less than 32MB once installed on Compact Flash, hard drive or USB key.

Partition Image is a Linux/UNIX utility similar to Symantec's Ghost. This utility saves partitions in the EXT2, Reiserfs, NTFS, HPFS, FAT16, and FAT32 file system formats to an image file. The image file can be compressed with gzip or bzip2 in order ... [More] to save disk space, and it can be split in order to fit onto a series of floppy disks. This program can be useful for backup purposes. A boot/root disk is also provided, allowing you to run Partition Image without Linux installed on the hard disk. [Less]

ZFS is a new kind of file system that provides simple administration, transactional semantics, end-to-end data integrity, and immense scalability. ZFS is not an incremental improvement to existing technology; it is a fundamentally new approach to ... [More] data management. We've blown away 20 years of obsolete assumptions, eliminated complexity at the source, and created a storage system that's actually a pleasure to use. [Less]

Apache Xindice is a database designed from the ground up to store XML data or what is more commonly referred to as a native XML database.

Cleversafe provides a dispersed data storage solution.

PowerFolder is a tool to synchronize files between PCs in home-network, intranet or over the internet. On the internet PowerFolder utilizes peer-to-peer technology to discover the people you exchange files with. Main use cases for PowerFolder are ... [More] the automatic file synchronization between PCs, private or public filesharing, the exchange of project files and data backup. [Less]

Cobian Backup is a multi-threaded program that can be used to schedule and backup your files and directories from their original location to other directories/drives in the same computer or other computer in your network. FTP backup is also supported ... [More] in both directions (download and upload). Cobian Backup exists in two different versions: application and service. The program uses very few resources and can be running on the background on your system, checking your backup schedule and executing your backups when necessary. Cobian Backup is not an usual backup application: it only copies your files and folders in original or compressed mode to other destination, creating a security copy as a result. So Cobian Backup can be better described as a "Scheduler for security copies". [Less]

HiveDB is an open source framework for horizontally partitioning MySQL systems. HiveDB uses a partition-by-key scheme to manage sharded data stored in separate MySQL databases. Out of the box HiveDB supports simple JDBC or HIbernate via HIbernate Shards.

AspSQLProvider is a PostgreSQL implementation of the ASP.NET 2.0 Membership, Role, Profileprovider and Session-State Store Provider.

PyTables is a package for managing hierarchical datasets and designed to efficiently and easily cope with extremely large amounts of data. PyTables is built on top of the HDF5 library, using the Python language and the NumPy package (it also ... [More] supports numarray and Numeric right out-of-the-box). It features an object-oriented interface that, combined with C extensions for the peformance-critical parts of the code (generated using Pyrex), makes it a fast, yet extremely easy to use tool for interactively saving and retrieving very large amounts of data. One important feature of PyTables is that it optimizes memory and disk resources so that data takes much less space (specially if on-flight compression is used) than other solutions such as relational or object oriented databases. [Less]

Distributed, content-addressable storage system with repository backends for Memcached, SFTP, Amazon S3, etc.

Net::Amazon::S3 is a simple, easy to use Ruby implementation of the Amazon S3 REST API.

The CryptoBox project aims to bring data encryption to the masses. We develop two Free Software packages: * The CryptoBox live-CD is made for people who want to encrypt their data without bothering about complicated technical issues. A computer ... [More] running the CryptoBox live-CD works as a fileserver/NAS and encrypts your private data. * The CryptoBox-Server package adds a user friendly, web-based frontend for harddisk encryption to a fileserver. [Less]

Clover.ETL is an Open Source, Java based ETL framework which can be used to transform structured data. While using JAVA technology it allows for platform independence. It can be used standalone - as a server application or can be embedded in other applications as a library.

Takusen is a DBMS access library. It has a backend for Oracle on Unix, Linux or Windows via OCI, and a stub to test the library without any database. The infrastructure and the stub let one interface natively with other databases. The distinguished ... [More] feature of Takusen is processing query results using a left-fold enumerator. A higher level interface to databases for Haskell. [Less]

YASLI stands for Yet Another Serialization LIbrary. Features: * Simple user interface, including single method for both storing and loading (intrusive way). * Non-intrusive way is also supported - for serialization of classes from third ... [More] party libraries. * Lookup of named elements. You can reorder, insert, and remove members maintaining backward compatibility with old format. * TextOArchive/TextIArchive. Store data in compact, human-readable text format. * Combined generic and abstract approach allows simple addition of archive types. PropertyTree (GUI with wxWidgets) is currently under development. [Less]

Zumastor:Enterprise Network Storage for Linux. Bringing great snapshot and remote replication support to Linux since 2007.

The userspace portion of device mapper, a generic framework to map one block device into another with sector granularity. Device mapper forms the foundation of LVM2 and EVMS, software RAIDs, dm-crypt disk encryption, and offers additional features such as file-system snapshots.

Distributed copy-on-write file system implemented on top of FUSE, Bitcache and RDF.rb.

The SNIA Common HBA API is an industry standard "C" language Application Programming Interface for management of Fibre Channel Host Bus Adapters and discovery of SAN resources. Developed through the Storage Networking Industry Association (SNIA), the ... [More] HBA API has been overwhelmingly adopted by Storage Area Network vendors to help manage, monitor, and deploy storage area networks. [Less]

A unique flat-file database module, written in pure perl. True multi-level hash/array support (unlike MLDBM, which is faked), hybrid OO / tie() interface, cross-platform FTPable files, ACID transactions, and is quite fast. Can handle millions of keys ... [More] and unlimited levels without significant slow-down. Written from the ground-up in pure perl -- this is NOT a wrapper around a C-based DBM. Out-of-the-box compatibility with Unix, Mac OS X and Windows. [Less]

libjio is a userspace library to do journaled, transaction-oriented I/O. It provides a very simple API to commit and rollback transactions, and on top of that a UNIX-alike set of functions to perform most regular operations (ie. open(), read() ... [More] , write()) in a non-intrusive threadsafe and atomic way, with safe and fast crash recovery. This allows the library to guarantee file integrity even after unexpected crashes, never leaving your files in an inconsistent state. On the disk, the file you work on is exactly like a regular one, but a special directory is created to store in-flight transactions. [Less]