Projects tagged ‘python’ and ‘storage’

The Zope Object Database provides an object-oriented database for Python that provides a high-degree of transparency. Applications can take advantage of object database features with few, if any ... [More] , changes to application logic. ZODB includes features such as a plugable storage interface, rich transaction support, and undo. [Less]

Tryton is a three-tiers high-level general purpose application platform under the license GPL-3 written in Python and use PostgreSQL as database engine. It is the core base of a complete business ... [More] solution providing modularity, scalability and security. The core of Tryton provides all the necessary functionalities for a complete application framework: data persistence, users management, workflow and report engines, web services and internationalisation. Thus constituting a complete application platform which can be used for any relevant purpose. Currently, the main modules available for Tryton cover the following fields of activity: * Accounting * Invoicing * Sale Management * Purchase Management * Analytic Accounting * Inventory Management [Less]

PyTables is a package for managing hierarchical datasets and designed to efficiently and easily cope with extremely large amounts of data. PyTables is built on top of the HDF5 library, using the ... [More] Python language and the NumPy package (it also supports numarray and Numeric right out-of-the-box). It features an object-oriented interface that, combined with C extensions for the peformance-critical parts of the code (generated using Pyrex), makes it a fast, yet extremely easy to use tool for interactively saving and retrieving very large amounts of data. One important feature of PyTables is that it optimizes memory and disk resources so that data takes much less space (specially if on-flight compression is used) than other solutions such as relational or object oriented databases. [Less]

InstallationThe simplest way to install stockpyle is through easy_install: easy_install stockpyleAlternatively, you can download the latest source from here: ... [More] http://pypi.python.org/packages/source/s/stockpyle/ Then just untar the source and run python setup.py install. Documentationhttp://pypi.python.org/pypi/stockpyle/ Release Notesstockpyle 0.1.4 added a release() API to all stores. This method will release any resources that were lazily acquired by the store during operation. Note that release'ing a store may cause objects from that store to become unusable (e.g. SqlAlchemyStore objects will no longer be able to refresh attributes from the database) stockpyle 0.1.3 fixed SqlAlchemyStore in multithreaded environment (use SQLAlchemy scoped_sessions) stockpyle 0.1.2 fixed bug in SqlAlchemyStore post-processing (adding objects back to an SA session needed to happen before storing in previous layers) fixed bug in SqlAlchemyStore put/get/delete operations (needed to have a catchall exception that would rollback the session) added simple check to SqlAlchemyStore to ensure unique entity retrieval stockpyle 0.1.1 fixed bug where SqlAlchemyStore failed to ignore non-SQLAlchemy-backed objects upon deserialization in a ChainedStore stockpyle 0.1.0 added ThreadLocalStore (helpful for web applications) better key generation (md5 for less collisions, bugfix that made values like 123 == '123', other speed tweaks) fixed bug with accessing SQLAlchemy-backed objects across multiple processes when using memcached [Less]

A folksonomy based file and meta data synchronization engine. The main goals of this project are: 1) Store folksonomy meta data (tags) for files. Provide an API to enter this meta data and also to ... [More] query and search for files. 2) Create a robust synchronization framework that will replicate files and the aforementioned meta data to multiple setups. 3) Keep the data storage layer transparent to enable different "backends" such as a file system, a database, a version control system, etc. Ultimately, this project will become the ideal persistant storage layer for any file management application such as a web album, a CMS or a document management system. A future feature for identidem include a plugin mechanism to automatically "handle" files added to the storage pool. Handling files might for example mean taking a newly added image file, extracting the EXIF and IPTC data from it and translating that to the more generic folksonomy meta data. [Less]

Imagery is an image field, named ImageField, that provides a PIL Image object for Django model instances. Django Imagery manages the storage of Image objects as disk files in a directory configured ... [More] in the Django settings file, IMAGERY_ROOT. Image processing functions are also available. They can be passed as parameters for the ImageField constructor. Each function is applied to the Image object when the model is saved, generating an extra processed image file in a subdirectory of IMAGERY_ROOT. The project suffered a complete rewrite between versions 0.3 and 0.4. Much of it's functionality has moved to project Django Photography. [Less]

python-HAtoolsSummaryPython-HAtools is a set of python modules and scripts designed to help you dynamically configure and manage resources commonly associated with high-availability applications on ... [More] Linux. (Note: python-HAtools doesn't attempt to add any new HA resources to your environment, it just makes management of those resources simpler and more flexible) The first release of python-HAtools will focus on block-level storage, and will include tools for managing: iSCSI IET/iscsi-target (http://iscsitarget.sourceforge.net/) Open-iSCSI (http://www.open-iscsi.org) Volume management LVM2 (http://sourceware.org/lvm2/) Replication DRBD (http://www.drbd.org/) Future versions may allow management of additional functions: Heartbeat (http://linux-ha.org/Heartbeat) Multipath IO (http://christophe.varoqui.free.fr/) NFS (client and server configuration) Cluster filesystems GFS2 (http://sources.redhat.com/cluster/gfs/) Lustre (http://lustre.org) OCFS2 (http://oss.oracle.com/projects/ocfs2/) Monitoring Nagios (http://www.nagios.org) Cacti (http://www.cacti.net/) OpenIPMI (http://openipmi.sourceforge.net/) GoalsOne of the goals of python-HAtools is to accomplish its work using the command-line configuration interfaces of the resources it manages. Where it makes sense, we also use status information from the /proc filesystem. We believe this approach has some advantages over library-API integration: Code that's easy for system administrators to follow Compile-free, portable installation The main disadvantage to this approach is performance. It's assumed, however, that the tasks performed by python-HAtools will not greatly benefit from the memory or speed increases to be gained by library-API integration, and that the users of python-HAtools will more greatly value convenience and familiarity. Another goal is to make the tools highly dynamic by storing as little internal state information as possible. We read the state information from the underlying system as often as possible to be sure that information is up-to-date and decisions are made on current state. StatusDevelopment on python-HAtools is just getting started. The iSCSI.Target (IET) module is functional, but is being reworked to conform to the project's goals. The next module to be completed will be iSCSI.Initiator, the client compliment to iSCSI.Target. [Less]

GrassyKnollGrassyKnoll is a search engine written in Python. NewsThe Warren Commission has reconvened and development is active again. Huzzah! Interested parties should try the unhork branch. ... [More] More slides from the talk at Barcamp Chicago on August 16 are up. Slides from the talk at the NYC Python User Group Meeting on June 17 are up. Version 0.4 is due out soon. This will be the first production-ready release. We had a great PyCon2008. Version 0.3 is out! Get it from the download page. HighlightsHigh-performance storage options: PyLucene, SQLite, DBM, Memcached A RESTful HTTP frontend Easy-to-use wire formats: JSON, HTML Clients in Python and Javascript A clean, powerful data model Lock-free Concurrency Extensive high-level and source code documentation A large suite of UnitTests Use CasesGrassyknoll can provide network-accessible search platform for applications such as: Database Search: add text search to your relational database Site Search: provide search this site functionality on your website Intranet Search: index all of your enterprise data Desktop Search: simultaneously index and search your laptop's documents, emails, etc. More! Hot LinksInstall Grassyknoll Try the Tutorial ContactUs CIA Bot Available VersionsWant to try GrassyKnoll? Use the unhork branch. Development takes place on trunk. Note: trunk is kinda horked right now. Version 0.3 is an exploratory release. It is available from the downloads page. You can also get the source from subversion. It's fully functional but not production ready. [Less]

1. a file maybe huge is cutted and sended by the program using email with suited attachment. 2. the program receive emails and combine the attachments

Design goals: A Python object storage system, which aims at handling relational data expressed as python objects. Offers a simple ORM interface for client to create, query objects and delete ... [More] them. Focuses on data scalability across network forming a distributed python object storage system. In-built support for sharding data across different machines by using consistent hashing to handle the nodes in the object store cluster. User can tune the consistent hashing parameters to change the sharding behavior. [Less]