Pylot is a free open source tool for testing performance and scalability of web services. It runs HTTP load tests, which are useful for capacity planning, benchmarking, analysis, and system tuning.
... [More]
Pylot generates concurrent load (HTTP Requests), verifies server responses, and produces reports with metrics. Tests suites are executed and monitored from a GUI. [Less]
The GL Open Benchmark Suite is based around a PyGTK interface that launches OpenGL programs feeding them with a common CLI options set which will affect their behavior, then receives back their statistical output.
What?This is an open source software for AI, Machine Learning algorithms benchmarking, written in Java with TCP interface and example agents in Java and Python. This software suits for research
... [More], teaching and self-learning. Starting from very simple examples you have ability to dive into very complex tasks. JNI is going to be supported fairly soon.
Why?Got boring one day from walking just the mazes and came up with idea to create a universal benchmark with simple interface and entertaining content.
When?This project was started in March 2009. Mario AI Competition was hold @ ICE-GIC in London on August, 24th and CIG in Milano on September, 7th, 2009. Currently approaching and working on organizing AI Mario Championship 2010.
Who?by Julian Togelius and Sergey Karakovskiy with participant of Tom Schaul and Jan Koutnik.
Where?@ IDSIA [Less]
Cloudrunner is currently used to launch benchmarking jobs to Amazon's EC2. These jobs typically launch a test server along with one or more servers to test. When the tests are completed, the results
... [More] are uploaded to S3 (of course) and the servers, typically, are shutdown. [Less]
pybench is a collection of tests that provides a standardized way to measure the performance of Python implementations. It takes a very
close look at different aspects of Python programs and let's
... [More] you decide which factors are more important to you than others, rather
than wrapping everything up in one number, like the other performance tests do (e.g. pystone which is included in the Python Standard
Library). [Less]
ParaMark is a high fidelity parallel file system benchmark. It does not only include general micro-benchmark, but also includes advanced features for high fidelity benchmarking, such as file system
... [More] image synthesis, file system aging, and workload synthesis. [Less]
The goal of this project is to develop a set of algorithms implemented in many different languages including compiled and interpreted.
Thoose test will allow us to know how much will an application
... [More] be improved if implemented into another language.
The tests are compared with a crude standard C. And the algorithm is initially implemented in Python and ported to all the others languages.
Please, if you run the tests, send me the results at jacobidiego(at)gmail.com
Any contributions are welcomed.
The next results are promediated from all runs and may vary on the algorithm used and the parameters passed.
Results for Quine-MacCLusky Algorithm:
"A procedural minterms reduction algorithm for logic ecuations, similar in function to Karnaugh"
Python is 34 times slower than C.
C++ is 3 times slower than .C
Note that, Python efficiency varies too much depending on the number of variables to manipulate. Plain Standard C is a pain to develop, most developers uses APIs like GLib to make this task done.
Another project aiming to bench languages is at: http://shootout.alioth.debian.org/ [Less]