Forums

I was wondering if there is a place to see the queue of ohloh's bots like the order of things they will download/anaylize/etc next.

Right now, there are no way to know how long Ohloh's queue and whose projects are next in line. I could like to know the download speed if possible.

Kiba

over 6 years ago

Hi Kiba,

A job queue is a fine idea, and it's something we'd like to provide, but it's not easy. There are a lot of complications that come into play:

• Jobs might be throttled based on which forge the source code is hosted on. Because we want to be good internet citizens, we limit the amount of bandwidth we demand from each forge. Your project might be next in line for download, but continually skipped to avoid overloading a forge.

• We have a cluster of several machines that do the downloading and analysis work, with dozens of jobs running at once. The amount of CPU, network, and database resources we have available is always changing. Jobs are chosen to run based on the resources we expect them to require, which means that the next job in the queue is not always the best one to run at the moment.

All this boils down to the fact that it's somewhat unpredictable exactly which job will be chosen next, and how long the wait in the queue is going to be. The good news is that we can usually start a job almost immediately, and rarely should you have to wait more than a few hours.

We have a lot of bandwidth, and our download speed is almost always limited by the abilities of the source control server. Because we get every version of every file, downloads can take quite a while. Truly massive projects (like GCC or OpenOffice) can take several days to download. The majority of projects finish in under an hour.

We'll keep thinking about how best to expose the queue and the expected wait times.

Thanks for your interest,

Robin

Robin Luckey

over 6 years ago

How about an email when it is done?

donert

over 6 years ago

I thought about an email myself. That'd be very nice - right now I'm checking a couple of times a day.

Swashbuckler

over 6 years ago

Agreed, email is a fine idea.

For now, you can subscribe to the RSS for a project, and this feed contains notifications of all changes to the project.

The link is in the upper-right area of the project page near the Enlistment and Commits links.

Robin

Robin Luckey

over 6 years ago

Robin,

As I posted in a different thread, RSS feeds don't seem to be very usable. They don't work with Firefox Live Bookmarks, with Onfolio's RSS reader, with the Google Reader or even as just plain XML in IE.

Swashbuckler

over 6 years ago

Post a Response