TikiWiki stats are incorrect

Avatar

marclaporte

12 months ago

Hi!

"Over the entire history of the project, 148 contributors have submitted code. 42 have done so in the last year." http://www.ohloh.net/projects/39/analyses/latest/contributors

It should be over 200. Please see: http://cvs.tikiwiki.org/cvsmonitor.pl?module=Tiki.Tiki&authorsortby=commits http://cia.vc/stats/project/tikiwiki

When I check the enlistments: http://www.ohloh.net/projects/39/enlistments

I notice that this: :pserver:anonymous:@tikiwiki.cvs.sourceforge.net:/cvsroot/tikiwiki Step 1 of 3: Downloading source code history (Failed) tiki

It is written: "We are already aware of the problem, and you do not need to take any specific action. We usually correct failures within the next business day."

I have checked several times and the error message seems to persist.

Any ideas?

Thanks!

M ;-)


Avatar

marclaporte

11 months ago

Hi again!

Checkout now seems to be OK: :pserver:anonymous:@tikiwiki.cvs.sourceforge.net:/cvsroot/tikiwiki Ohloh update completed 13 days ago. http://www.ohloh.net/projects/39/enlistments

But stats are way off. For example:

13 commits: http://www.ohloh.net/projects/39/contributors/2098

456 commits: http://cvs.tikiwiki.org/cvsmonitor.pl?cmd=viewBrowseAuthor&author=marclaporte&module=Tiki.Tiki

Overalls stats seem to be missing a big chunk of CVS

Thanks!

M ;-)


Avatar

marclaporte

11 months ago

Broken again as of now: ":pserver:anonymous:@tikiwiki.cvs.sourceforge.net:/cvsroot/tikiwiki Step 1 of 3: Downloading source code history (Failed)"

Thanks!

M ;-)


Avatar

Robin Luckey

11 months ago

I am investigating this now. The job failure itself is a bit of a puzzle, and I'm trying a fresh import now.

I'm not sure why so many of the commits seem to be missing. The CVS Monitor web site crashes when I attempt to query your list of commits, so I may be stuck drilling through rlog files for a while (ugh).

It may be a branching issue. Can you explain the branching pattern for this project? Are the missing commits on a branch other than the HEAD?

It would be very helpful if you could find a particular commit which we are missing -- preferably a relatively old one, since we haven't successfully downloaded the tiki module in a few weeks.

Thanks


Avatar

marclaporte

11 months ago

Hi Robin,

Thank you for your help.

We have 2 branches (BRANCH-1-9 and HEAD) at the moment. We had other branches (ex.: BRANCH-1-8) before but they are all deprecated.

Missing commits seem to be on BRANCH-1-9

Here is an example of a commit to BRANCH-1-9 in August 2006

cvs view diff: http://tikiwiki.cvs.sourceforge.net/tikiwiki/tiki/templates/tiki-calendar.tpl?r1=1.46.2.64&r2=1.46.2.65

cvs monitor: http://cvs.tikiwiki.org/cvsmonitor.pl?cmd=viewBrowseVersion&version=1.46.2.65&file=templates/tiki-calendar.tpl&module=Tiki.Tiki

cvs mailing list http://sourceforge.net/mailarchive/forum.php?threadname=E1GH7HC-000352-3z%40mail.sourceforge.net&forumname=tikiwiki-cvs

Best regards,

M ;-)


Avatar

marclaporte

10 months ago

Hi Robin,

The problem is still not solved.

Best regards,

M ;-)


Avatar

Robin Luckey

10 months ago

Ouch, sorry I missed your post. You've been waiting a long time.

The answer to your question might simply be that this is by design: we only import a single branch. For CVS, this is always HEAD. If all of the HEAD commits are present on Ohloh, and none of the BRANCH-1-9 commits are present, then our system is working as designed.

Also, it looks like module 'tiki' is still failing to update. I'll take another look at this.


Avatar

marclaporte

10 months ago

Hi!

It makes sense to only import a single branch so as not to count the same effort twice (when it is merged up).

However, it skews our stats. We have some developers, such as myself, which focus on bugfixing. And some others are more focused on developing the amazing features of the next version.

The mystery is solved. That's the way the cookie crumbles :-)

Best regards,

M ;-)


Avatar

marclaporte

5 months ago

Hi again Robin!

Would there be a way to use another Branch than HEAD?

It would be much more representative to use BRANCH-1-9 because it's the stable, official release. And change to BRANCH-1-10 when that comes out.

Thanks!

M ;-)


Avatar

Robin Luckey

5 months ago

Hi Marc,

We currently don't have this capability for CVS.

To be honest, I think it would fairly straightfoward to implement -- but we just don't have the resources right now.

We're pushing to open up the Ohloh code, and this might be a good task for an outside contributor to take a swing at when the code is available.

Thanks, Robin


Avatar

marclaporte

4 months ago

Hi Robin,

Please inform them there is a bounty of a keg of beer (provided mail-order of beer is legal where they are) for the people that fix it.

M ;-)


Avatar

Andy Verprauskus

4 months ago

Will the keg be delivered by the Silver Bullet train?


Avatar

marclaporte

2 months ago

More likely by UPS or Fedex :-)


Avatar

marclaporte

2 months ago

ok, we are now using SVN instead of CVS and it seems to have affected the stats.

169 contributors here: http://www.ohloh.net/projects/tikiwiki/contributors (should be over 200 but at least, it's closer)

but only 47 contributors on the widget: http://www.ohloh.net/projects/tikiwiki/widgets

Best regards,

M ;-)


Avatar

Robin Luckey

2 months ago

This is a problem of poor communication on our part.

Ohloh counts "active contributors" as contributors who made at least one commit in the last 12 months.

There were 169 total contributors found in the source control logs. However, only 47 of those contributors did any work in the last 12 months.

So in the widget and most other places, Ohloh reports the number of contributors on this project as 47.

I admit in looking over the report that this is not at all clear.


Avatar

marclaporte

2 months ago

Hi Robin!

1- The widget shows the total number of lines of code and the total value of the project, so why not show the total number of contributors?

This has surely been debated/discussed.

In our information, we say that over 200 people have contributed to the source code of TikiWiki (which never ceases to impress me). This makes it awkward for us to put the nice ohloh widget, as you can see here: http://tikiwiki.org/Top-10+stats

2- The "Effort" of 652 Person Years seems too high to me. TikiWiki is 5 and half years old. This would be an average effort of about 120 persons per year since the beginning of the project. While we had loads of people working on the project, most are not full time. Maybe something is being counted in double?

Best regards,

M ;-)


Avatar

Robin Luckey

2 months ago

1- Actually, I don't know that we really debated it much; this is the first time it's come up. We can debate it now. :-).

I'm inclined to agree that in the context of a 50-pixel widget with little room to explain things, "total" is probably the expectation.

I don't know whether anyone would have a cow if we switched from "active contributors" to "total contributors" in the widget. We have a lot of widgets in the wild now.

2- The person-years effort estimation is strictly an artifact of COCOMO, which I don't really defend. In my opinion, COCOMO often doesn't correlate with the typical ad-hoc development process of many open source projects (as opposed to corporate waterfall methodologies, for which it was designed). We provide it here because it's a relatively standard way to express the scale of a project to non-technical users.

Ironically, given the source control history, Ohloh could provide a very accurate estimate of actual development effort, but COCOMO is a "standard" and it doesn't use this extra information. Also, COCOMO is intended to include a lot more than just development effort -- it's supposed to estimate planning, discussion, testing, management, etc.

We can look into providing Ohloh's calculation of the total person-years from the source control logs as a new statistic.


Avatar

marclaporte

about 1 month ago

Hi Robin!

Assuming nobody will have a cow, may I suggest a switch to "total contributors" in the widget?

Assuming it's fairly easy to implement, we can always rollback if it provokes a debate, which I doubt.

Best regards,

M ;-)


Avatar

marclaporte

about 1 month ago

Hi again!

According to CIA, TikiWiki has 15 + 172 others = 187 contributors.

But for Ohloh, "Over the entire history of the project, 169 developers have contributed."

I think it's because CIA also takes into account the CVS stuff. We still have our stable BRANCH-1-9 on CVS, while the newer BRANCH-1-10 is on SVN.

I wonder if I should add the CVS to the enlistements? But I am worried it'll mess up the stats.

Anyways... I won't do anything for now and until someone has some good advice.

Best regards,

M ;-)


Avatar

marclaporte

24 days ago

I just replaced this with this.

I am hoping it will help with our stats. This is the branch we are really using until we release 1.10.0 (soon!)

Count of: Codebase 2,336,667 Effort (est.) 669 Person Years Avg. Salary $ year $ 36,811,554 seems much too high. I think something is counted in double.

The current image here jumps from 1.5M LOCs to 2.5M in a suspiciously short amount of time, and a few months later, from 2.5M to 3.5M

I'll revert if it makes things worse :-)

Best regards,

M ;-)


Avatar

marclaporte

22 days ago

I am reverting because it is now reporting: "Short source control history (4 months)" and only "44 contributors".

One day, I'll figure it out :-)

M ;-)