FreeBSD enlistments

Avatar

Piet Delport

over 2 years ago

I added enlistments for FreeBSD and FreeBSD Ports a few days ago, and both downloaded for a while (getting to several thousand revisions), but then failed with the message "Downloading source code history (Failed)".

What's going on there?


Avatar

Robin Luckey

over 2 years ago

Hi Piet,

I'm afraid we had to cancel those jobs intentionally.

These downloads are extremely large and will literally take us a week or more to complete. Meanwhile, we also have several other large projects (NetBSD, Mandriva Linux, and others) who are also waiting to be downloaded.

So that our whole system doesn't come to a complete halt, we're running only one or two of these large jobs at a time. Once the initial downloads are complete, we should be able to keep up with regular updates without any problems. It's just the initial downloads that are a problem.

We've been making good progress on our download queue, and we're adding new hardware to our server farm all the time (in fact we just received some new hardware that is waiting to be installed right now), so we should be able to run these jobs soon.

Long term, the correct answer for us is to use CVS mirroring features to host our own local mirror. That would be the fastest way to import all the history. Until we have time to write that code, though, the line is moving rather slowly for the truly big CVS projects.

Thanks for your patience,

Robin


Avatar

anholt

over 2 years ago

I've been trying out parsecvs on a cvsup mirror of the FreeBSD repository to produce a git tree. It's not suitable for doing development on because of repocopies rewriting history, but it would be suitable for ohloh assuming that ohloh is deals with history rewrites. If this works out, I'll enlist src and ports from my tree.


Avatar

Piet Delport

over 2 years ago

Robin Luckey: Cool, thanks for the explanation.

I don't know if this has been brought up before, but has any thought been given to supporting enlistments via CVSup? Several big projects (including FreeBSD, obviously) use it as an alternative to direct CVS for repository distribution.


Avatar

Robin Luckey

over 2 years ago

@Piet,

Yes, we've done some experiments locally with CVSup, and have been intending to use it for a long time. It just seems like something else is always demanding our attention.

@anholt,

That's great! I'll be very interested in how this works out. Thanks for helping out. Keep me posted!