Re: [ljc] Hosted CI

From: Alan P.
Sent on: Friday, June 28, 2013 8:39 AM
Wes,

Most providers do have a mirror to central but there still is an overhead of transferring a large number of individuals files. 

If your total artifact count is low and just from central you are likely to be okay. In our case 1GB of files added 3 to 5 minutes to our build time and when you have 7 concurrent Jenkins jobs using the same artifacts this adds up to a significant waste in build time.

You can simplify the administration of your own Jenkins clusters by using Puppet with the available Jenkins module (https://github.com/jenkinsci/puppet-jenkins) for installing Jenkins and Jenkins Plugins. We managed to completely put our Jenkins installation and configuration into puppet manifests and the build jobs (XML files on disk) into SCM. This allowed us to build a whole new Jenkins cluster from scratch in 5 minutes.

Alan



On 28 June[masked]:43, Wesley Hall <[address removed]> wrote:
Alan, 

The maven download implications is a really good point, I hadn't considered that. I guess I always assumed that anyone running a hosted CI would have some mirror of mavencentral closeby and redirect requests there. 

I have given some thought to just running up an instance of EC2, but it just felt like one more thing to manage, I already have quite a lot on my plate, but you are right, it might be the best option. I will mull this over again.

Thanks.

Wes


On Thu, Jun 27, 2013 at 8:28 PM, Wesley Hall <[address removed]> wrote:
Julian, 

Looks like travis-ci doesn't support private repositories yet. It looks interesting though, I will keep an eye on it for the future. Thanks :)

Wes


On Thu, Jun 27, 2013 at 2:04 PM, Alan Parkinson <[address removed]> wrote:
Hi Wes

We have recently moved from Cloudbees to Atlassian Bamboo but we are now avoiding hosted CI systems all together. By dynamically allocating/spinning up new agents/slaves to perform the build, each slave had to download our Maven artifacts and other binaries (about 1.1 GB worth) and this added significant overhead to our build times.

We avoid this problem now by using a dedicated server for our CI server master and then for high work loads spin up AWS instances with EBS attached containing our Maven artifacts and binaries. We find this gives us the benefits of both worlds, great control over the CI systems as a dedicated system and the scalability and cost control of a Hosted solution. You can do this technique with Jenkins or Bamboo.

Alan

--
CEO and co-founder, Hindsight Software Ltd

Hindsight Software Ltd is a company registered in England and Wales. Registered number: 08051221. Registered office: 12-14 Bridge Street, Leatherhead, Surrey, United Kingdom, KT22 8BZ 


On 27 June[masked]:41, Wesley Hall <[address removed]> wrote:
Hey folks, 

Does anyone have any recommendations for hosted CI services? There seems to be a few out there. 

We are currently using Jenkins at cloudbees but are reaching the limits of the gratis setup and it seems to make sense to evaluate options before we upgrade.

I know my way around Jenkins but I am not too worried about using different software. The basic requirement is, "run a maven3 build", plus a few other bits which every CI server will support. 

For the smaller, 'start-upy' guys out there. What are you using? Anything you would put your name behind? ;)

Wes




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Wesley Hall ([address removed]) from LJC - London Java Community.
To learn more about Wesley Hall, visit his/her member profile
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]





--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Alan Parkinson ([address removed]) from LJC - London Java Community.
To learn more about Alan Parkinson, visit his/her member profile






--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Wesley Hall ([address removed]) from LJC - London Java Community.
To learn more about Wesley Hall, visit his/her member profile
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]

Our Sponsors

  • Our Blog

    Read the latest news from the LJC

  • RecWorks Ltd

    Fixing Tech Recruitment using the Power of Community

  • jClarity

    Java/JVM Performance Analysis Tools & mentoring for Java related matters

  • LJC Aggrity

    Our LJC Aggrity site contains blog posts from our members

  • LJC Book Club

    Our Book club with book reviews from our members

  • Devoxx UK

    Java Community Conference, in collaboration with the LJC 12/13 Jun 14

  • SkillsMatter

    "Host, help organise, promote, film many of our meetings."

  • Packt Publishing

    A publishing company specializing on specific technologies and solutions

  • Java.Net

    We are an official Java User Group recognised by Oracle's JUG program

  • JRebel

    Free 3 month J-Rebel license.

  • O'Reilly

    40% discount on printed books and 50% on e-books.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy