addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

EC2, Grid Computing, etc.

From: Matthew J.
Sent on: Friday, February 8, 2008 5:19 PM
Last nights Java meetup had a great presentation with a good deal of interest to Linux systems folks: Creating Grid-Based Data Infrastructures for the Enterprise. Cameron Purdy, Founder of Tangosol (absorbed into the Oracle nation state), was the speaker and he talked at length about the implementation.

A couple of really interesting points I thought I would share.

They use EC2 for prototyping and testing their platform. Spinning up 50 nodes on the fly is a great demonstration of EC2s applicability to testing and scaling problems.

They primarily use commodity platforms and tools Linux as the node os, Several open source projects for the communication middle layer (mule, spring, servicemix, Hibernate, javarules, etc), all part of a Organic Resilient Event Driven architecture, <breath>. In a nutshell using open source tools and ec2 we can play with the same tools that are solving problems like: credit risk analysis calculation, Foreign Exchange Market tracking, Protein Folding, etc.

For those of use who have hacked together a Beowulf cluster and played with clustering and parallel computing Grid is obviously attractive. Grid Administration/development is in demand and anyone with practical experience in this field learned hands on.

So, in short, Grid is coming true thanks to xen, linux, and commodity software, and I'm excited again about playing with ec2 to test some of the grid architectures, as well as playing with dynamically scaling datacenters in general.

I know some of us have mentioned using ec2 to test individual distro nodes and doing other exercises with it. Has anyone played at a large scale with it yet? Is there a problem domain that would fit the grid architecture?

I'm sure some of this will play out in our next end of month project meeting of which I will have another announcement at our next regular meeting Next Tues!

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy