HBase Hackathon Message Board › JOBS: Big Data Architect/Mgr + SW Dev Engineer for internet/high tech Strate
|A former member||
Job Sheet Data Analytics Team: two jobs open: (1) Platform Architect/Manager/Big Data Ninja and (2) SW Dev Engr
Closely tied to Harvard Business School, with offices in Boston, SF, Chicago, NY and UAE, the firm is a boutique high tech/web centric strategy consulting firm with ~ 50 employees mostly from McKinsey, Bain and BCG. They specialize in developing data-driven business strategy for some of the leading firms in high tech. They are well established, fast growing, have minimal hierarchy and an entrepreneurial spirit. We seek the best/brightest to join the team – individuals who thrive on analytical problem solving and data driven analysis and are smart, ambitious and inquisitive.
This position is a unique blend of top tier big data platform architecture, strategy consulting, data driven analytics and economic consulting. Your work will heavily influence key strategic decisions at some of the largest tech companies in the world. You will build our firm’s software development capabilities to extract and analyze data at internet scale, driving insights for our clients that impact their most strategic business decisions.
Data is our kingdom, and we understand that intimate familiarity with data in its rawest form, and the skills to navigate the complex systems required to store and analyze it, are increasingly necessary to drive data driven business insight. Analysis is only as good as the data set, and many assumptions are made early in the data structures that are very difficult to unwind later – the more you understand the raw data and how to process it, the more flexible you are in the analyses you can design. Our challenge to operate navigate unstructured data, from engineering its extraction to statistical analysis of insights, and this requires a core technical team of creative, analytical software experts working with some of the most innovative data platforms.
“If you are looking for a career where your services will be in high demand, you should find something where you provide a scarce, complementary service to something that is getting ubiquitous and cheap. So what’s getting ubiquitous and cheap? Data. And what is complementary to data? Analysis.” – Hal Varian, Chief Economist at Google
This opportunity is a chance to work on the cutting edge of Big Data; the world’s largest web properties (Google, Facebook, Microsoft, Fox Interactive Media, etc.) each collect terabytes of data/day about their businesses, and their data management stacks have had to evolve beyond traditional data warehousing and business intelligence capabilities. All have constructed petabyte scale data storage and analysis platforms, including distributed file systems, parallel data processing capabilities, and specialized query languages.
We develop critical strategies and key business insights driven by these data platforms, and we engineer solutions to extract and analyze data in creative ways.
Design/Develop analysis system to extract meaning from large scale and unstructured data
Brainstorm programming approaches, rapidly implement prototypes
Devise creative testing mechanisms
Example assignment: brainstorm creative programming approaches that interpret internet search data and user behavior to create an analysis platform for critical project work. Rapidly build a simple prototype to test your approach. Proactively resolve issues with the team.
Assist econometric team in analyzing large data sets and giving statistical insight to their meaning
Strong programming skill in multiple languages, comfortable learning new ones quickly (ideally C#, C++ etc)
Passionate about quality
Ability to communicate proactively in a small team environment
Hard-working, fast and autonomous learner
With a lean outline and general direction in mind, can rapidly prototype, measure, and iterate
Experience with MapReduce programming a big plus (Hadoop, Twister, Greenplum, Cosmos, or similar)
Familiarity with NoSQL datbases (hBase, Cassandra, MongoDB, Couch DB) and unstructured data
Familiarity with Hive, Pig, Avro, Flume, Scribe
Data warehousing and business intelligence systems
Familiarity with “agile software development” methodologies
Cluster and grid computing
Startup experience; working with small teams in entrepreneurial environments
*Boston (ideal), San Francisco, Chicago or NY
* we will consider a remote candidate with superior track record
Mark DeWitt at Atherton Advisors is the contact person for this search. Please direct all inquiries to: MarkatAthertonAdvisorsdotcom (650)646-295five