Hadoop-DC Message Board › SGI IS HIRING - BIG DATA ENGINEER - Bay Area
|A former member||
Big Data Engineer
SGI - Fremont, CA (San Francisco Bay Area)
Job DescriptionSGI is seeking for a Data Architect to join our Big Data Solutions Engineering team and contribute to design, implementation and benchmarking of a data management and analytics solution in support of SGI Fusion workflow. The job location is SGI Headquarters, Fremont, CA.The candidate must demonstrate a solid knowledge and proven track record for implementing an end-to-end modular, scalable data analytics workflow with the selection and use of a mix of leading, industry-standard and emerging technologies. The software platform will include co-processing of structured and unstructured data comprising of relational databases, Hadoop and various analytical BI software and tools on SGI scale-up and scale-out platforms.Responsibilities include:- Design and implement a Fusion workflow on SGI scale-out and scale-up platforms involving data ingestion, big data processing in Hadoop, ETL to a SQL data warehouse followed by predictive analytics and visualization.- Characterize performance and scalability of the workflow and size SGI hardware with an incremental ingestion rate. Design test cases to generate performance metrics.- Stay abreast of developments in the Big Data professional community with an eye to solving real-world business problems.- Work closely with Partners to integrate and test new software for the Fusion platform.
Desired Skills & Experience
Education and/or Equivalent Experience (including tech. and non-tech. capabilities):
Required Experience:- Around 5 years experience as a hands-on analytics architect, data architect or database architect involving implementations in the Terabyte and/ Petabyte range. - Skills in data management design, performance, data integration tools with a good understanding of scripting languages.- Strong SQL database skills and experience with NoSQL and MapReduce solutions. Experience with Oracle, Greenplum, Teradata, MySQL and similar technologies, is a plus.- Proven expertise in performance testing (load testing, benchmarking), CPU profiling, memory profiling, thread profiling, network profiling and database profiling.- Expertise in Sourcing, ETL technologies, Data Modeling, BI and Reporting and multiple tools to support these components. - Expertise in software development using Java, C/C++, SOAP, HTTP, TCP, HTML is a plus.- Linux kernel experience including basic administration, profiling and scripting for performance diagnosis is required.- Understanding the underlying principles of networking as related to fast data ingestion from heterogeneous sources and integration between Hadoop and SQL databases is highly preferable. - Prior experience in running custom enterprise applications or BI software suites with an emphasis on mission-critical robustness, performance and scalability is a plus. - Need to have good interpersonal skills to work with people from various organizations.- Occasional travel to Partner site(s) may be necessary.Education:BS/MS/Ph.D in Computer Science or related area from an accredited institution.
SGI JOB post ON LINKED IN