Job Description
Insight Global is looking for Senior Hadoop Developers to support Data and Analytics Platform, Information Management and Solution Delivery for one of our largest Financial clients in either Dallas TX, Charlotte NC, Pennington NJ, or New York. The role ensures design and engineering approach for complex data solutions is consistent across multiple flows and systems, while building processes to support data transformation, data structures, metadata, data quality controls, dependency and workload management. The individual will be responsible to define internal controls, identify gaps in data management standards adherence and work with appropriate partners to develop plans to close the same, lead concept and experimentation testing to synthesize the results and validate and improve the solution, document and communicate required information for deployment, maintenance, support, and business functionality. They may be required to mentor more junior Data Engineers and coach team members in delivery/release activities.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
HR@insightglobal.com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
* 3-6+ years experience in Hadoop stack and storage technologies (HDFS, MapReduce, Yarn, HIVE, Sqoop, Impala , spark, flume, Kafka and Oozie)
* 1-- 3+ years experience in Scala programming for Big Data
* Extensive Knowledge on Bigdata Enterprise architecture (Cloudera preferred)
* Experienced in HBase, RDBMS, SQL, ETL and data analysis
* Experience in No SQL Technologies (ex., Cassandra/ MongoDB, etc.)
* Experienced in scripting(Unix/Linux) and scheduling (Autosys)
* Experience with team delivery/release processes and cadence pertaining to code deployment and release
* Experience in Hive Tuning, Bucketing and Partitioning, debugging, tracing errors/exception in Spark job execution
* Knowledgeable in techniques for designing Hadoop based file layout, optimized for business
Nice to Have Skills & Experience
* Object-oriented programming and design experience
* Experience with automated testing methodologies and frameworks, including JUnit, is a plus
* Exposure to JAVA/Spring framework
* Fundamentals of Python -- Data Structures, Collections, Pandas for file and other type of data handling, visualizations etc.
* Visual Analytics Tools knowledge ( Tableau )
* Degree in Computer Science or equivalent
* Any Big Data certification(ex. Cloudera's CCP, CCA) is a plus
* Excellent analytical capabilities - Strong interest in algorithms. Research oriented, motivated, pro-active, self-starter with good interpersonal skills
* Experience with team delivery/release processes and cadence pertaining to code deployment and release
* A team player with good verbal and written skills, capable of working with a team of Architects, Developers, Business/Data Analysts, QA and client stakeholders
* Proficient understanding of distributed computing principles
* Python IDEs(Django, Flask), data wrangling and analytics in a python based environment
* Experience with Big Data Analytics & Business Intelligence and Industry standard tools integrated with Hadoop ecosystem. ( R , Python )
* Data Integration, Data Security on Hadoop ecosystem. ( Kerberos )
* Research oriented, motivated, pro-active, self-starter with strong technical, analytical and interpersonal skills
* Versatile resource with balanced development skills and business acumen to operate at a fast and accurate speed
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.