Job Description
Day-to-Day:
* Design, develop and maintain high throughput, precise, ultra-low latency industry leading big data linking solutions
* Generate and own end-to-end solutions for loosely defined business problems by leveraging pattern detection over potentially large datasets
* Provide project management and technical leadership for every aspect of SDLC
* Coordinate and collaborate with technology and business stakeholders, including gathering and determining feasibility of customer requirements
* Recommend technical strategy, participate in evolution of architecture, design solutions, and build and integrate the implementation
* Lead, plan and implement core changes that impact enterprise-wide critical functions/processes.
* Work in iterative processes to perform advanced data analysis, validate findings or test hypotheses, and communicate results and methodology
* Communicate technical information successfully with technical and non-technical audiences such as third-party vendors, external customer technical departments, various levels of management and other relevant parties
* Collaborate effectively with all team members as well as hold regular team meetings
Summary:
A client of Insight Global is looking for a Principal Software/Data Engineer focused on Big Data Analytics to join their Linking Team. The linking team is responsible for linking billions of public and proprietary records to create a unique entity identifier for consumers, organizations and providers. We're looking for an experienced, smart, driven individual who will help us build and deliver enterprise-wide big data linking solutions by resolving complex analytical problems using quantitative approaches with a unique blend of analytical, mathematical and technical skills. This includes analyzing and linking large data problems using various statistical techniques, developing data models, implementing solutions, and providing support. This position provides assistance and input to management, develops and leads large multifunctional development activities, solves complex technical problems, writes complex code for computer systems, and serves as a senior source of expertise. The position may also provide sizing or budget recommendations to management. This role is intended to become a Tech Lead upon conversion working on big data cloud projects and it will be essential to have strong communication skills for success in that position. The ideal candidate will have 8+ years of data engineering experience with excellent Java and SQL skills, deploying applications into Azure interfacing with CosmosDB.
Required Skills & Experience
Must Haves:
* Bachelor or Master's degree in computer science, mathematics, statistics, or equivalent technical discipline
* 8+ years of data engineering experience working with big data analytics and numerous large data sets/data warehouses
* Ability to assemble, analyze, and evaluate big data and be able to make appropriate and well-reasoned recommendations to stakeholders
* Good analytical and problem solving skills, good understanding of different data structures, algorithms and their usage in solving business problems
* Experience with Search algorithms and/or preparing data for Search applications
* Ability to collaborate and lead internal and external technology resources in solving complex business needs
* Strong communication (verbal and written) and customer service skills. Strong interpersonal, communication, and presentation skills applicable to a wide audience including senior and executive management, customers, etc.
* Experience with Big data technologies,
* Knowledge of Data science and NLP
* Understanding of precision and recall in data science
* Experience with Data Mining
* Familiarity with clustering and linking of data
* Exposure Text Mining and Natural Language Processing (NLP)
* Expertise in development languages Java and SQL
* Experience with cloud technologies -- Azure, Databricks, Cosmos DB
* Deploying apps into Azure and interfacing with CosmoDB
Nice to Have Skills & Experience
* Experience with managing a team or ambition to do that would be an advantage
* Relevant industry experience: healthcare, insurance, finance, etc.
* Certifications in data science or analytics
* Python
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.