Job Search Results for big data

Insight Global is seeking a skilled and motivated Big Data Engineer to join our clients GenAI applications team based out of India. This role is part of a strategic initiative to migrate their data... More infrastructure from on-premise to Google Cloud Platform (GCP). You will work closely with a high-performing team of engineers and leaders to build scalable data solutions and support cloud-native application development. Key Responsibilities:Design, develop, and maintain scalable big data pipelines and applications.Collaborate with cross-functional teams to support the migration from on-prem to GCP.Contribute to the development of GenAI-powered applications and services.Participate in whiteboarding sessions and technical discussions to solve complex problems.Ensure high performance, reliability, and scalability of data systems.Work closely with senior engineers and leadership to align with project goals.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for a Backend Java Developer to join one of the world's leading online payment platform companies based in San Jose, CA. This is a compliance platform team, who is... More responsible for overseeing and coordinating responses to global regulatory changes that impact the company. This team tracks evolving regulations across jurisdictions, assess business and technology impacts and drive timely implementation to ensure compliance.This team enables he company to stay ahead of regulatory developments and maintain operation readiness in a rapidly changing global environment.Youll be part of a dynamic and evolving landscape, where you can apply your expertise and make meaningful contributions to our platform, leveraging AI/ML solutions to drive greater efficiency. Primary Job Responsibilities Develop and maintain a robust and scalable big data insights platform to drive AI-assisted process automation and deliver actionable insights. Develop solutions that combine state-of-the-art Generative AI techniques with rich data to deliver best-in-class automation and user experience. Design and implement batch and near real-time data pipelines using Spark, Flink, and BigQuery. Design and implement efficient data models in relational and NoSQL databases like Oracle and BigQuery. Leverage cloud-native technologies to build world-class backend platforms. Work closely with cross-functional teams and other stakeholders to deliver features. Lead feature or component design reviews and is fully recognized as the go-to developer for that component. Participate in architecture discussions and propose and discuss solutions to platform and product changes. Stay current with emerging technologies and promote a culture of excellencePay rate: $10 USD/hrWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

A client of Insight Global is looking for a Senior Data Scientist to join their team. This individual will participate in all phases of the data and analytics lifecycle, including specifying data... More capture requirements, analyzing patterns and trends in structured and unstructured data to provide insights on projects that span all facets of the Enterprise. Take these finding and synthesize them into dashboards or presentations that convey insights and recommendations through storytelling, while maintaining a balance between the big picture and mastery of details.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Day to Day Insight Global is seeking a Data Engineer to join one of a Retail Client in Vancouver BC. This Data Engineer will sit within the People Enablement Technology team which is committed to... More enabling seamless experiences for their global workforce. The Data & Analytics Pillar is a newly formed team, focused on automating our core health & wealth offerings as well as work across the department to enable efforts driven by the People Systems, Digital Workplace & Learning, and Workforce Agility pillars. The project the successful candidate will join is bringing the learning data from various platforms such as LI learning into an existing data lake. This will allow for analytics insights to be generated from this people data for various teams such as the ESG team. The data engineer will support using data bricks for this ingestion, and use unity catalog for its categorization and potential encryption if required.A successful candidate will be a problem solver and an expert in ETL programming/scripting, data modelling, data integration, SQL and have exemplary communication skills. The candidate will need to be comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. The candidate will know, and love working with new technologies, can model multidimensional datasets, and can partner with cross functional business teams to answer key business questions. Apart from building data pipelines, you will be an advocate for automation, performance tuning and cost optimization. Be ready to question the status quo and bring forth intelligent solutions and proof of concepts.Principal Duties and Responsibilities: Support the design and implementation of complex data integration, modeling, and orchestration workflows using tools such as Databricks, Azure Data Factory, and SnowflakeCollaborate with architects, engineers, analysts, and business stakeholders to deliver secure, reliable, and high-performing data solutionsApply DevSecOps principles to ensure secure development, deployment, and monitoring of data pipelines and infrastructureImplement and maintain data encryption, access controls, and governance using Databricks Unity Catalog to protect sensitive informationParticipate in operational support, including troubleshooting, performance tuning, and continuous improvement of data workflowsCreate and maintain technical documentation and contribute to knowledge-sharing across the teamWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An employer is looking for a Sr. Data Engineer in the Seattle, WA area. This entertainment company is looking for a Sr. Data Engineer to join their consumer business division. They are dealing with... More large amounts of television and digital data around their customers. This person will be responsible for their Data Warehouse as they evolve into a more cloud based environment. Someone with AWS and Snowflake experience would be a standout candidate. However, if you have an expertise in Python for developing ETL pipelines, data warehousing, and some cloud experience, this could be a fit for you. This group is looking for a team player who's interested in learning new technologies in an evolving organization. If this sounds like you, please apply today!We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

What you will do We are looking for an astute, determined professional to fulfil a Data Architect role within our Technology Solutions Group. You will showcase your success in a fast-paced... More environment through collaboration, ownership and innovation. Your expertise in emerging trends and practices will evoke stimulating discussions around optimization and change to help keep our competitive edge. This rewarding opportunity will enable you to make a big impact in our organization, so if this sounds exciting, then PGIM might be the place. What you can expect A key contributor of PGIM Fixed Income Data Strategy, transforming and modernizing our data environment and landscapeDevelop data models that represent the structure and relationships of data within the organizationImplement data governance initiatives, including data catalog, data quality framework, and data lineageMonitor and optimize data systems for performance, ensuring that data is processed and access efficientlyEstablish and enforce data best practices through comprehensive, documented guidelines and a transparent review processWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global's client seeking Senior Data Analyst to join their integration team. This person will be collaborating with 3rd party vendors to collect and validate data coming through that it is... More able to be consumed. They should have strong capabilities writing SQL queries and be able to analyze large amounts of data. This role requires a self-starter who takes initiative in identifying both problems and opportunities for improvement. The ideal candidate proactively engages in conversations to surface issues, collaborates on solutions, and drives progress without needing to be prompted by others.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Job Description: Lead complex technology initiatives including those that are companywide with broad impact. Act as a key participant in developing standards and companywide best practices for... More engineering complex and large scale technology solutions for technology engineering disciplines. Design, code, test, debug, and document for projects and programs. Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors. Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives. Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals. Lead projects, teams, or serve as a peer mentor. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Day to Day:We are seeking a qualified candidate for the role of QA Engineer, who will be responsible for developing and executing automated test scripts in a big data environment. The Senior Data... More Quality Engineer will support the development of secure, scalable data integration and analytics solutions within the People Enablement Technology team. This role focuses on validating data pipelines built using Databricks, Azure Data Factory, Snowflake, and related technologies. The ideal candidate will have a strong background in ETL testing, data validation, and automation, with a deep understanding of data governance, encryption, and automation practices.You will collaborate closely with data engineers, architects, analysts, and business stakeholders to ensure that data solutions meet business requirements and maintain high standards of quality and compliance. This role focuses on validating data pipelines built using Databricks, Azure Data Factory, Snowflake, and related technologies. The ideal candidate will have a strong background in ETL testing, data validation, and automation, with a deep understanding of data governance, encryption, and DevSecOps practices.You will collaborate closely with data engineers, architects, analysts, and business stakeholders to ensure that data solutions meet business requirements and maintain high standards of quality and compliance.Principal Duties and Responsibilities:Design and implement test strategies for complex data pipelines and workflows using Databricks, Azure Data Factory, and SnowflakeDevelop and maintain automated test suites for data validation, transformation logic, and data quality checks using Python, SQL, and PySparkCollaborate with cross-functional teams to define test cases, acceptance criteria, and quality benchmarksPerform root cause analysis and support troubleshooting of data issues in production and non-production environmentsMaintain detailed test documentation, prepare test data sets, and contribute to knowledge sharing across the QA and engineering teamsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Our client is looking for a Senior Data Engineer to join their team in India. Responsibilities are shown below:Collaborate with business stakeholders and other technical team members to acquire and... More migrate data sources that are most relevant to business needs and goals.Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options.Determine solutions that are best suited to develop a pipeline for a particular data source.Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development.Efficient in ETL/ELT development using Azure cloud services and Snowflake, Testing and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance).Work with modern data platforms including Snowflake to develop, test, and operationalize data pipelines for scalable analytics delivery.Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders.Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability).Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.Build cross-platform data strategy to aggregate multiple sources and process development datasets.Proactive in stakeholder communication, mentor/guide junior resources by doing regular KT/reverse KT and help them in identifying production bugs/issues if needed and provide resolution recommendation.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less