Job Search Results for Big Data

? Design and maintain the overall data platform architecture integrating Snowflake, AtScale, and dbt components? Establish data quality frameworks and monitoring systems? Define platform scalability... More and performance optimization strategies? Design and implement Snowflake warehouse configurations and resource management policies? Manage user access controls, roles, and security policies within Snowflake? Optimize query performance through warehouse sizing, clustering, and partitioning strategies? Implement data sharing and collaboration features across business units? Monitor and control Snowflake costs through usage optimization and resource scheduling? Design and maintain data pipeline architectures for ingestion and transformation? Establish connection protocols between AtScale and various BI tools (Tableau, Power BI, etc.)? Optimize query performance through aggregate tables and caching strategies? Manage AtScale cluster configurations and scaling policies? Implement security models that align with organizational data access requirements dbt Development & Operations? Design and maintain dbt project structures and development workflows? Create and enforce dbt coding standards and documentation requirements? Implement dbt testing frameworks for data quality validation? Manage dbt deployment pipelines and environment promotion processes? Design modular dbt models that support reusability and maintainability? Establish version control and collaboration practices for dbt development teams Integration & Data Flow Management? Design end-to-end data pipelines connecting source systems to Snowflake via dbt transformations? Implement data lineage tracking across all three platforms? Create monitoring and alerting systems for data pipeline health and performance? Establish disaster recovery and backup procedures for the integrated platform? Design API integrations and data exchange protocols between platforms Team Leadership & Collaboration? Mentor and train data engineers and analysts on platform best practices? Collaborate with data science teams to support ML/AI workload requirements? Coordinate with DevOps teams on infrastructure automation and deployment practices? Lead architectural review sessions and technical decision-making processes Performance & Cost Optimization? Monitor and optimize compute resource utilization across all platforms? Implement cost allocation and chargeback models for different business units? Analyze query patterns and usage metrics to identify optimization opportunities? Design and implement automated scaling policies based on workload demands? Establish SLA monitoring and reporting for platform availability and performance Security & Compliance? Implement data encryption, masking, and anonymization policies? Ensure compliance with regulatory requirements (GDPR, HIPAA, SOX, etc.)? Design and maintain audit trails and data access logging? Coordinate security assessments and vulnerability management? Establish data classification and handling procedures across all platformsPay Rate: $16.00-$22.00 depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Senior Data Engineer to support one of our financial services clients in Nashville, TN. This individual will join a growing data team focused on building and... More optimizing data pipelines, transforming data for analytics, and ensuring high-quality, reliable data is available for business intelligence initiatives. This is a hands-on role ideal for someone who enjoys working with modern data tools and collaborating across technical and business teams.Responsibilities:? Design, build, and maintain scalable data pipelines to ingest data from multiple sources? Develop and optimize data transformation models using dbt? Ensure data quality, accuracy, and reliability through testing and monitoring? Implement best practices for data modeling and warehouse performance? Partner with analysts, engineers, and business stakeholders to understand data needsContribute to internal processes, documentation, and overall data engineering best practicesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to support the collection, storage, processing, and analysis of large-scale data sets. This individual will play a key role in designing and maintaining... More scalable data solutions that enable efficient, reliable, and accurate data-driven decision-making across the organization.Key Responsibilities:Partner with business and technology stakeholders to understand current and future data requirements and translate them into scalable solutions.Design, build, and maintain robust data infrastructure to support data ingestion, storage, transformation, and analytics.Develop and optimize scalable data pipelines, data models, and workflows that ensure reliable and efficient movement of data across systems.Design, implement, and support enterprise data platforms, including data warehouses, data lakes, and lakehouse architectures, for both structured and unstructured data.Create and maintain data engineering tools, scripts, and automation solutions to streamline processes and improve operational efficiency.Monitor and optimize the performance, scalability, and reliability of data systems, proactively identifying opportunities for improvement.Ensure data quality, integrity, security, and governance standards are maintained across all data environments.Collaborate with cross-functional teams to support reporting, analytics, machine learning, and other data-driven initiatives.This role requires a strong understanding of modern data architecture, ETL/ELT processes, cloud-based data platforms, and best practices in data engineering.$65/hr to $78/hr Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401K retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

This candidate will be responsible for providing data analytics, reporting, and actionable insights that drive operational efficiency and business performance. The desired individual will partner... More with stakeholders to gather requirements, develop reports, analyze trends, and identify opportunities for process improvement and optimization. They will support strategic decision-making through ongoing reporting, ad hoc analysis, and system audits to ensure data accuracy and uncover new analytical opportunities. Additionally, they maintain compliance with all quality system requirements, demonstrating a strong commitment to patient safety, product quality, and regulatory standards.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The ideal candidate will have extensive experience in data warehouse concepts, streaming data processing, Azure cloud services, Snowflake, and SQL. This role will be responsible for designing,... More building, and optimizing data pipelines, ensuring efficient data management and accessibility to support business intelligence and analytics. Design, develop, and maintain data pipelines and ETL processes for structured and unstructured data.- Implement and optimize data warehouse solutions using Snowflake and Azure technologies.- Work with real-time data streaming technologies such as Apache Kafka, Azure Event Hubs, or similar.- Develop and optimize SQL queries for data transformation, aggregation, and analysis.- Ensure data integrity, security, and governance by implementing best practices.- Collaborate with cross-functional teams to understand data needs and deliver efficient solutions.- Monitor, troubleshoot, and improve performance of existing data pipelines and systems.- Stay up to date with industry trends and emerging technologies in data engineering.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Engineer to support one of our financial services clients in Nashville, TN. This individual will join a growing data team focused on building and optimizing... More data pipelines, transforming data for analytics, and ensuring high-quality, reliable data supports business intelligence efforts. This is a hands-on role ideal for someone who enjoys working with modern data tools and collaborating across both technical and business teams.The team is looking for someone who can work onsite Monday through Thursday, with remote flexibility on Fridays.Responsibilities:? Design, build, and maintain scalable data pipelines to ingest data from multiple sources? Develop and optimize data transformation models using dbt? Ensure data quality, accuracy, and reliability through testing and monitoring? Implement best practices for data modeling and warehouse performance? Partner with analysts, engineers, and business stakeholders to understand data needs ? Contribute to internal processes, documentation, and overall data engineering best practicesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Scientist support an established banking client out of Chicago, IL. This individual needs hands-on experience using advanced analytical algorithms and technologies... More (e.g., machine learning, deep learning, artificial intelligence) to mine and analyze large sets of structured and unstructured data to obtain insights. They will be responsible for designing and constructing new processes for modeling data, as well as, developing predictive models and leveraging big data technology to design solutions that deliver smarter business decisions, improve customer experience, and drive productivity. They will collaborate with other data and analytics professionals and teams to optimize, refine, and scale analysis into mature analytics solutions. Day to Day:Plays an active role in the futuristic display of data and advancement of innovative data strategies to understand consumer trends and address business problems.Uses data mining and extracts usable data from valuable data sources to assess the feasibility of AI/ML solutions for improved processing and usage of organizational data.Conducts large-scale analysis of information to discover patterns and trends by combining different modules and algorithms.Uses analysis to provide recommendations and advice for business leaders to maintain market competitiveness.Develops prediction systems and machine learning algorithms. Investigates additional technologies and tools for developing innovative data solutions for business stakeholders.Collaborates with the product team and partners to support data-driven decision-making, business planning, and future roadmaps.Focuses primarily on a specific business/group, with the potential for broader enterprise-wide impact.Exercises judgment to identify, diagnose, and solve problems within established guidelines.Works independently on a range of complex tasks, including unique or non-routine situations.Assumes additional responsibilities as needed.Protects the bank from risk by applying the Risk Management Framework, Risk Culture principles, and approved Risk Appetite. Makes sound, risk-informed decisions that align with business strategy, protect assets, and comply with applicable policies, standards, procedures, laws, and regulations.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Reporting to the VP of Enterprise Data & Analytics, this Director of Data Engineering will lead the data engineering function while helping define and execute the organization's long-term data... More roadmap. The role is focused on scaling cloud-based data platforms, modernizing data infrastructure, supporting AI initiatives, and ensuring the organization has reliable, accessible data for reporting, analytics, and business decision making. They will manage a team of around 10-11 with one manager, with opportunity to grow dependent on roadmap and needs. Daily responsibilities include:Lead the Data Engineering function, overseeing enterprise data platforms, pipelines, and cloud-based data architectureHelp define, develop and execute the teams data roadmap and long-term strategyCollaborate with BI and analytics leaders to improve data quality, reporting capabilities, and enterprise data modelsDrive cloud data strategy and modernization efforts across Azure, Microsoft Fabric, enterprise data warehouses, and data pipeline architecture.Lead and mentor engineering managers and technical teams while helping grow the data organizationSupport and scale AI-enabled data initiatives, including AI-assisted ETL, data ingestion, and automationWork cross-functionally with business and technical stakeholders, translating business needs into data solutionsManage priorities, projects, budgets, and team development while fostering a mission-driven cultureWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking 5 Data Engineers to support a large-scale application integration initiative focused on physician and provider-facing systems. This team will be responsible for designing and building... More data infrastructure, developing integrations, and ensuring seamless data flow across multiple applications and platforms. The engineers will work closely with business and technical stakeholders to streamline data processes, improve data quality, and support system consolidation efforts. Responsibilities include data pipeline development, ETL processes, data modeling, and optimizing data movement between systems.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

oThe Data Architect leads secure, scalable data architecture for enterprise security platforms in classified, enclave-based environments. The role designs data pipelines, storage, and governance to... More support large-scale security analytics while ensuring compliance and data integrity. The ideal candidate translates complex TS/SCI security requirements into resilient, compliant data architectures.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less