Senior Data Engineer for Big Data and Cloud Platforms

3 days ago


Boston, Massachusetts, United States KYYBA Full time
Job Title: Senior Data Engineer for Big Data and Cloud Platforms

We are seeking a highly skilled Senior Data Engineer to join our team at Kyyba.

This role is focused on designing, building, and maintaining large-scale data engineering pipelines using Databricks and AWS services. The ideal candidate will have a strong background in cloud-based big data technologies, including Databricks, Airflow, IBM StreamSets, and AWS services such as S3, EC2, RDS, Kinesis/Kafka, and Lambda.

About the Role:
  • Design, build, and maintain scalable data engineering pipelines using Databricks and AWS services.
  • Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  • Develop and implement ETL processes, data transformations, and data quality checks using Python, Scala, and SQL.
  • Migrate data from on-prem Hadoop to Databricks/AWS.
  • Work closely with data scientists to develop machine learning models and deploy them to production environments.
  • Ensure high-quality data integration, transformation, and analytics services are delivered to end-users.
Requirements:
  • 4+ years of experience with Databricks, Airflow, IBM StreamSets, and AWS services.
  • Strong programming skills in Python, Scala, and SQL.
  • Experience with data migration, ETL processes, and data quality checks.
  • Knowledge of cloud architecture, security, and compliance.
  • Excellent communication and collaboration skills.
Salary Range:

$120,000 - $180,000 per year, depending on experience.

Benefits:
  • Comprehensive health insurance.
  • Retirement plan.
  • Flexible work arrangements.
  • Professional development opportunities.
About Kyyba:

Kyyba is a leading provider of IT staffing and recruitment services. We are proud to offer a dynamic work environment, competitive salaries, and comprehensive benefits.


  • Senior Data Engineer

    4 weeks ago


    Boston, Massachusetts, United States Saxon Global Full time

    Job Title: Senior Data Engineer - Cloud ExpertJob Description:We are seeking a highly skilled Senior Data Engineer with expertise in cloud technologies to join our team at Saxon Global. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and...


  • Boston, Massachusetts, United States Fidelity Investments Full time

    Fidelity Investments is a leading financial services company with a mission to strengthen the financial well-being of our clients.We are seeking a skilled Cloud Engineer for Data Analytics to join our Advanced Strategies & Research Technology Team. This role will be responsible for designing, developing, and implementing scalable data analytics solutions on...


  • Boston, Massachusetts, United States Horizontal Talent Full time

    We are seeking an experienced Cloud Infrastructure Architect to lead the design and implementation of data platforms on cloud infrastructure. This role involves translating functional requirements into technical specifications, developing optimized solution designs, and collaborating with cross-functional teams to resolve technical issues.The ideal candidate...

  • Senior Data Architect

    4 weeks ago


    Boston, Massachusetts, United States Blue Cross Blue Shield of Massachusetts Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Blue Cross Blue Shield of Massachusetts.Key ResponsibilitiesLead the implementation of data and analytics solutions to meet business needs.Design and deliver data engineering solutions, including ETL/ELT pipelines on multi-terabyte SQL/NoSQL databases.Collaborate with...


  • Boston, Massachusetts, United States CODAMETRIX Full time

    Data Engineering Position at CodametrixCodametrix is a leading company in revenue cycle management, revolutionizing the industry with its AI-powered solutions. We are seeking a highly skilled Senior Data Engineer to join our Data & Analytics team. The ideal candidate will be responsible for designing and maintaining robust data architectures, managing data...

  • Senior Data Architect

    4 weeks ago


    Boston, Massachusetts, United States ICS Global Soft INC Full time

    Job Title: Senior Data Architect",">About the Company:",">ICS Global Soft INC is a forward-thinking company that specializes in data-driven solutions.",">Salary Range:",">$120,000 - $180,000 per year",">About the Job:",">We are seeking an experienced Senior Data Architect to lead our data engineering team and design scalable data...


  • Boston, Massachusetts, United States CODAMETRIX Full time

    About UsCodaMetrix is a pioneering company in Revenue Cycle Management, leveraging AI-powered autonomous coding to transform clinical information into accurate medical codes. Our multi-specialty AI-platform enables efficient data processing under fee-for-service and value-based care models, while supporting improved patient care.We are passionate about...

  • Data Architect Expert

    4 weeks ago


    Boston, Massachusetts, United States Slalom Full time

    Job Description:Data Architect ExpertAbout the Role:At Slalom, we're seeking a highly skilled Data Architect Expert to join our team. In this role, you'll design and develop multi-phased cloud data strategies, including implementation roadmaps and technology roadmaps based on business needs. You'll also serve as a subject matter expert in a cloud platform...


  • Boston, Massachusetts, United States Compunnel Full time

    Job Summary:The Senior Data Engineer at Compunnel will create and maintain an optimal data pipeline architecture, managing large, complex data sets to meet business requirements. The role involves working with stakeholders to address data-related technical needs, optimizing infrastructure for scalability, and supporting data and analytics teams. The engineer...


  • Boston, Massachusetts, United States PA Consulting Full time

    Drive Innovation in HealthcareWe are seeking a highly skilled Clinical Data Registry Engineer to join our dynamic team at PA Consulting.In this role, you will have the opportunity to harness the power of data to drive advancements in healthcare. As a key member of our team, you will be responsible for designing, building, and maintaining a clinical data...


  • Boston, Massachusetts, United States Kunai Full time

    Job OverviewWe are seeking an experienced Cloud Data Solutions Architect to join our team at Kunai, a fast-growing digital consultancy focused on banking, payments, and fintech.This is a hybrid position with onsite work three days a week in either Northern Virginia or Boston. Our ideal candidate is a technical problem-solver with a strong background in data...


  • Boston, Massachusetts, United States Capital One Full time

    Transformative Cloud Platform Leadership OpportunityCapital One is revolutionizing the financial services industry through AI and machine learning, creating personalized experiences for customers.About the Role:Lead and optimize Machine Learning & Artificial Intelligence platform operations, reporting to the Senior Vice President, Head of Machine Learning...


  • Boston, Massachusetts, United States ICS Global Soft INC Full time

    Company Overview:We are ICS Global Soft INC, a leading company in the field of data engineering. We specialize in managing complex data systems and developing innovative solutions to drive business growth.Estimated Salary: $120,000 - $180,000 per yearJob Description:As a Senior Data Engineer at ICS Global Soft INC, you will be responsible for designing and...

  • Data Engineer

    4 weeks ago


    Boston, Massachusetts, United States NTT DATA Group Corporation Full time

    Job Summary:We are seeking a highly skilled Data Engineer - Pipeline Architect to join our team. In this role, you will be responsible for designing and implementing optimal data pipeline architecture, assembling large and complex data sets, and identifying opportunities for process improvements.Key Responsibilities:Create and maintain data pipeline...


  • Boston, Massachusetts, United States KYYBA Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team in Farmington Hills, MI. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Databricks and various AWS services.The ideal candidate will have a strong background in data...


  • Boston, Massachusetts, United States PA Consulting Full time

    Unlock Your Potential as a Senior Full Stack EngineerWe are seeking an experienced Senior Full Stack Engineer to join our dynamic team and contribute to the development of cutting-edge healthcare data platforms.In this role, you will have the opportunity to work with a dedicated team of collaborators and customers to build and grow a clinical data registry...


  • Boston, Massachusetts, United States TetraScience Full time

    Job SummaryTetraScience is the Scientific Data and AI Cloud company with a mission to radically improve and extend human life. Our team is seeking a talented Senior Software Engineer to develop and maintain high-quality software solutions that enable scientists and researchers to leverage and analyze complex datasets.About TetraScienceWe combine the world's...


  • Boston, Massachusetts, United States Insource Services, Inc. Full time

    Role OverviewWe are seeking a highly skilled Data Engineer to join our team at Insource Services, Inc. This individual will play a crucial role in designing and implementing data architectures that meet the specific needs of our clients in the clinical research and healthcare sectors.About the JobAs a Data Engineer, you will be responsible for building and...


  • Boston, Massachusetts, United States Rose International Full time

    At Rose International, we are seeking an experienced Data Engineer to join our team in Boston, MA. This role is a fantastic opportunity to work with cutting-edge technology and contribute to the success of our organization.As a Data Engineer, you will be responsible for designing, developing, and maintaining complex Snowflake data warehouses, including data...


  • Boston, Massachusetts, United States Forward Financing Full time

    Job DescriptionWe are looking for a talented Cloud-Based Data Warehouse Engineer to join our team. In this role, you will collaborate with Data Engineering team on the deployment of variables that feed production predictive models. You will also ensure code quality by reviewing analyst's pull requests and ensuring adherence to internal standards for style,...