Azure Databricks Developer Position

1 day ago


Princeton, New Jersey, United States Capgemini Full time

About Us

Capgemini is a global business and technology transformation partner, helping organizations accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. We have over 55 years of experience in delivering end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by our market leading capabilities in AI, cloud, and data, combined with our deep industry expertise and partner ecosystem.

Job Description

As a Cloud Data Architect, you will play a critical role in designing and implementing scalable cloud-based data solutions for our clients. You will be responsible for developing and maintaining data pipelines to read partner files from AWS S3, transform the data using Databricks, and assist in the migration from Snowflake to Azure Databricks.

Key Responsibilities

  • Design and implement scalable cloud-based data solutions.
  • Develop and manage data pipelines to read and process partner files from AWS S3 using Azure Databricks.
  • Implement transformations using Python and Spark to prepare data for loading into Snowflake and Azure Databricks.
  • Assist with the migration of data objects schema and databases from Snowflake to Azure Databricks.
  • Work with the Databricks Architect to ensure efficient design and implementation of data transformation and migration activities.
  • Perform unit testing and troubleshooting of data pipelines.
  • Ensure best practices are followed for coding security and data quality.

Requirements

  • 5+ years of experience in developing data pipelines with Azure Databricks, Spark, and Python.
  • Strong understanding of AWS S3, Snowflake, and data migration concepts.
  • Proficiency in SQL for data querying, transformation, and analysis.
  • Experience with unit testing, debugging, and troubleshooting data pipelines.
  • Good communication skills and ability to work in a collaborative team environment.

Why Join Capgemini?

Capgemini is a company that values diversity, equity, and inclusion. We believe in fostering a culture that allows every employee to reach their full potential. We offer flexible work arrangements, healthcare benefits, financial well-being programs, paid time off, and many more perks. Our employees enjoy working in a collaborative and inclusive environment where everyone feels valued and respected.



  • Princeton, New Jersey, United States Capgemini Full time

    Job OverviewAs a Databricks Engineer at Capgemini, you will play a crucial role in developing and maintaining data pipelines to read partner files from AWS S3. Your primary focus will be on transforming data using Azure Databricks and assisting in the migration from Snowflake to Azure Databricks.The ideal candidate will have experience in developing data...


  • Princeton, New Jersey, United States Capgemini Full time

    About the RoleThis position requires working closely with the Databricks Architect to ensure the successful implementation of data solutions. Key responsibilities include developing and managing data pipelines to read and process partner files from AWS S3 using Azure Databricks. Implementing transformations using Python and Spark to prepare data for loading...


  • Princeton, New Jersey, United States Azure Consulting Services Full time

    Azure Consulting Services is a leading provider of expert consulting services for businesses looking to leverage machine learning and AI. We are seeking a skilled Python Java Developer to join our team and help drive innovation in the field.The successful candidate will have a strong background in Python and Java, with experience in data modeling, machine...


  • Princeton, New Jersey, United States Inficare Full time

    Job Summary: We are looking for a seasoned Azure Cloud Architect to lead our enterprise cloud solutions efforts in Princeton, NJ. As a key member of our team, you will design and implement scalable, secure, and efficient cloud architectures that meet the evolving needs of our clients.Main Responsibilities: The successful candidate will have hands-on...


  • Princeton, New Jersey, United States Azure Consulting Services Full time

    We are seeking a highly skilled Full Stack Developer with expertise in both Python and Java to join our team at Azure Consulting Services. The ideal candidate will have extensive experience in developing scalable and efficient software solutions using these technologies.In this role, you will be responsible for designing, implementing, and maintaining...

  • Azure Engineer Lead

    3 weeks ago


    Princeton, New Jersey, United States Vertex Solutions Inc. Full time

    Job Overview:We are looking for a seasoned technical leader to join our team as a Lead Cloud Engineer. The successful candidate will be responsible for overseeing the design, implementation, and maintenance of our cloud infrastructure on the Microsoft Azure platform.Main Responsibilities:Design, implement, and maintain our cloud infrastructure on the...


  • Princeton, New Jersey, United States Azure Consulting Services Full time

    Job Type: ContractWe are seeking a highly skilled Python Java Developer to join our team at Azure Consulting Services. The ideal candidate will have extensive experience in Python and Java, with a strong focus on machine learning and data modeling.The successful candidate will work on back-end development, utilizing their expertise in RESTful application...


  • Princeton, New Jersey, United States Inficare Full time

    Job Title: Azure Cloud Architecture SpecialistAbout Inficare: As a leading provider of innovative solutions, Inficare seeks an experienced Senior Cloud Architect to drive the implementation of our cloud strategy. This role will play a crucial part in shaping our cloud infrastructure and ensuring seamless integration with existing systems.Estimated Salary:...


  • Princeton, New Jersey, United States Azure Consulting Services Full time

    At Azure Consulting Services, we are committed to delivering exceptional results for our clients through innovative solutions and cutting-edge technology. We are now seeking a seasoned Python Java Developer to join our team and take on key responsibilities in machine learning and data modeling.The ideal candidate will have extensive experience in Python and...


  • Princeton, New Jersey, United States Vertex Solutions Inc. Full time

    Job Description:We are seeking an experienced Azure Cloud Engineer to lead our cloud engineering team at Vertex Solutions Inc. in Princeton, NJ. The ideal candidate will have a strong background in Azure cloud technologies and extensive experience in building CI/CD pipelines.About the Company:Vertex Solutions Inc. is a technology company that provides...


  • Princeton, New Jersey, United States Cloud Security Services Full time

    Job OverviewWe are seeking a skilled Azure Stack HCI Automation Specialist to join our team at Cloud Security Services.The successful candidate will have expertise in implementing large-scale Azure Stack HCI deployments, configuring and scripting environment settings, virtual networking, and PowerShell automation. Experience with hybrid infrastructure,...


  • Princeton, New Jersey, United States Cloud Security Services Full time

    Job Title: Cloud Automation Engineer - HCI ExpertAt Cloud Security Services, we have a long-term project that requires a skilled Automation Engineer to work with Azure Stack HCI. The successful candidate will have hands-on experience with Azure Stack HCI, including implementing large deployments, configuring and scripting the environment, and understanding...


  • Princeton, New Jersey, United States Derex Technologies Full time

    At Derex Technologies, we are seeking a highly experienced Sr. NET Developer to lead the development of our Energy Billing System in Princeton, NJ or remotely. The ideal candidate will have 12+ years of experience with MS ASP.NET Applications using MVC5 and SQL Server.This position offers a competitive salary of approximately $145,000 per year, considering...


  • Princeton, New Jersey, United States Diverse Lynx Full time

    Job Title: Senior Java Developer PositionLocation: Princeton, NJJob Type: ContractWe are seeking a skilled Senior Java Developer to join our team at Diverse Lynx LLC. As a key member of our development team, you will be responsible for designing, developing, and implementing scalable and efficient software solutions using Java as the primary programming...


  • Princeton, New Jersey, United States S&P Global Full time

    About the Role:S&P Global Ratings seeks a highly experienced Software Engineering Director to lead our data services group. This team builds and manages enterprise data stores, data services, data analytics, and BI products that support global ratings business across 90+ economies.The ideal candidate will have broad knowledge of Ratings organization's data...


  • Princeton, New Jersey, United States S&P Global Full time

    About the Role:We are seeking a highly skilled and experienced Director of Full Stack Engineering/Architecture to join our team at S&P Global Ratings.The successful candidate will be responsible for leading the analysis, architecture, design, development, and support of enterprise data management systems. As a servant leader, you will support global agile...


  • Princeton, New Jersey, United States Diverse Lynx Full time

    About the RoleWe are seeking a highly skilled Java Developer to join our team at Diverse Lynx LLC in Princeton, NJ. As a key member of our software development team, you will be responsible for designing and developing high-quality software applications using Java and related technologies. Our ideal candidate will have a strong background in Java and...


  • Princeton, New Jersey, United States Munich Re Full time

    Munich Re America Services, Inc. is seeking a highly skilled Senior Enterprise Solution Developer to join our team in Princeton, New Jersey.About the JobThis role involves developing complex programs and scripts using agreed specifications and standards. You will design, code, test, correct, and document enterprise-wide scalable operations on Cloud...


  • Princeton, New Jersey, United States Diverse Lynx Full time

    About the Role: We are looking for a highly skilled Full-Stack Java Developer to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in Java development and be able to design, develop, and deploy scalable software systems.Responsibilities:Design, develop, and deploy software systems using Java.Collaborate with...


  • Princeton, New Jersey, United States Syntricate Technologies Full time

    Job Title: Java Backend Developer with ReactJS ExpertiseAbout Syntricate Technologies:Syntricate Technologies is a renowned technology firm that provides cutting-edge solutions to its clients. We are seeking a skilled Java Backend Developer with expertise in ReactJS to join our team.Estimated Salary: $125,000 per yearJob Responsibilities:We are looking for a...