Data Engineer/ Data Integration Engineer

1 week ago


Pleasanton, United States Data Piper Full time
Job DescriptionJob DescriptionCompany Description

Data Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of finding the next perfect fit for your team.

Job Description


About the role:

We are seeking a highly skilled Solutions Architect/Sr Data Engineer with a strong background in the Azure and Databricks ecosystem, along with a solid understanding of data extraction from Microsoft D365 applications. Additionally, if the candidate has awareness of F&O module of D365 and their tables it will be great.

Note: Need someone who has experience in creating pipeline to extract data from Dynamics 365 (D365) and then store in Databricks not in Azure Data factory

Key Responsibilities:

  • Design and implement scalable data architectures within the Azure and Databricks environment, focusing on high performance and efficiency.
  • Utilize Azure tools and services to build and maintain robust data pipelines.
  • Implement Databricks for data processing, transformation, and analytics, ensuring that solutions are scalable and aligned with industry best practices.
  • Develop solutions for extracting and transforming data from Microsoft D365 applications
  • Knowledge of the F&O module within D365 to map out data structures, understand table relationships, and optimize data retrieval processes is nice to have.
Qualifications

Note: Need someone who has experience in creating pipeline to extract data from Dynamics 365 (D365) and then store in Databricks not in Azure Data factory



Additional Information

All your information will be kept confidential according to EEO guidelines.


  • Sr. Data Engineer

    3 months ago


    Pleasanton, United States Talent Connection Full time

    Job DescriptionJob DescriptionCompany DescriptionJoin Our Client's Team as a Sr. Data Engineer!At Talent Connection, we excel at matching exceptional talent with leading employers. We are currently seeking a Sr. Data Engineer to join our prestigious client’s team and help drive their innovative data solutions.About Our Client: Our client is a leading...

  • Data Engineer

    4 weeks ago


    Pleasanton, United States Usage AI Full time

    Note:No Recruiters Please.Must be in office 5 days / week.Minimum 3+ years of experience.Must come onsite for interview.ResponsibilitiesDesign and develop aggregation data pipelines, data models etc.Write great quality, maintainable code following best practices.Apply analytical skills to solve complex finops problems.Develop efficient data model for storing...

  • Data Engineer

    4 weeks ago


    Pleasanton, United States Usage AI Full time

    Note:No Recruiters Please.Must be in office 5 days / week.Minimum 3+ years of experience.Must come onsite for interview.ResponsibilitiesDesign and develop aggregation data pipelines, data models etc.Write great quality, maintainable code following best practices.Apply analytical skills to solve complex finops problems.Develop efficient data model for storing...

  • Data Engineer

    4 weeks ago


    Pleasanton, United States Intelliswift Software Full time

    Title: Data EngineerLocation: Dublin, CA (Onsite role – 4 days/Week)Type: Fulltime with Intelliswift Software Inc.Detailed Job DescriptionWe are seeking a highly skilled Data Analyst with strong analytical skills and the ability to work independently. The ideal candidate will be a self-starter capable of piecing together data to answer complex questions....

  • Data Engineer

    2 months ago


    Pleasanton, United States Intelliswift Software Full time

    Title: Data EngineerLocation: Dublin, CA (Onsite role – 4 days/Week)Type: Fulltime with Intelliswift Software Inc.Detailed Job DescriptionWe are seeking a highly skilled Data Analyst with strong analytical skills and the ability to work independently. The ideal candidate will be a self-starter capable of piecing together data to answer complex questions....


  • Pleasanton, United States Albertsons Companies Full time

    The Principal AI Engineer will be a key technical leader responsible for designing and implementing the platform & architecture that underpins our AI and ML modeling capabilities and integration with applications and data pipelines. This person will Engineer, Principal, Data Science, Data Engineer, Cloud Architect, AI, Technology, Grocery


  • Pleasanton, California, United States Kapital Data Corp Full time

    Job Overview: PeopleSoft Software Engineer (Mid-Level) Position Type: Long-Term Contract (Up to 5 years or more) Location: Remote (Candidates must reside in the US) Requirement: US Citizen (Contract contingent upon background check clearance) Position Summary: Kapital Data Corp is looking for a proficient PeopleSoft Software Engineer with mid-level...


  • Pleasanton, United States DRISHTICON Inc Full time

    We have an immediate contract requirement for Sr Azure Cloud Data Engineer with one of our direct clients in San Francisco Bay Area, CA USA.Senior Azure Cloud Data Engineer with a strong background in Power BI, Azure Data bricks , Java and SQL. The candidate will be responsible for designing, developing, and implementing data integration solutions in the...


  • Pleasanton, United States DRISHTICON Inc Full time

    We have an immediate contract requirement for Sr Azure Cloud Data Engineer with one of our direct clients in San Francisco Bay Area, CA USA.Senior Azure Cloud Data Engineer with a strong background in Power BI, Azure Data bricks , Java and SQL. The candidate will be responsible for designing, developing, and implementing data integration solutions in the...

  • Staff Data Engineer

    2 months ago


    Pleasanton, United States BlackLine Full time

    Get to Know Us:It's fun to work in a company where people truly believe in what they're doing! At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications.Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial...

  • Staff Data Engineer

    2 months ago


    Pleasanton, United States BlackLine Full time

    It's fun to work in a company where people truly believe in what they're doing! At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications. Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial close process. Our vision is to...

  • Staff Data Engineer

    2 months ago


    Pleasanton, United States BlackLine Full time

    It's fun to work in a company where people truly believe in what they're doing! At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications. Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial close process. Our vision is to...


  • Pleasanton, United States 10x Genomics Inc Full time

    About the role:10x is looking for an outstanding Data Engineer to join the Process Development team. This is a key position for both the Process Development and broader Operations team to ensure development of data pipelines, ensure accessibility of data, and design of data analytics tools.The ideal candidate will have a strong background in data engineering...


  • Pleasanton, United States 10x Genomics Inc Full time

    About the role:10x is looking for an outstanding Data Engineer to join the Process Development team. This is a key position for both the Process Development and broader Operations team to ensure development of data pipelines, ensure accessibility of data, and design of data analytics tools.The ideal candidate will have a strong background in data engineering...


  • Pleasanton, California, United States Kapital Data Corp Full time

    Job Overview: Senior PeopleSoft EngineerPosition Type: Long-Term Contract (Up to 8 years or more)Location: Remote (Candidates must reside in the US)Eligibility: US Citizen (Contract contingent upon successful background check clearance)Position Summary:Kapital Data Corp is in search of a proficient Senior PeopleSoft Engineer to become a vital part of our...


  • Pleasanton, United States Albertsons Full time

    Job DescriptionAbout the company Albertsons Companies is at the forefront of the revolution in retail. With a fixation on raising the bar with innovation and building belonging through our culture, our team is rallying our company around a unique purpose: to create joy around each table and inspire a healthier tomorrow for every community. Albertsons...


  • Pleasanton, California, United States 10x Genomics, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer, Data Platform to join our team at 10x Genomics, Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our central data and business intelligence platform.The ideal candidate will have a strong background in software...


  • Pleasanton, California, United States 10x Genomics Full time

    About the RoleWe are seeking an exceptional Data Engineer to join our Process Development team at 10x Genomics. This is a critical position that will play a key role in ensuring the development of data pipelines, accessibility of data, and design of data analytics tools.Key ResponsibilitiesDevelop and implement process control and yield optimization...


  • Pleasanton, California, United States DRISHTICON Inc Full time

    We are seeking a highly skilled Sr Azure Cloud Data Engineer to join our team at DRISHTICON Inc. in the San Francisco Bay Area, CA USA.The ideal candidate will have a strong background in Power BI, Azure Data bricks, Java, and SQL, with experience in designing, developing, and implementing data integration solutions in the Azure cloud...

  • Data Architect

    3 months ago


    Pleasanton, United States CriticalRiver Inc. Full time

    Job Title: Data Architect with DBTEmployment Type: Fulltime Location – Pleasanton CA Onsite/Hybrid - 2-3 days in the Pleasanton CR officeYears of Experience: 10-15 YearsProject task:A key player in shaping our data architecture strategies and driving innovative solutions. This role requires a seasoned professional with a deep understanding of data science,...