Data Engineer Databricks

4 weeks ago

Atlanta, United States Capgemini Full time

Job Title: Data Engineer Databricks

Job Location: Atlanta, GA/ Tampa, FL/ NJ


Key Responsibilities:

  • Work closely with analytics architects and AI engineers to support exploratory and production application data preparation needs. Data customers will include human analysts, analytics engineers, AI and analytical models, dashboarding applications, and data stores.
  • Set up pipelines to ingest, store, clean, merge, transform, and aggregate data from multiple external and internal data sources
  • Set up both batch and streaming pipelines
  • Data pipelines and transformations will be built in Azure Databricks
  • Data may need to be ported to or from graph data stores such as Neo4j or TigerGraph


Required Knowledge:

  • Databricks data engineering (Databricks Professional Data Engineer and/or Spark Developer certification preferred)
  • Understanding of batch and streaming data processing for reporting and model inferencing
  • Understanding of structured, unstructured, and semi-structured data processing
  • Exposure to graph database technologies
  • Understanding of financial services risk and security data domain
  • Highly proficient Python and SQL skills
  • PySpark and Spark SQL


Key Talents

  • Adaptability: Data engineering requirements will change frequently as analytical needs and priorities flex. The data engineer who fills this role must be able to understand and quickly adapt to new requests
  • Conscientiousness: it is critical the person who fills this role takes in upon themselves to ensure that the output of their pipelines are what is practically needed by the business users and analytics engineers downstream. This person must be able to interpret specification in the context of business needs and work to clarify specifications to ensure that they serve the practical business need.


Preferred Experience:

  • 2+ years of Databricks data engineering experience (Databricks Professional Data Engineer and/or Spark Developer certification preferred)
  • 7+ years of experience in data engineering pipelines for analytics—must include batch and streaming data
  • 3+ years working in a financial services or security related data domain


Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief


Disclaimer

  • Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
  • This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
  • Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.


  • Click the following link for more information on your rights as an Applicant

  • Databricks Data Analyst

    4 weeks ago

    Atlanta, United States Blu Omega Full time

    Blu Omega is seeking a motivated and detail-oriented Jr. to Mid-Level Databricks Data Analyst to join our team. The ideal candidate will have experience with Databricks in Azure and possess strong analytical skills to help drive data-driven decision-making processes. This position requires someone who can effectively communicate both orally and in writing,...

  • Databricks Data Analyst

    4 weeks ago

    Atlanta, United States Blu Omega Full time

    Blu Omega is seeking a motivated and detail-oriented Jr. to Mid-Level Databricks Data Analyst to join our team. The ideal candidate will have experience with Databricks in Azure and possess strong analytical skills to help drive data-driven decision-making processes. This position requires someone who can effectively communicate both orally and in writing,...

  • Databricks Architect

    2 months ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant- Databricks Hybrid Architect Platform!We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data...

  • Databricks Architect

    2 months ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant- Databricks Hybrid Architect Platform!We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data...

  • Azure Databricks Architect

    4 weeks ago

    Atlanta, United States Tata Consultancy Services Full time

    Technical/Functional SkillsMUST HAVE SKILLS Experience: Proven experience as a Data Architect or similar role with extensive experience in designing and implementing solutions on Azure Data bricks.Technical Skills: Proficiency with Azure Data bricks, Apache Spark, and data processing frameworks.Strong experience with Azure services (e.g., Azure Data Lake,...

  • Data Engineer

    3 weeks ago

    Atlanta, United States Wise Skulls llc Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Atlanta, GA; Dallas, TX (On-site) Duration: 6+ Months Implementation Partner: Infosys End Client: To be disclosedJD:4 to 5 years of experience in Snowflake with DatabricksExperience working with large, heterogeneous data sets in building and optimizing data pipelines and solutions on the...

  • Data Engineer

    4 weeks ago

    Atlanta, United States Vimerse Full time

    Job DescriptionJob DescriptionTiitle: Data EngineerLocation- Atlanta, GAHybrid RoleMust have skills : Azure Data Factory, Databricks Good to have skills: Azure SynapseJob Description:*Hands-on experience with Azure Data Factory * Hands-on experience with Azure Databricks * Excellent SQL and T-SQL skills * Experience of working in Agile teams * Excellent...

  • Data Engineer

    4 weeks ago

    Atlanta, United States Vimerse Full time

    Job DescriptionJob DescriptionTiitle: Data EngineerLocation- Atlanta, GAHybrid RoleMust have skills : Azure Data Factory, Databricks Good to have skills: Azure SynapseJob Description:*Hands-on experience with Azure Data Factory * Hands-on experience with Azure Databricks * Excellent SQL and T-SQL skills * Experience of working in Agile teams * Excellent...

  • Data Engineer

    3 months ago

    Atlanta, United States Scalene Works People Solution LLP Full time

    Requisition/Position Title Senior Azure Data Engineer Employment (Regular/Consultant) Regular Position Type (New/Replacement) New Experience Level (Min-Max) >6 Years Mandatory Skillset (Maximum 5) Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake Detailed Job Description Job Responsibilities: · Design, develop, and implement robust...

  • Key Data Engineer

    2 months ago

    Atlanta, Georgia, United States EPAM Systems Full time

    We are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.What You'll DoBuild and maintain secure and compliant...

  • Senior Azure Data Engineer

    1 month ago

    Atlanta, United States 3i People Full time

    At 3i People, we’re more than a staffing agency, we are career accelerators! Partnered with cutting-edge tech firms and innovative companies, we connect top-tier talent with their dream jobs. Our mission is to open doors for professionals like you to thriving workplaces where you can leave your mark. Here is one such opportunity for a Senior Azure Data...

  • Senior Azure Data Engineer

    1 month ago

    Atlanta, United States 3i People Full time

    At 3i People, we’re more than a staffing agency, we are career accelerators! Partnered with cutting-edge tech firms and innovative companies, we connect top-tier talent with their dream jobs. Our mission is to open doors for professionals like you to thriving workplaces where you can leave your mark. Here is one such opportunity for a Senior Azure Data...

  • Data Engineer

    1 week ago

    Atlanta, United States Pacer Staffing LLC Full time

    Experience in data engineering, with a specialization in creating and managing cloud-based data infrastructure.Experience with Databricks, Apache Spark, and cloud platforms Proficient in dimensional modeling with a solid grasp of warehouse construction principles

  • Data Engineer

    2 weeks ago

    Atlanta, United States Pacer Staffing LLC Full time

    Experience in data engineering, with a specialization in creating and managing cloud-based data infrastructure.Experience with Databricks, Apache Spark, and cloud platforms Proficient in dimensional modeling with a solid grasp of warehouse construction principles

  • Data Architect

    3 months ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionData ArchitectFurniture.comAbout Us Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Senior Azure Databricks Developer

    3 weeks ago

    Atlanta, United States Artmac Soft LLC Full time

    Job DescriptionJob DescriptionWho We Are: Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.Job Description Job Title : Senior Azure Databricks DeveloperJob Type : C2C Experience : 8 - 10 years Location : Atlanta, Georgia (Onsite)Responsibilities :The effort...

  • Sr. Data Engineer

    3 months ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionSr Data Engineer Furniture.com Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Senior Data Engineer

    4 weeks ago

    Atlanta, United States Optomi Full time

    Senior Data Engineer - Snowflake ProficienciesHybrid to Atlanta GA (office is in Alpharetta)This opportunity is a contract based opportunity and will continually extend. Optomi, in partnership with a leader in the Retail and Communications industry, is seeking a Senior Data Engineer to join their team! This team is working with foundational data that feeds...

  • Data Engineer

    2 weeks ago

    Atlanta, United States The E Group Full time $50 - $62

    Job DescriptionJob DescriptionJob Title: Data Engineer 3 or 4Date Posted: 8/29/2024Location: Atlanta, GAJob Type: Contract Full Time - W2 only - in office position Immediate W2 contract position available in Atlanta, GA.Estimated Duration: 6 months Desired Qualifications:· Bachelor’s or Master’s degree in Computer Science, Information Systems, or an...

  • Big Data Engineer

    1 month ago

    Atlanta, Georgia, United States Norfolk Southern Corp. Full time

    Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail. As part of Norfolk Southern, you'll join a collaborative team where there are opportunities for growth across...