Senior Data Engineer

1 week ago


Phoenix, Arizona, United States American Express Full time
About the Role

We are seeking a highly skilled Senior Data Engineer to join our team at American Express. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining NLP pipelines for sales practices and monitoring initiatives. This role involves building a cohesive data layer by linking data from different sources, engineering big data-enabled AI pipelines, and building integration capabilities both in real-time and batch mode to ensure that outcomes are synced into Salesforce-based user experiences.

Key Responsibilities
  • Perform business requirements analysis and translate requirements into technical requirements.
  • Provide technical expertise in driving projects from inception to closure.
  • Develop ETL data pipelines using open-source big data technologies.
  • Develop and deploy microservices-based APIs over Docker containers.
  • Work independently as well as collaborate effectively with cross-functional teams on a case-by-case basis.
  • Work with Product teams, other data engineers, and DevOps to deliver features on time.
  • Be a change agent with hands-on ability to build POC products and set best practices.
  • Perform code reviews and help the team to produce quality code.
  • Work in a geographically distributed team setup.
  • Identify opportunities for further enhancements and refinements to standards and processes.
  • Fine-tune the existing application with new ideas and optimization opportunities to reduce latency.
Requirements
  • Bachelor's degree in engineering or Computer Science or equivalent OR master's in computer applications or equivalent.
  • 7+ years of experience within Data Engineering/Data Warehousing using Big Data.
  • Awareness of machine learning, NLP, and AI concepts with 2+ years of experience.
  • Technical Skills: Expert on Distributed ecosystem including Map-Reduce, Hive, Spark (core, SQL, and PySpark).
  • Hands-on experience with programming using Core Java or Python.
  • Expert on Hadoop and Spark Architecture and its working principle.
  • Hands-on experience on writing and understanding complex SQL (Hive/PySpark-dataframes), optimizing joins while processing huge amounts of data.
  • Experience in UNIX shell scripting.
  • Ability to design and develop optimized Data pipelines for batch and real-time data processing.
  • Experience with ML, AI, and NLP products development.
  • Provides advanced knowledge of technical and functional principles.
  • Should have experience in analysis, design, development, testing, and implementation of system applications.
  • Experience with GitHub/Bitbucket and leveraging CI/CD pipelines.
  • Creative problem-solving (Innovative).
  • Excellent technical and analytical aptitude.
  • Self-starter with a curiosity and appetite for new technology.
  • Teamwork & ability to multi-task.
  • Excellent communication skills.
  • Ability to influence and lead others.
  • Willingness to understand the business and participate in discussions around project requirements.
What We Offer

We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:

  • Competitive base salaries.
  • Bonus incentives.
  • 6% Company Match on retirement savings plan.
  • Free financial coaching and financial well-being support.
  • Comprehensive medical, dental, vision, life insurance, and disability benefits.
  • Flexible working model with hybrid, onsite, or virtual arrangements depending on role and business need.
  • 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption, or surrogacy.
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location).
  • Free and confidential counseling support through our Healthy Minds program.
  • Career development and training opportunities.

  • Senior Data Engineer

    3 weeks ago


    Phoenix, Arizona, United States Harnham Full time

    Unlock Your Potential as a Senior Data EngineerAbout the RoleHarnham is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures, developing efficient ETL pipelines, and ensuring data governance and security.Key...

  • Senior Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Harnham Full time

    Senior Data EngineerUnlocking Business Potential through Data Innovation$110,000 to $150,000 base salaryPhoenix, AZ - 5 days per week onsiteAbout the CompanyHarnham is a leading recruitment agency specializing in data and technology roles. Our team of experts is dedicated to connecting top talent with innovative companies.About the RoleWe are seeking a...

  • Senior Data Architect

    3 weeks ago


    Phoenix, Arizona, United States Harnham Full time

    Senior Data EngineerHigh-Growth Investment Management Firm$110,000 to $150,000 base salaryOnsite Work ArrangementAbout the CompanyHarnham is a leading provider of data-driven solutions for investment management firms.About the RoleAs a Senior Data Engineer, you will be responsible for designing and implementing data architectures that drive business growth...


  • Phoenix, Arizona, United States Oracle Full time

    Job Title: Senior Data Center EngineerJob Summary:We are seeking a highly skilled Senior Data Center Engineer to join our team at Oracle. As a key member of our Data Center Operations team, you will be responsible for maintaining the operational run aspects of our Data Center Environment.Key Responsibilities:Support the growth path of our Data Center...


  • Phoenix, Arizona, United States MatchPointe Group Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at MatchPointe Group.The ideal candidate will have a strong background in designing and implementing business intelligence and ETL solutions using programming, performance tuning, and data modeling.As a Senior Data Engineer, you will be responsible for creating databases...


  • Phoenix, Arizona, United States Aligned Data Centers Full time

    Job DescriptionJob Title: Technical Program Director - Data Center ExpertJob Summary:We are seeking a highly skilled Technical Program Director to lead our data center projects from inception to completion. As a key member of our team, you will be responsible for driving projects forward, ensuring timely delivery, and maintaining high-quality standards.Key...


  • Phoenix, Arizona, United States Strategic Employment Partners (SEP) Full time

    Strategic Employment Partners (SEP) - Lead Data EngineerA SaaS company with over 25 years of experience is seeking a Lead Data Engineer to join their team. As a key member of the data infrastructure team, you will design, implement, and maintain critical data processes and infrastructure in Azure Data Factory. Your leadership skills will be essential in...


  • Phoenix, Arizona, United States Sogeti Full time

    Sogeti Data Governance Engineer ConsultantSogeti, a subsidiary of Capgemini, is seeking a dynamic and experienced Data Governance Engineer Consultant to join our team in Phoenix, Arizona. With a strong emphasis on our people and partnerships, we foster a culture that celebrates innovation and helps you achieve a good balance between your professional and...


  • Phoenix, Arizona, United States Sogeti Full time

    Sogeti Data Governance Engineer Consultant Job DescriptionSogeti, a subsidiary of Capgemini, is seeking a highly skilled Data Governance Engineer Consultant to join our team in Phoenix, Arizona. As a key member of our team, you will play a crucial role in driving business teams to understand business process and data flows, documenting results of data...


  • Phoenix, Arizona, United States DriveTime Full time

    About the RoleWe are seeking a highly skilled Senior Data Scientist to join our team at DriveTime Family of Brands. As a key member of our analytics team, you will be responsible for designing, developing, and implementing analytical solutions to support multiple products, business units, and verticals.Key ResponsibilitiesCollaborate with business partners...


  • Phoenix, Arizona, United States Paradigm Technology Full time

    Senior Substation EngineerParadigm Technology is seeking an experienced Senior Substation Engineer to join our Transmission Engineering team. As a key member of our team, you will be responsible for designing and developing electrical substation projects, ensuring compliance with design, regulatory, operating, and maintenance requirements.Key...


  • Phoenix, Arizona, United States NTT DATA Full time

    Job Title: Senior Customer Service RepresentativeWe are seeking a highly skilled and experienced Senior Customer Service Representative to join our team at NTT DATA. As a key member of our customer service team, you will be responsible for providing exceptional service to our clients, resolving complex issues, and ensuring customer satisfaction.Job...


  • Phoenix, Arizona, United States NTT DATA Full time

    Job Title: Senior Customer Service RepresentativeWe are seeking a highly skilled and experienced Senior Customer Service Representative to join our team at NTT DATA. As a Senior Customer Service Representative, you will be responsible for providing exceptional customer service to our clients, resolving complex issues, and ensuring customer satisfaction.Key...


  • Phoenix, Arizona, United States Paradigm Technology Full time

    Job Title: Senior Substation EngineerParadigm Technology is seeking a highly skilled Senior Substation Engineer to join our team. As a Senior Substation Engineer, you will be responsible for designing and developing electrical substation systems, including physical and controls design, to ensure safe and efficient operation.Key Responsibilities:Design and...

  • GCP Big Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Centraprise Full time

    Job DescriptionCentraprise is seeking a highly skilled Senior Software Engineer to join our team. As a key member of our Big Data team, you will be responsible for designing and building software solutions that are fast, scalable, and flexible.Key Responsibilities:Design and develop Big Data applications using Java, Scala, SQL, and Linux.Collaborate with...

  • Big Data Engineer

    1 week ago


    Phoenix, Arizona, United States American Express Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at American Express. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining our Big Data Platform, Cornerstone. This is a unique opportunity to work with cutting-edge technologies and contribute to the success of our...


  • Phoenix, Arizona, United States NTT DATA Full time

    Job Title: Senior Customer Service RepresentativeWe are seeking a highly skilled Senior Customer Service Representative to join our team for a 4-month or longer temporary assignment. As a Senior Customer Service Representative, you will be responsible for handling inbound and outbound calls from participants and prescribers to start and process order...


  • Phoenix, Arizona, United States NTT DATA Full time

    Job Title:Senior Customer Service RepresentativeAbout the Role:We are seeking a skilled Senior Customer Service Representative to join our team for a temporary assignment. As a key member of our customer service team, you will be responsible for providing exceptional service to our clients, resolving issues, and ensuring a positive customer experience.Key...


  • Phoenix, Arizona, United States NTT DATA Full time

    Senior Customer Service Representative OpportunityWe are seeking a skilled Senior Customer Service Representative to join our team for a temporary assignment. As a key member of our team, you will be responsible for providing exceptional customer service and support to our clients.Key Responsibilities:Research and resolve customer issues in a timely and...


  • Phoenix, Arizona, United States NTT DATA Full time

    Senior Customer Service Representative OpportunityWe are seeking a skilled Senior Customer Service Representative to join our team for a temporary assignment. As a key member of our team, you will be responsible for providing exceptional customer service and support to our clients.Key Responsibilities:Research and resolve customer issues in a timely and...