Senior Data Engineer

4 weeks ago


Plano, Texas, United States Capital One Full time
Job Description

Capital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights.

Key Responsibilities:
  • Design and build Enterprise Level scalable, low-latency, fault-tolerant streaming data platform
  • Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, Python
  • Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets
  • Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Requirements:
  • Bachelor's Degree
  • At least 3 years of experience in application development (Internship experience does not apply)
  • At least 1 year of experience in big data technologies
Preferred Qualifications:
  • 5+ years of experience in application development including Python, SQL, Scala, or Java
  • 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 3+ years experience with Distributed data computing tools (Kafka, Spark, Flink)
  • 2+ year experience working on real-time data and streaming applications
  • 2+ years of experience with NoSQL implementation (DynamoDB, OpenSearch)
  • 2+ years of data warehousing experience (Redshift or Snowflake)
  • 3+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website.

This role is expected to accept applications for a minimum of 5 business days.

No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law.


  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States One Park Financial Full time

    Senior Data EngineerAt One Park Financial, we're seeking a highly skilled Senior Data Engineer to lead the transformation of our technology data lake and analytics platform within the AWS ecosystem. As a key member of our team, you'll be responsible for designing and building the necessary infrastructure to support advanced data and AI capabilities.Key...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    Job Title: Senior Data EngineerAbout the Role:Capital One is seeking a Senior Data Engineer to join our product data team. As a Senior Data Engineer, you will be responsible for building and maintaining sophisticated data pipelines that ingest data from major auto customers, utilizing advanced AWS services including EMR, S3, and EC2. Your work will directly...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States Syntricate Technologies Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have a strong background in Java and experience working with large data sets, ETL, and high-volume data collection. Additionally, they should have expertise in Spark, AWS, and RDBMS. A strong understanding of software...


  • Plano, Texas, United States Smart Data Solutions Full time

    As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients, reducing costs, streamlining workflows, and improving overall customer experience.SDS is seeking a skilled Senior...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States Public Storage Full time

    Job SummaryWe are seeking a highly skilled Data Engineer II to join our team and play a key role in advancing our cutting-edge data infrastructure. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable data systems to support advanced analytical capabilities and meet evolving business needs.Key...


  • Plano, Texas, United States Motion Recruitment Full time

    Are you an experienced Azure Data Engineer looking for a challenging role in cloud data solutions? Motion Recruitment is seeking a Senior Azure Data Engineer to join their team and contribute to the development of cloud-based ETL data processes.This is a senior-level opportunity that requires a minimum of 6 years of experience in Azure PaaS/SaaS solutions,...

  • Data Engineer

    1 month ago


    Plano, Texas, United States Zenith services Full time

    Senior Data EngineerZenith Services is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data pipelines and architectures.Key Responsibilities:Design and develop scalable data pipelines using Informatica Cloud (IICS) and...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States UnitedHealth Group Full time

    Job SummaryAs a Senior Data Engineer at UnitedHealth Group, you will be responsible for designing and implementing data storage and retrieval systems that meet the needs of our business. This includes analyzing current business practices and identifying future opportunities for leveraging data storage and retrieval system capabilities.Key Responsibilities-...


  • Plano, Texas, United States Visionary Innovative Technology Solutions LLC Full time

    We are seeking a highly skilled Senior Data Engineer with extensive experience in Snowflake, data warehousing, ETL, and BI projects.The ideal candidate will have expertise in Snowflake Database and query optimization, as well as data modeling.Additionally, experience in implementing complex stored procedures, standard DWH and ETL concepts, and basic...


  • Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a Senior Lead Data Engineer to join our team at Capital One. As a Senior Lead Data Engineer, you will be responsible for leading a team of developers in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with and across Agile teams to...


  • Plano, Texas, United States Nuvem, Inc Full time

    Job SummaryAs a Senior Azure Data Engineer at Nuvem, Inc, you will be responsible for designing and implementing cloud-based data solutions using Azure Data Engineering Stack. The ideal candidate will have a strong background in data integration, database technologies, and Azure Cloud PaaS/SaaS solutions. You will work closely with clients to deliver...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States The Dignify Solutions LLC Full time

    We are seeking a highly skilled Data Engineer to join our team at The Dignify Solutions LLC. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in data engineering, with a minimum of 10+ years of experience in...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will play a critical role in designing, developing, and implementing data solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data solutions that meet business...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States Capital One Full time

    About the RoleCapital One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data pipelines and architectures to support our business needs.Key ResponsibilitiesCollaborate with cross-functional teams to design and develop data solutionsDevelop and maintain data...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States AIT Global inc. Full time

    Job Title: Senior Data Engineer - Java Spark with AWS and SnowflakeJob Summary: We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data pipelines using Apache Spark and Java.Key Responsibilities:* Design and develop data processing workflows and ETL processes to ingest, transform, and store large volumes of data*...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    Job DescriptionCapital One is seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work closely with Agile teams to collaborate on projects, utilize programming languages like Java, Scala, Python,...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will be responsible for designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platforms that provide meaningful and timely insights.Key Responsibilities:Build the next generation Distributed Streaming...

  • Senior Data Analyst

    4 weeks ago


    Plano, Texas, United States Insight Global Full time

    Job Title: Senior Data AnalystJob Summary:Insight Global is seeking a Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for working with our technical team members to define data flow from SAP/Oracle to Azure data environment. You will create data flow diagrams, artifacts, and support testing of data. This role is...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Idexcel Full time

    Job Title: Sr Data EngineerLocation: Remote opportunities availableDuration: Long-term engagementKey Responsibilities:1. Design and develop scalable data architectures using Spark, Python, and Pyspark.2. Collaborate with cross-functional teams to implement data solutions on AWS Cloud technologies.3. Ensure data quality, security, and compliance with Idexcel...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will be responsible for designing, developing, and implementing data pipelines for decisioning systems, leveraging in-house data frameworks, running validation tests, and communicating with the business POC on the status of requests.Key...