Senior Data Engineer in Generative AI

4 days ago

York, PA, United States Capital One Full time

Are you passionate about pioneering new technologies and solving complex business challenges? At Capital One, you’ll join a dynamic team of innovators dedicated to addressing real customer needs. We are looking for a Senior Data Engineer focused on Generative AI who is eager to harness the potential of emerging technologies to transform how we deliver value to our customers.

The AI Foundations team is at the forefront of Capital One’s AI vision, impacting every phase of the research life cycle from academic collaboration to crafting production systems. Our work involves partnering across product, technology, and business teams to implement state-of-the-art AI solutions.

What You'll Do:

  • Collaborate with Agile teams to design, develop, test, implement, and support innovative technical solutions using a comprehensive range of full-stack development tools and technologies.

  • Engage with a cross-functional team of applied researchers, data scientists, software engineers, machine learning engineers, and product managers to create AI-driven products that enhance customer interactions with their finances.

  • Utilize advanced technologies, including AWS Ultraclusters, Spark, Kubeflow, and more, to develop data pipelines that inform our foundational models of customer behavior.

  • Stay up-to-date with technology trends, explore and learn new technologies, and mentor fellow members of the engineering team.

  • Conduct thorough unit testing and peer reviews to ensure your code is well-designed, efficiently written, and optimized for high performance.

Basic Qualifications:

  • Bachelor's Degree.

  • Minimum of 4 years experience in application development (excluding internships).

  • At least 2 years of experience in big data technologies.

  • 1+ year experience with cloud computing (AWS, Microsoft Azure, Google Cloud).

Preferred Qualifications:

  • 7+ years of experience in application development, proficient in Python, SQL, Scala, or Java.

  • 4+ years of experience with public cloud platforms (AWS, Microsoft Azure, Google Cloud).

  • 4+ years experience with distributed computing tools (Spark, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, or MySQL).

  • 4+ years of experience in designing, building, and optimizing large-scale data pipelines and ETL workflows.

  • 4+ years of experience with UNIX/Linux, including basic command usage and shell scripting.

  • 2+ years working on real-time data and streaming applications.

  • 2+ years of experience in data warehousing (Redshift or Snowflake).

  • 2+ years of experience with Agile engineering practices.

Please note that Capital One will not sponsor applicants for employment authorization or immigration-related support for this position.

The minimum and maximum full-time annual salaries for this role are as follows: Boston, MA: $193,400 - $220,700; McLean, VA: $193,400 - $220,700; New York, NY: $211,000 - $240,800; San Francisco, CA: $211,000 - $240,800.

This role may also earn performance-based incentive compensation, including cash bonuses and/or long-term incentives. Capital One offers a competitive and comprehensive set of benefits supporting overall well-being.

Capital One promotes a drug-free workplace and is an equal opportunity employer, committed to non-discrimination laws. We encourage applications from individuals with a criminal history in compliance with applicable statutes.

If you need accommodation during the application process, please contact Capital One Recruiting via email. All information will be treated confidentially.

  • Senior Distinguished Data Engineer

    1 week ago

    York, PA, United States Capital One Full time

    As a Senior Distinguished Data Engineer, you will be a key contributor at Capital One, shaping innovative solutions within our Credit Card Technology Data Engineering Team. Your work will directly influence the future of financial services as you manage and leverage vast amounts of sensitive, real-time, and batch data. Join our fast-paced, mission-driven...

  • Senior Distinguished Data Engineer

    6 days ago

    York, PA, United States Capital One Full time

    As a Senior Distinguished Data Engineer, you will be a key contributor at Capital One, shaping innovative solutions within our Credit Card Technology Data Engineering Team. Your work will directly influence the future of financial services as you manage and leverage vast amounts of sensitive, real-time, and batch data. Join our fast-paced, mission-driven...

  • Senior Distinguished Data Engineer

    4 days ago

    York, PA, United States Capital One Full time

    As a Senior Distinguished Data Engineer, you will be a key contributor at Capital One, shaping innovative solutions within our Credit Card Technology Data Engineering Team. Your work will directly influence the future of financial services as you manage and leverage vast amounts of sensitive, real-time, and batch data. Join our fast-paced, mission-driven...

  • Senior Distinguished Data Engineer

    2 days ago

    York, PA, United States Capital One Full time

    As a Senior Distinguished Data Engineer, you will be a key contributor at Capital One, shaping innovative solutions within our Credit Card Technology Data Engineering Team. Your work will directly influence the future of financial services as you manage and leverage vast amounts of sensitive, real-time, and batch data. Join our fast-paced, mission-driven...

  • Senior Data Engineer, Python

    1 week ago

    York, PA, United States Capital One Full time

    Senior Data Engineer, Python Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We...

  • Senior Data Engineer

    1 week ago

    York, PA, United States Capital One Full time

    Senior Data Engineer (Cloud Operations Resilience Engineering) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...

  • Senior Data Engineer

    6 days ago

    York, PA, United States Capital One Full time

    Senior Data Engineer (Cloud Operations Resilience Engineering) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...

  • Senior Data Engineer

    4 days ago

    York, PA, United States Capital One Full time

    Senior Data Engineer (Cloud Operations Resilience Engineering) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...

  • Senior Data Engineer

    1 week ago

    York, PA, United States Capital One Full time

    Senior Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...

  • Senior Data Engineer

    2 days ago

    York, PA, United States Capital One Full time

    Senior Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...