Lead Data Engineer

7 days ago

McLean, United States Capital One Full time
Lead Data Engineer - Python, Spark (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices.

What You’ll Do:

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake.
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance.

Basic Qualifications:

  • Bachelor’s Degree.
  • At least 4 years of experience in application development (Internship experience does not apply).
  • At least 2 years of experience in big data technologies.
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud).

Preferred Qualifications:

  • 7+ years of experience in application development including Python, SQL, Scala, or Java.
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
  • 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
  • 4+ year experience working on real-time data and streaming applications.
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra).
  • 4+ years of data warehousing experience (Redshift or Snowflake).
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting.
  • 2+ years of experience with Agile engineering practices.

At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

#J-18808-Ljbffr

  • Lead Data Engineer

    1 month ago

    Mclean, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Lead Data Engineer

    2 weeks ago

    Mclean, United States Capital One Full time

    Center 2 (19050), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Lead Data Engineer

    7 days ago

    Mclean, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Lead Data Engineer

    1 week ago

    McLean, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you‘ll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Lead Data Engineer

    4 weeks ago

    Mclean, United States Capital One Full time

    Plano 3 (31063), United States of America, Plano, TexasSenior Lead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Lead Data Architect/Engineer

    1 week ago

    McLean, United States Saxon Global Full time

    As a data/platform architect, you will be responsible for designing and delivering enterprise wide solutions on cloud platform. This position works with enterprise architects, data architects and solution architects to design and implement data solutions to meet business priorities in keeping with technology strategy, standards and the best course of action....

  • Lead Data Engineer

    2 months ago

    McLean, United States MITRE Full time

    Why choose between doing meaningful work and having a fulfilling life? At MITRE, you can have both. That's because MITRE people are committed to tackling our nation's toughest challenges—and we're committed to the long-term well-being of our employees. MITRE is different from most technology companies. We are a not-for-profit corporation chartered to work...

  • Lead Data Engineer,

    7 days ago

    Mclean, United States Capital One Full time

    Locations: VA - McLean, United States of America, McLean, VirginiaLead Data Engineer, (Enterprise Platforms Technology)Lead Data Engineer (Enterprise Platforms Technology)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At...

  • Lead Data Engineer

    4 weeks ago

    Mclean, United States Capital One Full time

    77 West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers,...

  • Data Scientist/Data Engineer

    6 months ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Software Engineering Lead

    2 days ago

    McLean, United States Top Secret Clearance Jobs Full time

    About the job Software Engineering Lead / Software Engineer Tech Lead Top Secret Clearance Jobs is dedicated to helping those with the most exclusive security clearance find their next career opportunity and get interviews within 48 hours. Candidate MUST possess a TS/SCI clearance with Intel Polygraph Software Engineering Lead Job DescriptionThe Software...

  • Senior Lead Data Scientist

    3 months ago

    McLean, United States Hilton Full time

    ***This role is based at our corporate office in McLean, VA*** This is your chance to be part of an in-house Strategy, Insights, and Analytics team of consultants to important functions across Hilton! The team consists of both embedded authorities who serve as strategic advisors to partners and technical specialists who are proficient in advanced analytics...

  • Virtual Engineer, Engineering Operations Specialist

    3 weeks ago

    McLean, Virginia, United States SMS Data Products Group Full time

    Job Summary:We are seeking a highly skilled Virtual Engineer to join our team at SMS Data Products Group. As an Illumio SME and network security expert, you will be responsible for overseeing and directing the engineering, implementation, policy configurations, and maintenance for the Air Force adopted Department of Defense (DoD) Zero Trust Architecture...

  • Sr. Data Engineer

    1 week ago

    McLean, United States Mindlance Full time

    We are looking for an experienced and highly motivated Data Engineer to join our team. In this role, you will play a key part in designing, implementing, and optimizing data pipelines and infrastructure for efficient data management and analysis. This role requires deep expertise in data engineering concepts, cloud-based technologies, and a commitment to...

  • Sr. Data Engineer

    1 week ago

    McLean, United States Mindlance Full time

    We are looking for an experienced and highly motivated Data Engineer to join our team. In this role, you will play a key part in designing, implementing, and optimizing data pipelines and infrastructure for efficient data management and analysis. This role requires deep expertise in data engineering concepts, cloud-based technologies, and a commitment to...

  • Data Engineer

    3 weeks ago

    McLean, United States Idexcel Full time

    Job Title: Data Engineer (Pyspark)Location: McLean, VA / Richmond, VA / Plano, TX/Chicago, Il (only locals)Duration: ContractWork is Python to Pyspark migrationTop Skills:Python, Pyspark, SQL, AWS, Snowflake, Data Bricks, ETL, Kafka, Unix (Command/Shell Script) and ETL/DWH concepts

  • Data Engineer

    3 weeks ago

    McLean, United States Idexcel Full time

    Job Title: Data Engineer (Pyspark)Location: McLean, VA / Richmond, VA / Plano, TX/Chicago, Il (only locals)Duration: ContractWork is Python to Pyspark migrationTop Skills:Python, Pyspark, SQL, AWS, Snowflake, Data Bricks, ETL, Kafka, Unix (Command/Shell Script) and ETL/DWH concepts

  • Data Engineer

    4 weeks ago

    McLean, United States Idexcel Full time

    Job Title: Data Engineer (Pyspark)Location: McLean, VA / Richmond, VA / Plano, TX (only locals)Duration: ContractRequired:Work is Python to PySpark migrationTop skills:Python, Pyspark, SQL, AWS, Snowflake, Data Bricks, ETL, Kafka, Unix (Command/Shell Script) and ETL/DWH concepts

  • Data Engineer

    4 weeks ago

    mclean, United States Idexcel Full time

    Job Title: Data Engineer (Pyspark)Location: McLean, VA / Richmond, VA / Plano, TX (only locals)Duration: ContractRequired:Work is Python to PySpark migrationTop skills:Python, Pyspark, SQL, AWS, Snowflake, Data Bricks, ETL, Kafka, Unix (Command/Shell Script) and ETL/DWH concepts

  • Data Engineer

    1 month ago

    McLean, United States Idexcel Full time

    Job Title: Data Engineer Location: McLean, VA / Richmond, VA / Plano, TX (only locals)Duration: ContractRequired:Work is Python to PySpark migrationTop skills:Python, Pyspark, SQL, AWS, Snowflake, Data Bricks, ETL, Kafka, Unix (Command/Shell Script) and ETL/DWH concepts