Senior Manager, Data Engineering

2 weeks ago


Chicago, Illinois, United States Capital One Full time
About the Role

We are seeking a highly skilled Senior Manager, Data Engineering to lead our team of data engineers in designing and implementing scalable data pipelines using Spark, Scala, and SQL. As a key member of our data engineering team, you will be responsible for overseeing the development and execution of strategies to convert retail partners by utilizing data-driven insights and innovative technologies.

Key Responsibilities
  • Collaborate with agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full-stack systems.
  • Utilize programming languages like Java, Scala, Python, and Open Source RDBMS and NoSQL databases and Cloud-based data warehousing services such as Redshift and Snowflake.
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.
  • Perform unit tests and conduct reviews with other team members to make sure our code is rigorously designed, elegantly coded, and effectively tuned for performance.
Requirements
  • Bachelor's Degree.
  • At least 6 years of experience in application development (Internship experience does not apply).
  • At least 2 years of experience in big data technologies.
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
  • At least 4 years of people management experience.
Preferred Qualifications
  • Master's Degree.
  • 9+ years of experience in application development including Python, SQL, Scala, or Java.
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
  • 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
  • 4+ year experience working on real-time data and streaming applications.
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra).
  • 4+ years of data warehousing experience (Redshift or Snowflake).
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting.
  • 2+ years of experience with Agile engineering practices.
  • 6+ years of people management experience.
About Capital One

Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law.

Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.


  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Trajektory Full time

    Trajektory is seeking a highly skilled Senior Data Engineer to join our team in Chicago, IL. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems, as well as collaborating with cross-functional teams to drive business growth through data-driven insights. Key responsibilities include data...


  • Chicago, Illinois, United States ACV Auctions Full time

    About ACV AuctionsACV Auctions is a technology company that has revolutionized the automotive industry by providing a digital marketplace for buying and selling cars online. We are committed to innovation and user-designed solutions that drive growth and autonomy.Job SummaryWe are seeking an experienced Senior Data Engineering Manager to lead our Data...


  • Chicago, Illinois, United States Intelsat US LLC Full time

    Job Title: Senior Data EngineerJob Summary:Intelsat US LLC is seeking a highly skilled Senior Data Engineer to join our team in Chicago, IL. As a Senior Data Engineer, you will be responsible for developing and implementing rigorous data analysis and design methodology to yield high-quality technical design documentation that meets consumer requirements and...

  • Senior Data Engineer

    2 weeks ago


    Chicago, Illinois, United States Trajektory Full time

    Trajectory Data Engineer RoleAt Trajektory, we're seeking a skilled Senior Data Engineer to join our team in downtown Chicago. As a Senior Data Engineer, you'll be responsible for designing, developing, and maintaining our data engineering infrastructure, ensuring seamless data flow and analytics capabilities.Key Responsibilities• Design and implement data...


  • Chicago, Illinois, United States Cyclotron, Inc. Full time

    Job Title: Senior Data Engineer - Azure Cloud SolutionsWe are seeking a highly skilled Senior Data Engineer to join our team at Cyclotron, Inc. in a senior position. As a Senior Data Engineer, you will be responsible for designing and implementing high-value data-driven solutions leveraging our proven implementation methodology and solutions for enterprise...

  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Trajektory Full time

    Company OverviewTrajektory is a leading provider of data management solutions for the sports and entertainment industries. Our cutting-edge tools help brands evaluate sponsorship impact and make data-driven decisions. As a Senior Data Engineer at Trajektory, you will play a key role in developing and maintaining our data engineering capabilities.Job...


  • Chicago, Illinois, United States Adtalem Global Education Full time

    Job Title: Senior Data EngineerAdtalem Global Education is a national leader in post-secondary education and a leading provider of professional talent to the healthcare industry. We are seeking a highly skilled Senior Data Engineer to join our Data Engineering team.Job SummaryWe are looking for a technical powerhouse who can scale our data platform to meet...

  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States The Judge Group Full time

    About The Judge GroupThe Judge Group is a leading provider of professional services, including data engineering, data analytics, and IT consulting. We are seeking a highly skilled Senior Data Engineer to join our team.Job SummaryWe are looking for a Senior Data Engineer with expertise in designing, building, and maintaining large-scale data systems. The...

  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures.Key Responsibilities:Collaborate with cross-functional teams to design and implement data systems and architecturesDevelop and...

  • Senior Data Engineer

    1 month ago


    Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines using Azure Data Factory, Python, and Databricks.Key Responsibilities:Design and implement data pipelines to efficiently process and transfer dataCollaborate with cross-functional teams to develop solutions using DatabricksDevelop and maintain code in...

  • Senior Data Engineer

    4 weeks ago


    Chicago, Illinois, United States AbbVie Full time

    Job Title: Senior Data EngineerAbbVie is seeking a highly skilled Senior Data Engineer to join our Business Technology Solutions team. As a Senior Data Engineer, you will be responsible for designing and building scalable and efficient data solutions to accommodate large-scale data processing and presentation.Key Responsibilities:Design and develop data...

  • Senior Data Engineer

    15 hours ago


    Chicago, Illinois, United States JobRialto Full time

    Job SummaryThe Senior Data Engineer is responsible for developing, managing, and migrating data between systems while ensuring data integrity and performance optimization.This role requires strong expertise in ETL processes, Python, SQL, and shell scripting, as well as experience with Hadoop and relational databases like PostgreSQL.The Senior Data Engineer...


  • Chicago, Illinois, United States PatientIQ Full time

    Join Our Team as a Senior Data EngineerWe're seeking a highly skilled Senior Data Engineer to join our team at PatientIQ. As a key member of our Data Engineering department, you will play a critical role in building and maintaining our data infrastructure to support healthcare data analysis.Key Responsibilities:Clean and process large, complex datasets using...


  • Chicago, Illinois, United States Fidelity TalentSource LLC Full time

    Job Description:As a Senior Data Engineer at Fidelity Investments, you will play a critical role in developing and maintaining scalable data flows for AI model training in the financial services industry. Your expertise in designing and implementing data pipelines, ETL workflows, and data-centric APIs will enable the delivery of innovative products and...


  • Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines that efficiently process and transfer data.Key Responsibilities:Design and implement data pipelines using Azure Data FactoryDevelop and maintain code in Python for data processing and analysisCollaborate with cross-functional teams to develop solutions...


  • Chicago, Illinois, United States Grainger Full time

    Job Title: Senior Staff Data EngineerWe are seeking a highly skilled Senior Staff Data Engineer to join our Customer Information Management (CIM) team. As a key member of our team, you will be responsible for designing and developing data pipelines and data products to drive business growth.You will work closely with architects, stakeholders, and product...


  • Chicago, Illinois, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test,...

  • Senior Data Engineer

    3 weeks ago


    Chicago, Illinois, United States InterEx Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build data pipelines that efficiently process and transfer data. The ideal candidate will have a strong background in Azure Data Factory, Python, Databricks, and the Azure Data stack.Key Responsibilities:Design and build data pipelines to process and transfer dataUtilize...


  • Chicago, Illinois, United States Northern Trust Full time

    About Northern TrustNorthern Trust is a globally recognized financial institution with a rich history dating back to 1889. As a Fortune 500 company, we provide innovative financial services and guidance to the world's most successful individuals, families, and institutions.We pride ourselves on our enduring principles of service, expertise, and integrity,...


  • Chicago, Illinois, United States Hispanic Technology Executive Council Full time

    Transformative Data Engineering RoleCapital One is seeking a Senior Manager, Data Engineering to drive a major transformation within the organization. As a key member of the team, you will be responsible for leading the development and execution of strategies to convert retail partners by utilizing data-driven insights and innovative technologies.Key...