Senior Data Engineer: Mastering Big Data Solutions

7 days ago


New York, New York, United States Capital One Full time
About the Role

We are seeking a Senior Data Engineer to join our team at Capital One. As a key member of our engineering group, you will play a crucial role in designing, developing, and deploying cutting-edge big data solutions.

Key Responsibilities
  • Collaborate with cross-functional teams to design and implement technical solutions using full-stack development tools and technologies.
  • Work with experienced developers to build, test, and deploy machine learning, distributed microservices, and full-stack systems.
  • Utilize programming languages such as Java, Scala, Python, and databases like Redshift and Snowflake.
  • Stay up-to-date with emerging technologies and share knowledge with the engineering community through mentoring and technology communities.
  • Partner with digital product managers to deliver robust cloud-based solutions that drive customer experience.
  • Write high-quality code and conduct peer reviews to ensure rigorous design, elegant coding, and optimal performance.
Requirements
  • Bachelor's Degree.
  • At least 3 years of experience in application development (internship experience does not apply).
  • At least 1 year of experience in big data technologies.
Preferred Qualifications
  • 5+ years of experience in application development including Python, SQL, Scala, or Java.
  • 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
  • 3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
  • 2+ year experience working on real-time data and streaming applications.
  • 2+ years of experience with NoSQL implementation (Mongo, Cassandra).
  • 2+ years of data warehousing experience (Redshift or Snowflake).
  • 3+ years of experience with UNIX/Linux including basic commands and shell scripting.
  • 2+ years of experience with Agile engineering practices.
What We Offer

As a Senior Data Engineer at Capital One, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and develop your skills in big data technologies.

The estimated annual salary for this role is $165,100 - $188,500 based on location and experience.

In addition to competitive compensation, we offer a comprehensive benefits package, including health, financial, and other perks that support your total well-being.



  • New York, New York, United States S&P Global Full time

    About the Role:S&P Global seeks a skilled Data Engineer to join its Data Lake team. The ideal candidate will have expertise in designing and building data pipelines with an emphasis on scale, performance, and reliability. This role is responsible for providing technical expertise in the areas of design and implementation of Data Lake solutions powered by...


  • New York, New York, United States HexaQuEST Global, Inc. Full time

    HexaQuEST Global, Inc. is seeking a highly skilled Senior Big Data Engineer to join our team.We are offering an estimated salary of $120,000 per year for this role in the United States.About UsAs a leading provider of innovative solutions, HexaQuEST Global, Inc. prides itself on its commitment to excellence and customer satisfaction.Job DescriptionThis is a...


  • New York, New York, United States Capital One Full time

    Job OverviewCapital One is seeking a highly experienced Senior Lead Data Engineer to join our Card Data Organization & Data Foundations group. As a key member of this team, you will have the opportunity to drive major transformations within the organization and be on the forefront of driving innovation in big data technologies.About the RoleWe are looking...


  • New York, New York, United States Amazon Full time

    As a Sr. Data Engineer on the Amazon Publisher Monetization team, you will play a key role in shaping the future of monetization for Amazon's advertising-supported publishers.About This RoleThis is an exceptional opportunity to work with large datasets and design scalable real-time analytical solutions that meet the rapidly growing demands of rich data.The...


  • New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a highly skilled Cloud Engineering Lead to spearhead the development of our big data and streaming solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based infrastructure.Job DescriptionAs a Cloud Engineering Lead, you will work closely...

  • Senior Data Engineer

    16 hours ago


    New York, New York, United States Ichor Strategies Full time

    Job SummaryWe are looking for an experienced Senior Data Engineer - Enterprise Solutions to join our team at Ichor Strategies. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems that meet the needs of our clients.Key Responsibilities:Design and implement data architectures...


  • New York, New York, United States Data Intellect Full time

    About This RoleWe are seeking a highly skilled Senior Financial Data Developer to join our team. In this role, you will be responsible for developing and maintaining complex financial data systems using kdb+.This is an exciting opportunity for someone who is passionate about working with data and wants to make a real impact in the financial industry.


  • New York, New York, United States Capital One Full time

    OverviewCapital One is seeking a Senior Data Engineer to join our team. As a key member of our data engineering group, you will play a crucial role in designing, developing, and deploying scalable data solutions using cutting-edge technologies.SalaryThe estimated annual salary for this position is $165,100 - $188,500, depending on location. This includes...


  • New York, New York, United States Diverse Lynx Full time

    About UsDiverse Lynx LLC is an Equal Employment Opportunity employer committed to fostering a diverse and inclusive workforce.Job SummaryWe are seeking an experienced Senior Big Data Engineer with expertise in cloud native architecture to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable...


  • New York, New York, United States CyberTec Full time

    We are CyberTec, a leading technology company seeking a highly skilled Big Data Architect with DevOps expertise to join our team. Job Title: Big Data Architect with DevOpsEstimated Salary: $120,000 - $180,000 per annumAs a key member of our engineering team, you will be responsible for designing and implementing scalable data architectures using industry...


  • New York, New York, United States Data Intellect Full time

    Data Intellect is a leading data and technology consultancy firm, specialized in financial and capital markets technology solutions. We pride ourselves on our ability to turn complex data problems into smart data solutions.As a highly skilled Junior kdb+ Developer, you will play a key role in delivering projects on time and on budget. Your primary...


  • New York, New York, United States Conde Nast Full time

    About the Role:Conde Nast is seeking a seasoned Data Solutions Engineer to lead our global data engineering & data warehousing practice. As a key member of our engineering team, you will drive the development of a customer 360 initiative across our revenue lines of business.Responsibilities:Lead and manage a diverse team of data engineers, fostering a...


  • New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...

  • Big Data Architect

    3 days ago


    New York, New York, United States Ichor Strategies Full time

    About the PositionWe are seeking a highly skilled Big Data Architect & Engineering Manager to join our team at Ichor Strategies. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems that meet the needs of our clients.Key Responsibilities:Design and implement data architectures...


  • New York, New York, United States S&P Global Full time

    About the Role:At S&P Global, we're seeking a highly skilled Data Lake Architect to join our Data Lake team. The successful candidate will be responsible for designing and building data pipelines with an emphasis on scale, performance, and reliability.Key Responsibilities:Design and implement data pipelines using Databricks on AWS cloud.Partner with data...


  • New York, New York, United States FleishmanHillard Full time

    About the RoleMethods+Mastery is seeking an experienced Data Engineer to join our talented team. The ideal candidate will have a strong background in building scalable data pipelines that process unstructured text data.ResponsibilitiesDesign and Build Scalable Data Pipelines: Develop and maintain efficient data pipelines, ETL processes, and data integration...


  • New York, New York, United States Capital One Full time

    Capital One is seeking a Senior Data Architect and Engineer to drive the design and implementation of high-performance data ecosystems that support real-time, intelligent experiences for its Risk Management functions.This role involves shaping the Risk Management Data domains that will drive standardized data assets and products. The ideal candidate will...


  • New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...


  • New York, New York, United States Eliassen Group Full time

    We are currently hiring a Senior Data Analytics Engineer to join our team at Eliassen Group. This is a full-time, 100% remote role that requires designing, architecting, developing, scaling, and improving next-generation data analytics platforms using advanced big data technologies.The ideal candidate will have 5+ years of experience in designing,...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. seeks a highly skilled Data Engineer to design, build, and maintain scalable ETL pipelines using Python, SQL, and Apache Airflow in any cloud environment.In this role, you will collaborate with data scientists to implement machine learning models (MLOps) in production and partner with business units to identify and fulfill...