Data Engineering Lead

5 days ago


New York, New York, United States Aligned Solutions Full time
Job Overview

Aligned Solutions is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our engineering team, you will play a crucial role in configuring, maintaining, and enhancing our data processing pipelines and cloud environments.

We are looking for someone with expertise in Python, cloud platforms, APIs, and SQL who can work effectively in a team and demonstrate excellent communication skills.

About the Role
  • Configure and maintain production data processing pipelines
  • Integrate results of Company algorithms with external systems
  • Configure and maintain production and R&D cloud environments
  • Assist data scientists with development and deployment of algorithms
Requirements
  • Technical Expertise: Proficient in Python with a solid understanding of its application in data environments
  • Cloud Platforms: Experience in managing services on major cloud platforms like Google Cloud, AWS, or Azure (experience with all preferred, 2 out of 3 ok)
  • APIs and SQL: Skilled in integrating REST APIs and managing databases using SQL
  • Professional Skills: Demonstrated ability to work effectively in a team, with a proactive attitude and excellent communication skills
Preferred Qualifications
  • Experience processing data with PySpark
  • Experience building B2B integrations
  • Experience with Airflow
  • Experience with multiple cloud service providers
  • Experience with Numpy/Pandas
  • Experience with data visualization
  • Experience with Python app-building libraries such as Streamlit, Dash
  • Experience with BI tools such as Tableau or Looker
Benefits

$120,000 - $180,000 per year, depending on experience, plus benefits package, equity opportunity, health insurance, 401k, paid vacation, professional growth opportunities, and innovative culture.



  • New York, New York, United States Rhode Island Blood Center Full time

    Lead Data EngineerAt Rhode Island Blood Center, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and leading initiatives for optimizing databases and data pipelines.Key Responsibilities:Lead the architectural design and optimization of...


  • New York, New York, United States WebMD Full time

    Job Title:Lead, Data EngineeringJob Summary:The ideal candidate has experience and passion for data engineering with expertise in front-end (data visualization, DAX, Power BI, SQL) or back-end (SSIS, Azure Data Factory, Synapse, data modeling, SQL) of the data engineering world.Responsibilities:Builds software to extract, transform, and load data using SSIS,...


  • New York, New York, United States Capital One Full time

    Job Title: Lead Data EngineerAt Capital One, we are seeking a Lead Data Engineer to join our team. As a Lead Data Engineer, you will have the opportunity to work on a variety of projects, including designing, developing, and implementing technical solutions in full-stack development tools and technologies.Responsibilities:Collaborate with Agile teams to...


  • New York, New York, United States City of New York Full time

    Job Title: Data Engineering Team LeadThe City of New York is seeking a highly skilled Data Engineering Team Lead to join the Information Technology Division (ITD). This role will lead the Data Engineering team in creating and publishing high-quality public datasets, building transparent and automated data pipelines, and developing a data ecosystem.Key...


  • New York, New York, United States Capital One Full time

    Capital One is a leading financial institution committed to driving innovation and customer satisfaction. We are seeking an experienced Cloud Data Engineering Lead to join our team.As a Cloud Data Engineering Lead at Capital One, you will be responsible for designing, developing, and implementing cloud-based data engineering solutions that drive business...


  • New York, New York, United States HR Recruiting Services Full time

    **Job Title:** Cloud Data Engineering Lead**Job Type:** Full-time**Location:** Remote (USA)**Salary:** $150,000 - $200,000 per yearWe are seeking an experienced Cloud Data Engineering Lead to join our team at HR Recruiting Services. The ideal candidate will have a strong background in data engineering and cloud computing, with a proven track record of...


  • New York, New York, United States SysMind Tech Full time

    Job DescriptionAs a Data Engineering Lead at SysMind Tech, you will play a critical role in shaping the company's data architecture and infrastructure. This is a 12+ month remote position that requires strong expertise in data modeling, design, and development.Key ResponsibilitiesDesign and architect tables and data marts for staging, facts, and...


  • New York, New York, United States Capital One Full time

    Job OverviewCapital One seeks a seasoned Data Engineer to lead the transformation of our data landscape. As a key member of our engineering team, you will design, develop, and implement cutting-edge data solutions that drive business growth and customer satisfaction.

  • Data Engineer Lead

    6 days ago


    New York, New York, United States Capital One Full time

    Unlock Career Advancement Opportunities as a Data Engineer LeadCapital One is seeking an experienced Data Engineer Lead to drive innovation and transformation in our technology space. If you are passionate about marrying data with emerging technologies, this role may be the perfect fit for you.About the Role:We are looking for a seasoned professional to lead...

  • Data Engineer Lead

    5 days ago


    New York, New York, United States Diverse Lynx Full time

    We are seeking an experienced Data Engineer Lead to join our team in New York, NY. This is a long-term contract opportunity with a competitive salary.About the RoleIn this role, you will lead the design and implementation of data engineering solutions using AWS technologies such as AWS Lake Formation, AWS Glue Data Catalog, and AWS EMR. You will work closely...

  • Lead Data Architect

    5 days ago


    New York, New York, United States Community Blood Center Full time

    [Data Engineering Lead at Community Blood CenterWe are seeking a highly skilled Data Engineering Lead to join our team at Community Blood Center. The successful candidate will be responsible for designing, implementing, and maintaining our data infrastructure, ensuring high-quality data delivery to support business decisions.Key Responsibilities:Develop and...


  • New York, New York, United States CyberTec Full time

    We are CyberTec, a leading technology company seeking a highly skilled Big Data Architect with DevOps expertise to join our team. Job Title: Big Data Architect with DevOpsEstimated Salary: $120,000 - $180,000 per annumAs a key member of our engineering team, you will be responsible for designing and implementing scalable data architectures using industry...


  • New York, New York, United States Capital One Services, LLC Full time

    About the Role:Capital One is seeking a Lead Data Engineer to join our Card Tech team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test, implement, and support technical...


  • New York, New York, United States Amazon Full time

    As a Sr. Data Engineer on the Amazon Publisher Monetization team, you will play a key role in shaping the future of monetization for Amazon's advertising-supported publishers.About This RoleThis is an exceptional opportunity to work with large datasets and design scalable real-time analytical solutions that meet the rapidly growing demands of rich data.The...

  • Lead Data Scientist

    4 days ago


    New York, New York, United States Henderson Harbor Group Full time

    Job SummaryWe are seeking a highly skilled and technical Lead Machine Learning Engineer to lead the development and deployment of AI/ML solutions across our organization.The ideal candidate will have 3+ years of experience in a lead software engineering or technical leadership role and proven hands-on expertise in machine learning and artificial...


  • New York, New York, United States Capital One Full time

    Drive innovation in data engineering at Capital One, a leader in financial technology. As a Senior Manager, Data Engineering, you will oversee the development of cutting-edge solutions that marry data with emerging technologies.What You'll Do:Collaborate with agile teams to design, develop, test, implement, and support technical solutions in full-stack...

  • Lead Data Architect

    2 days ago


    New York, New York, United States Capital One Full time

    **Job Title:** Lead Data ArchitectCapital One is seeking an experienced Senior Lead Data Engineer to drive a major transformation within our organization.The ideal candidate will have deep experience in machine learning, distributed microservices, and full stack systems.About the Role Collaborate with Agile teams to design, develop, iterate, test,...

  • Lead Data Architect

    6 days ago


    New York, New York, United States Capital One Full time

    Capital One is a leading financial institution seeking an experienced Senior Lead Data Engineer. This role requires a strong technical background in data engineering and the ability to lead a team of developers. The ideal candidate will have experience with big data technologies, cloud computing, and agile engineering practices.About Us:At Capital One, we...


  • New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a highly skilled Cloud Engineering Lead to spearhead the development of our big data and streaming solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based infrastructure.Job DescriptionAs a Cloud Engineering Lead, you will work closely...


  • New York, New York, United States Federal Reserve Bank Full time

    We are seeking a highly skilled Data Engineering Lead to join our team at the Federal Reserve Bank of New York. As a member of our development team in EPC, you will play a crucial role in building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.About the...