Data Engineer Full time

4 weeks ago


New York, United States Alltake Full time
Job Details:

Check out the role overview below If you are confident you have got the right skills and experience, apply today.

Job Description:

We are looking for a skilled Data Engineer with 6-8 years of experience in data management and processing to join our growing team. The ideal candidate will have experience in working with big data ecosystems and cloud-based systems and will be responsible for building and optimizing data pipelines, as well as data architecture across various platforms.

Responsibilities:

Design, develop, and maintain scalable data pipelines and architectures for complex data processing.
Work with big data technologies such as Hadoop, Hive, Pig, and Spark to manage large datasets.
Develop and maintain robust data processing solutions in cloud-based environments (AWS, Azure, GCP).
Perform data extraction, transformation, and loading (ETL) processes using SQL and other data query languages.
Collaborate with business owners and stakeholders to understand business needs and provide data-driven insights.
Automate repetitive tasks and optimize data processing using Unix shell scripting or Python.

Basic Qualifications:

3+ years of relevant experience in data engineering roles.
Proven hands-on experience with big data ecosystems, including Hadoop, Hive, Pig, and Spark.
Experience with cloud-based data systems such as AWS, Azure, or GCP.
Strong knowledge of SQL for data extraction and complex query design.
Familiarity with data modeling, ETL pipeline development, and optimization.

Preferred Qualifications:

Proficiency in Unix shell scripting and/or Python for automation.
Strong problem-solving skills with the ability to troubleshoot and optimize processes.
Excellent communication skills, with the ability to work closely with business stakeholders to define key business questions and develop data sets to answer them.

Self-motivated and adaptable, with strong attention to detail
  • Data Engineer

    2 weeks ago


    New York, United States SimplifyVMS Full time

    As a Data Engineer, you will be responsible for building and optimizing data pipelines, architectures, and datasets for effective data analysis and machine learning applications. Responsibilities: Developing, constructing, testing, and maintaining architectures for data ingestion, processing, and extraction. Designing and implementing data pipelines to...

  • Cloud Data Engineer

    2 weeks ago


    New York, United States People Placers Staffing Full time

    Title : Data/Cloud Engineer Location : New York, NY Salary/Pay Rate: $175,000 - $275,000 per year + Bonus Schedule: Full-Time, Partially Remote About the Client: People Placers Staffing is partnering with a $10 billion AUM hedge fund committed to developing state-of-the-art models and technology. They are building a cutting-edge, cloud-based data and...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Python Data Engineer

    4 weeks ago


    New York, United States CloudBC Labs Full time

    Python Data EngineerNew York, Charlotte, NCW2 Role Job Responsibilities: Integration Engineer responsible for daily support and project-based development of credit risk management systems. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. This is an...

  • Lead Data Engineer

    2 months ago


    New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    Center 2 (19050), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    West Creek 1 (12071), United States of America, Richmond, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    114 5th Ave (22114), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    130 5th Ave (22130), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Data Engineer

    6 months ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    4 weeks ago


    New York, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    6 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    Job Summary:Capital One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies. You will work closely with Agile teams to deliver robust cloud-based solutions that drive powerful experiences to help...

  • Senior Data Engineer

    2 months ago


    New York, United States Capital One Full time

    11 West 19th Street (22008), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Lead Data Engineer

    2 months ago


    New York, United States Capital One Full time

    11 West 19th Street (22008), United States of America, New York, New YorkLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Lead Data Engineer

    2 months ago


    New York, United States Capital One Full time

    Locations: VA - McLean, United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Data Engineer

    1 month ago


    New York, New York, United States CCG Business Solutions, LLC Full time

    Job DescriptionCCG Business Solutions, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.The ideal candidate will have a strong background in data engineering, with experience in designing and implementing data...

  • Data Engineer

    6 months ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...


  • New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaDistinguished Data EngineerCome join my teams in Enterprise Data & Machine Learning group to build a highly scalable, well governed, data ecosystem that scales across 1000's of AWS accounts, tens of thousands of database instances and millions of files stored across enterprise. You will have the...