Data Engineer

1 month ago


New York, United States Silver Search, Inc Full time
Data Engineer New York, NY

Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards**
Contract-to-hire

Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building and maintaining data processing frameworks and will work closely with the data science and visualization teams. The successful engineer will be responsible for data architecture and pipeline design and must have strong skills in data modelling and query optimization.  Our clients environment is state of the art They are continuously incorporating continually evolving technologies, including the AWS stack, Salesforce, SAS, etc.

Responsibilities:

  • Design, build and maintain all facets of Data Pipelines for Data Engineering team.
  • Lead the development of ETL processes to integrate data from a wide variety of sources including S3 objects, Kafka, REST APIs and SQL Server
  • Refine and enhance the in-house built Python data management framework
  • Develop strong relationships with key business sponsors and other technology teams to collaboratively solve complex problems

Requirements:

  • 5+ years of Data Engineering or Data Lake Architect experience on the AWS platform
  • Deep knowledge of AWS Services such as S3, EMR, Redshift, Data Pipeline, RDS, DynamoDB, STEP functions, Lambda
  • Advanced SQL knowledge for Redshift
  • ETL process design and implementation on AWS
  • Streaming data processing (Kafka)
  • Bachelors degree or higher in Computer Science, Information Systems, Information Technology, or related Engineering field


  • New York, United States Onset Data Loggers Full time

    Based in Bourne, Massachusetts, for more than 40 years Onset has been dedicated to designing and producing high-quality data loggers. Our manufacturing processes ensure precision and reliability in data logging technology. Onset's products are trusted worldwide for capturing critical data, making them an essential choice for professionals and organizations...

  • Data Engineer

    2 weeks ago


    New York, United States The New York Public Library Full time

    Overview This is a temporary four-year grant-funded position. The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you’ll have the opportunity to contribute to new and existing data pipelines that help the library understand our activities and support many staff members in making important decisions...

  • Data Engineer

    7 days ago


    New York County, New York, United States Codex Tech-IT Full time

    Codex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and accuracy, our Data Engineers play a crucial role in ensuring our clients have...

  • Data Engineer

    7 days ago


    New York, United States New York Blood Center Full time

    Data EngineerJob Locations US-NY-New YorkJob ID 2024-6284Category Information TechnologyMinimum Rate USD $100,000.00/Yr.Maximum Rate USD $115,000.00/Yr.Work Location Type HybridOverviewAt New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge...

  • Data Engineer

    2 weeks ago


    New York, United States Numeus Full time

    Numeus is a diversified digital asset investment firm built to the highest institutional standards, combining synergistic businesses across Trading, Alpha Strategies, Asset Management, and Venture Capital . Numeus was founded by successful executives with decades of experience across the finance, blockchain and technology industries, with a shared passion...

  • Data Engineer

    2 weeks ago


    New York, United States NR Consulting Full time

    Data Engineer SME Location: NYC / Charlotte (Candidate should be open for hybrid work model) Duration: 12 months Responsibilities: A background in financial services, investment banking, regulated sectors and large enterprise DevOps and Agile engineering practitioner with experience of test driven development Ability to work independently on specialized...

  • Data Engineer

    3 weeks ago


    New York, United States Net2Source Inc. Full time

    W2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...

  • Data Engineer

    3 weeks ago


    New York, United States Net2Source Inc. Full time

    W2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...


  • New York, New York, United States Domino Data Lab Full time

    Who we areDomino Data Lab powers model-driven businesses with its leading Enterprise AI platform trusted by over 20% of the Fortune 100. Domino accelerates the development and deployment of data science work while increasing collaboration and governance. With Domino, enterprises worldwide can develop better medicines, grow more productive crops, build better...

  • Data Engineering

    1 month ago


    New York, United States Understood Full time

    **About Understood**: Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and community so they can thrive. Having a shared commitment to our values is a key factor...

  • Data Engineer

    4 weeks ago


    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    1 week ago


    New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...

  • Data Engineer

    4 weeks ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • DevOps Engineer

    2 weeks ago


    New York, United States Creative Data Resources Full time

    Duties: Hybrid Schedule Client is seeking a hands-on DevOps Engineer who will lead the way for our DevOps environment. The ideal engineer will bring their experiences, best practices, and a collaborative attitude to help drive DevOps initiatives. To be successful, one must effectively communicate with our trade support and operations team to orchestrate...

  • Data Engineer

    2 weeks ago


    New York, United States Jane Street Full time

    About the Position We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...

  • Data Engineer

    3 weeks ago


    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...

  • Data Engineer

    3 weeks ago


    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...

  • Data Engineer

    2 weeks ago


    New York, United States ExodusPoint Full time

    ABOUT EXODUSPOINT ExodusPoint Capital, founded in 2017 by Michael Gelband and Hyung Lee, began managing investor capital in 2018. The firm employs a global multi-strategy investment approach, seeking to deliver compelling asymmetric returns by combining complementary liquid strategies managed by experienced investment professionals within a robust risk...

  • Data Engineer

    4 weeks ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...

  • Data Engineer

    4 minutes ago


    New York, United States Open Systems Technologies Full time

    An international law firm is looking for a Data Engineer to join their team in NYC. Compensation: $115-160kThe Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and...