Data Engineer

2 weeks ago


New York, United States Eliassen Group Full time

Hybrid role in New York City. Our client, a major US-based Sports & Entertainment organization, is looking to engage an experienced Data Engineer to join a group responsible for developing and extending their next generation data platform. This platform will enable fan to access personalized content and related offerings through advanced analytics. The platform is being built leveraging state of the art cloud components and capabilities.


In this role, you will be responsible for building scalable solutions for data ingestion, processing and analytics that crosscut data engineering, architecture and SW development. You will be involved with designing and implementing cloud-native solutions for ingestion, processing and compute at scale


Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.


Rate: $70 - $80 / hr. w2


Responsibilities

  • Design, implement, document and automate scalable production grade end to end data pipelines including API and ingestion, transformation, processing, monitoring and analytics capabilities while adhering to best practices in software development.
  • Build data-intensive application solutions on top of cloud platforms such as AWS, leveraging state-of-the-art solutions including distributed compute, lake house, real-time streaming while enforcing best practices for data modeling and engineering.
  • Work with infrastructure engineering team to setup infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.


Experience Requirements

  • Bachelor’s degree computer science or related field required.
  • Minimum of 2 years related experience with track record of building production software.
  • Hands-On experience building and delivering cloud native data solutions (AWS preferred)
  • Solid Computer Science fundamentals with experience across a range of disciplines, with one or more area of deep knowledge and experience in an advanced programming language.
  • Working experience of distributed processing systems including Apache Spark.
  • Hands-On experience with lake house architecture, open table formats such as Hudi, orchestration frameworks such as Airflow, real time streaming with Apache Kafka and container technology.
  • Deep understanding of best software practices and application of them in data engineering.
  • Familiarity with data science and machine learning workflows and frameworks
  • Ability to work independently and collaborate with cross-functional teams to complete projects.
  • Experience leading integration of technical components with other teams.


  • Data Engineer

    4 weeks ago


    New York, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    6 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Data Engineer

    4 weeks ago


    New York, New York, United States CCG Business Solutions, LLC Full time

    Job DescriptionCCG Business Solutions, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.The ideal candidate will have a strong background in data engineering, with experience in designing and implementing data...

  • Data Engineer

    2 weeks ago


    New York, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Data Engineer

    1 week ago


    New York, United States SimplifyVMS Full time

    As a Data Engineer, you will be responsible for building and optimizing data pipelines, architectures, and datasets for effective data analysis and machine learning applications. Responsibilities: Developing, constructing, testing, and maintaining architectures for data ingestion, processing, and extraction. Designing and implementing data pipelines to...

  • Data Engineer

    4 weeks ago


    New York, United States hackajob Full time

    Exciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...

  • Data Engineer

    6 months ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    2 weeks ago


    New York, United States Atlas Search Full time

    ResponsibilitiesCloud Data Engineer is responsible for building and maintaining data pipelines within an AWS cloud environment. Work heavily with MongoDB and Snowflake as well as Cypress, Selenium and Kafka. Requirements3+ years of experience in the Data Engineering space working heavily with Public cloud solutions.Experience with MongoDB or...

  • Data Engineer

    2 days ago


    New York, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in NEW YORK, New York. This role involves working in the industry, specifically focusing on AWS Technologies, Python, NoSQL, and Snowflake. The workplace is dynamic and requires someone who can efficiently handle data-related tasks. Responsibilities:• Build efficient...


  • New York, United States Tek Leaders Inc Full time

    Title: Healthcare Data Engineer Duration: 12 Months Location: 100% Remote (NYC NY) Essential skills for the role: Minimum of 35 years of experience in Healthcare Domain Minimum of 10 years of experience in Data Engineering. Required technical skills: Python PySpark SQL AWS Required Domain: Healthcare/Insurance Candidate is expected to have...

  • Data Engineer

    6 months ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...


  • New York, United States The Data Sherpas Full time

    J ob Summary : As a GCP Machine Learning Engineer, you will drive technology innovation by delivering world-class machine learning solutions. You will integrate GCP-native and third-party technologies to build scalable data infrastructures, focusing on modernizing data pipelines and machine learning platforms. You will collaborate with implementation teams...

  • Data Engineer

    2 weeks ago


    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionData Engineer$100k - $140kWho We Are.Wynd Labs is an early-stage startup that is on a mission to make public web data accessible for AI through contributions to Grass.Grass is a network sharing application that allows users to share their unused bandwidth. Effectively, this is a residential proxy network that directly rewards...


  • New York, United States Tek Leaders Inc Full time

    Title: Data Catalog Engineer We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance. Technical Skills Required: Overall 10 Years of IT Experience with Proficiency in AWS services including...

  • Data Engineer

    3 weeks ago


    new york city, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    3 weeks ago


    new york city, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...


  • New York, New York, United States Encora Full time

    About the RoleWe're seeking a skilled Data Engineer to join our team at Encora. As a Data Engineer, you will be responsible for ensuring that data is received, verified, transformed, stored, and accessible to the team.Key ResponsibilitiesBuild and promote data pipeline management and database maintenanceGather and prepare data to be analyzed and worked on,...


  • New York, New York, United States Acquired Data Solutions Full time

    Job Title: Senior Security Systems EngineerWe are seeking a highly skilled Senior Security Systems Engineer to join our team at Acquired Data Solutions, Inc. in Egg Harbor, NJ.Job Summary:The successful candidate will be responsible for performing in-depth engineering analysis of security-related systems to determine their potential for further development,...

  • AWS Data Engineers

    3 weeks ago


    New York, United States RIT Solutions, Inc. Full time

    Title- AWS Data Engineers Location- Onshore/Hybrid- 2-3 days a week onsite (NY/NJ) Duration- 12 Months We are seeking a highly skilled and experienced AWS Data Engineer to join our team . This role is ideal for professionals with a robust background in data engineering and a strong proficiency in AWS technologies. The position offers an opportunity to work...

  • Cloud Data Engineer

    2 weeks ago


    New York, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...