Data Engineer
2 months ago
Hybrid role in New York City. Our client, a major US-based Sports & Entertainment organization, is looking to engage an experienced Data Engineer to join a group responsible for developing and extending their next generation data platform. This platform will enable fan to access personalized content and related offerings through advanced analytics. The platform is being built leveraging state of the art cloud components and capabilities.
In this role, you will be responsible for building scalable solutions for data ingestion, processing and analytics that crosscut data engineering, architecture and SW development. You will be involved with designing and implementing cloud-native solutions for ingestion, processing and compute at scale
Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $70 - $80 / hr. w2
Responsibilities
Design, implement, document and automate scalable production grade end to end data pipelines including API and ingestion, transformation, processing, monitoring and analytics capabilities while adhering to best practices in software development.
Build data-intensive application solutions on top of cloud platforms such as AWS, leveraging state-of-the-art solutions including distributed compute, lake house, real-time streaming while enforcing best practices for data modeling and engineering.
Work with infrastructure engineering team to setup infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Experience Requirements
Bachelor’s degree computer science or related field required.
Minimum of 2 years related experience with track record of building production software.
Hands-On experience building and delivering cloud native data solutions (AWS preferred)
Solid Computer Science fundamentals with experience across a range of disciplines, with one or more area of deep knowledge and experience in an advanced programming language.
Working experience of distributed processing systems including Apache Spark.
Hands-On experience with lake house architecture, open table formats such as Hudi, orchestration frameworks such as Airflow, real time streaming with Apache Kafka and container technology.
Deep understanding of best software practices and application of them in data engineering.
Familiarity with data science and machine learning workflows and frameworks
Ability to work independently and collaborate with cross-functional teams to complete projects.
Experience leading integration of technical components with other teams.
-
Sr. Azure Data Engineer
6 months ago
New York, United States Hudson Data Full timeJob Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...
-
Cloud Data Engineer
5 days ago
New York, New York, United States The Data Sherpas Full timeAbout The Data SherpasWe are a team of highly skilled and motivated engineers assisting clients throughout their cloud journey. Our expertise lies in cloud, data, and application services.Job OverviewThis is an exciting opportunity for self-motivated and data-driven engineers to support our clients' data platform upgrades. Ideal candidates will have a solid...
-
Cloud Data Engineer Expert
3 weeks ago
New York, New York, United States Hudson Data Full timeHudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...
-
Azure Data Engineering Lead
4 weeks ago
New York, New York, United States Hudson Data Full timeHudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...
-
Azure Data Engineering Expert
3 days ago
New York, New York, United States Hudson Data Full timeJob DescriptionHudson Data is seeking an experienced Azure Data Engineer to design, implement, and maintain data solutions using Azure cloud services. The ideal candidate will develop ETL processes, optimize data pipelines, and ensure data quality and security. ResponsibilitiesDevelop ETL processes and optimize data pipelinesEnsure data quality and...
-
Kdb+ Data Engineer
3 weeks ago
New York, New York, United States Data Intellect Full timeJob OverviewData Intellect is a data and technology consultancy firm that specializes in financial and capital markets technology solutions. We're seeking an experienced Kdb+ Developer to join our team.Salary:$80,000 - $110,000 per annum (dependent on experience)Key ResponsibilitiesWork with business users to define requirements for new application...
-
GCP Data Science Engineering Lead
4 weeks ago
New York, New York, United States The Data Sherpas Full timeJob Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...
-
Data Solutions Strategist
3 weeks ago
New York, New York, United States Simon Data Full timeAbout UsSIMON DATA is a forward-thinking customer experience orchestration platform designed to disrupt the marketing technology and marketing cloud category. Our unique approach empowers businesses to develop one-to-one relationships with their customers without building a bespoke in-house data infrastructure.At SIMON, we believe that business success...
-
New York, New York, United States Entertainment Data Oracle (EDO) Full timeEntertainment Data Oracle (EDO)Who We AreWe are the TV outcomes company, a leading platform measuring Convergent TV advertising. Combining real-time engagement signals with world-class decision science, we maximize creative and media performance for modern marketers at leading brands, TV networks, entertainment studios, and ad agencies.We provide...
-
Technical Account Manager
3 weeks ago
New York, New York, United States Simon Data Full timeAbout UsSIMON Data is an enterprise customer data platform empowering marketers to create personalized data-driven experiences for their customers. Founded in 2015 by a team of successful serial entrepreneurs, we're a scrappy problem-solving company that believes in tackling big challenges with disruptive thinking and giving our customers the support they...
-
Data Product Strategist
3 weeks ago
New York, New York, United States PitchBook Data Full timeOverviewPitchBook Data is a leading provider of data and analytics solutions. We're seeking an experienced Technical Product Lead to join our team.Job DescriptionWe're looking for a highly skilled Technical Product Lead to oversee the integration of AI/ML technologies into our data collection processes. The ideal candidate will have a strong background in...
-
Data Solutions Architect
4 weeks ago
New York, New York, United States Data Intellect Full timeAbout Data IntellectWe're dedicated to harnessing the power of human intellect and collaboration to drive innovative solutions for complex challenges.Our approach is guided by the principles of Humility, Can-do Attitude, and Togetherness, which form the foundation of our [DI] code.Compensation Package: $150,000 - $200,000 per annum, commensurate with...
-
Data Innovation Lead
10 hours ago
New York, New York, United States The Data Sherpas Full timeJob DescriptionThe Data Sherpas is seeking a talented GCP Machine Learning Engineer to join our team. In this role, you will play a key part in driving technology innovation and delivering world-class machine learning solutions. Your primary focus will be on integrating GCP-native and third-party technologies to build scalable data infrastructures, focusing...
-
Data Scientist
3 days ago
New York, New York, United States Data Intellect Full timeCompany Overview">Data Intellect is a leading data and technology consultancy firm. We specialize in providing financial and capital markets technology solutions to our clients.">Skillset">">Kdb+">Python">Cloud Development">Software Development Methodologies">Systems Development Life Cycle">People Management">Technical Leadership">">Responsibilities">We are...
-
Data Engineer
4 weeks ago
New York, United States Mitchell Martin Full timeTitle: Data Engineer II Location: Remote Description: The Data Engineer II will play a vital role in designing and building scalable, efficient, and robust data pipelines to support reporting and analytics needs. The role involves working with modern data engineering technologies to create solutions that feed various analytics platforms, ensuring alignment...
-
Data Engineer
1 hour ago
New York, United States Atyeti Inc Full timeTitle : Data Engineer Location : New York, NY Hiring Mode : Full Time W-2 Qualifications: Data Engineering, Data Modeling, and Extract Transform Load (ETL) skills Proven experience(3 to 8 years) as a Data Engineer, with a focus on Python Experience in Dataproc, Big Query, Big Table Data Warehousing and Data Analytics skills Experience in working with...
-
Head of Data Solutions
4 weeks ago
New York, New York, United States People Data Labs Full timeCompany OverviewPeople Data Labs simplifies data collection and standardization so our customers can focus on building innovative data solutions. We integrate thousands of compliant datasets into a single source of truth.This role involves taking ownership of person data products and driving innovation in new data solutions. The ideal candidate will have...
-
Senior Data Strategist
3 weeks ago
New York, New York, United States People Data Labs Full timeJob DescriptionAbout Us: At People Data Labs, we do the heavy lifting of data collection and standardization, allowing our customers to focus on building innovative, compliant data solutions.You will own our person data, which represents a significant portion of our customer base, and work cross-functionally in a fast-paced environment to champion a shared...
-
Data Engineer
1 hour ago
New York, United States Atyeti Inc Full timeTitle : Data Engineer Location : New York, NYHiring Mode : Full Time W-2Qualifications: Data Engineering, Data Modeling, and Extract Transform Load (ETL) skillsProven experience(3 to 8 years) as a Data Engineer, wit...
-
Data Engineer
1 week ago
New York, United States VORKIS knows what employer wants Full timeJob DescriptionJob DescriptionAbout Company provides cutting-edge trade surveillance technology that protects investors, enhances transparency, and ensures regulatory compliance across traditional financial assets and crypto markets. The RoleWere looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in...