Data Processing Engineer

2 weeks ago


New York, New York, United States Inficare Full time
Job Title: Data Processing Engineer

Location: New York, USA (Hybrid)

Job Type: Contract

Job Duration: Long Term

Description:

Job Overview:
The ideal candidate will be a skilled data processing engineer with experience in Scala and Core Java.

In this role, you will develop and maintain data processing applications using Spark and Scala. You will collaborate with cross-functional teams to understand data requirements and design efficient solutions. You will also implement test-driven deployment practices to enhance the reliability of application.

Mandatory Skills:
  • Strong knowledge of Scala programming language
  • Excellent problem-solving and analytical skills
  • Proficiency in Spark, including the development and optimization of Spark applications
  • Ability to troubleshoot and debug performance issues in Spark
  • Understanding of design patterns and data structure for efficient data processing

Salary:$120,000 - $150,000 per year (based on location and experience)

Benefits:
  • Comprehensive health insurance
  • Retirement savings plan
  • Flexible work hours


  • New York, New York, United States Hudson Data Full time

    Hudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...


  • New York, New York, United States Hudson Data Full time

    Hudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...

  • Kdb+ Data Engineer

    1 day ago


    New York, New York, United States Data Intellect Full time

    Job OverviewData Intellect is a data and technology consultancy firm that specializes in financial and capital markets technology solutions. We're seeking an experienced Kdb+ Developer to join our team.Salary:$80,000 - $110,000 per annum (dependent on experience)Key ResponsibilitiesWork with business users to define requirements for new application...


  • New York, New York, United States CapB InfoteK Full time

    Data Engineering RoleCapB InfoteK has an exciting opportunity for a seasoned ETL Hadoop engineer to contribute to our data engineering team. We are looking for someone with extensive experience in Hadoop ecosystem, Unix shell scripting, and data warehousing ETL tools MPP database systems. As a key member of our team, you will be responsible for analyzing...


  • New York, New York, United States PitchBook Data Full time

    OverviewPitchBook Data is a leading provider of data and analytics solutions. We're seeking an experienced Technical Product Lead to join our team.Job DescriptionWe're looking for a highly skilled Technical Product Lead to oversee the integration of AI/ML technologies into our data collection processes. The ideal candidate will have a strong background in...


  • New York, New York, United States The Data Sherpas Full time

    Job Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...


  • New York, New York, United States Simon Data Full time

    About UsSIMON DATA is a forward-thinking customer experience orchestration platform designed to disrupt the marketing technology and marketing cloud category. Our unique approach empowers businesses to develop one-to-one relationships with their customers without building a bespoke in-house data infrastructure.At SIMON, we believe that business success...


  • New York, New York, United States Simon Data Full time

    About UsSIMON Data is an enterprise customer data platform empowering marketers to create personalized data-driven experiences for their customers. Founded in 2015 by a team of successful serial entrepreneurs, we're a scrappy problem-solving company that believes in tackling big challenges with disruptive thinking and giving our customers the support they...


  • New York, New York, United States Data Intellect Full time

    About Data IntellectWe're dedicated to harnessing the power of human intellect and collaboration to drive innovative solutions for complex challenges.Our approach is guided by the principles of Humility, Can-do Attitude, and Togetherness, which form the foundation of our [DI] code.Compensation Package: $150,000 - $200,000 per annum, commensurate with...


  • New York, New York, United States Condé Nast Full time

    About the RoleThis is an exciting opportunity to join our Data Solutions Engineering team as a Data Engineer. The successful candidate will have a degree in Computer Science or a related field and 2.5+ years of experience in distributed data processing. Proficiency in SQL and experience with data modeling, batch data pipeline design, and implementation are...

  • Data Engineer

    7 days ago


    New York, New York, United States Condé Nast Full time

    Company OverviewCondé Nast is a renowned global media company with a rich history of producing high-quality content. With a footprint spanning over 1 billion consumers across 32 territories, the company's portfolio includes some of the world's most respected and influential media properties, such as Vogue, Vanity Fair, Glamour, and Wired.Job DescriptionWe...


  • New York, New York, United States TechnoGen Full time

    Are you an expert in data processing and engineering? Do you want to join a dynamic team at TechnoGen in Brooklyn, NY? We are seeking a Senior Data Engineer to lead our Data Infrastructure team in building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines.As a Senior Data Engineer, you will be responsible for...

  • Data Engineer

    2 weeks ago


    New York, New York, United States TechnoGen Full time

    Data Engineering Role Overview:">We are seeking a talented Data Engineer to join our team at TechnoGen. As a key member of our CIO team, you will be responsible for designing and implementing database architecture, creating and supporting SQL SSIS packages, and improving database performance.">Duties:">">Create and support SQL SSIS packages for ETL and other...


  • New York, New York, United States The Custom Group of Companies Full time

    Job Description:The Custom Group of Companies is seeking a highly skilled Data Engineering Expert to join our team. In this role, you will design, develop, and maintain data pipelines in Databricks on an AWS 6 ecosystem with Delta Lake, Python, SQL, and Starburst as the technology stack.As a Senior Data Engineer, you will be responsible for establishing data...

  • Process Engineer

    2 days ago


    New York, New York, United States AIR COMPANY Full time

    Transform the future of carbon removal with AIR COMPANY.About the RoleWe are seeking a skilled Process Engineer, Chemical Reactor Specialist, to join our team in Brooklyn, NY. This role will contribute to advancing our technology through detailed 1-D and 2-D reactor modeling, experimental pilot plants data acquisition, analysis, evaluation, and process...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States Rhode Island Blood Center Full time

    Lead Data EngineerAt Rhode Island Blood Center, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and leading initiatives for optimizing databases and data pipelines.Key Responsibilities:Lead the architectural design and optimization of...

  • Cloud Data Engineer

    1 month ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...


  • New York, New York, United States People Data Labs Full time

    Company OverviewPeople Data Labs simplifies data collection and standardization so our customers can focus on building innovative data solutions. We integrate thousands of compliant datasets into a single source of truth.This role involves taking ownership of person data products and driving innovation in new data solutions. The ideal candidate will have...


  • New York, New York, United States UnitedMasters | Translation Full time

    Company OverviewUnitedMasters, a leading marketplace for cultural capital, connects independent artists and brands to drive transformational growth. With backing from Alphabet, Andreessen Horowitz, and Apple, we're reimagining how stories are told and cultures are pushed forward.Our team consists of musicians, marketers, engineers, and storytellers with...


  • New York, New York, United States HealthPlanOne Full time

    Job DescriptionThis is an exciting opportunity to join our team as a Data Engineer and contribute to the design, development, and maintenance of our data infrastructure and pipelines. As a key member of our data engineering team, you will work closely with data scientists, analysts, and other stakeholders to ensure the accuracy, accessibility, and security...