Senior Data Engineer

4 days ago

Poughkeepsie, NY, United States Quant Corp Full time
Senior Data Engineer

This is a remote position.

The Senior Data Engineer is responsible for preparing data for modeling and predictive analytics. This includes integrating new data sources, performing pre-processing operations such as data cleansing, feature engineering, statistical analysis, and sampling, as well as managing a wide range of ETL-related tasks. The ideal candidate should demonstrate strong software development practices and a continuous learning mindset. Proficiency in Python, machine learning, data storage solutions, and ETL pipeline development is essential.

Job Responsibilities
  • Design and implement scalable data pipelines using SQL, Airflow, Python, Alteryx, and cloud-based technologies
  • Lead the integration of data sources and design data models to meet complex business needs
  • Ensure data quality by identifying issues and collaborating with source owners to implement preventive measures
  • Deploy and optimize machine learning models, statistical methods, and analytics programs
  • Research new data acquisition methods and innovative uses of existing data to drive business value
  • Integrate advanced data management tools and software engineering practices to enhance system performance
  • Build and maintain high-quality datasets to support decision-making and data-driven products
  • Develop custom software components and analytics applications aligned with business requirements
  • Implement strategies to improve data reliability, efficiency, and scalability
  • Drive innovation through R&D initiatives within the data engineering team
  • Collaborate cross-functionally to build a flexible, scalable, and high-performing data platform
  • Maintain clear and comprehensive technical documentation for ongoing projects
Requirements
  • Proficient in Python, with hands-on experience in data analysis and automation
  • Skilled in using Dataiku for advanced data workflows and machine learning applications
  • Familiarity with cloud services like AWS or Azure
  • Strong background in data visualization and statistical analysis to drive data-driven insights
  • Practical experience with machine learning models and managing large-scale (big data) projects
  • Solid understanding of programming concepts and data architecture principles
  • Capable of defining and tracking meaningful metrics for data and analytics initiatives
  • Excellent analytical skills with a balance of quantitative rigor and qualitative insight
  • Highly proficient in Microsoft Office and Google Suite for documentation and collaboration
  • Bachelor's and/or Master's degree in Computer Science or a related technical field
  • Agile, innovative, and solutions-oriented thinker with a strong sense of ownership
  • Collaborative and dependable team player, effective in multicultural and diverse environments

  • Senior Data Engineer

    4 days ago

    Poughkeepsie, NY, United States Leadtech Full time

    Senior Data Engineer We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP). You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and performance across our ETL/ELT processes. You...

  • Senior Data Engineer

    4 days ago

    Poughkeepsie, NY, United States Leadtech Full time

    Senior Data Engineer We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP). You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and performance across our ETL/ELT processes. You...

  • Senior Data Engineer

    4 days ago

    Poughkeepsie, NY, United States Leadtech Full time

    Senior Data Engineer We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP). You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and performance across our ETL/ELT processes. You...

  • Senior Data Engineer

    4 days ago

    Poughkeepsie, NY, United States Leadtech Full time

    Senior Data Engineer We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP). You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and performance across our ETL/ELT processes. You...

  • Senior QA Engineer III

    1 week ago

    Poughkeepsie, NY, United States Mpower Health Full time

    Senior QA Engineer HaloMD specializes in Independent Dispute Resolution (IDR) through The No Surprises Act and state regulations for out-of-network healthcare providers, leveraging advanced technology and deep industry expertise to secure optimized reimbursements. We are seeking a Senior QA Engineer with strong experience testing full stack and SaaS...

  • Senior QA Engineer III

    1 week ago

    Poughkeepsie, NY, United States Mpower Health Full time

    Senior QA Engineer HaloMD specializes in Independent Dispute Resolution (IDR) through The No Surprises Act and state regulations for out-of-network healthcare providers, leveraging advanced technology and deep industry expertise to secure optimized reimbursements. We are seeking a Senior QA Engineer with strong experience testing full stack and SaaS...

  • Senior Software Engineer

    2 days ago

    Poughkeepsie, NY, United States Abacus Full time

    Senior Software Engineer Job Requisition Number: OMF-REQ-0003523 Number of Resources: 4 Start Date: 3/10/2025 End Date: 9/9/2025 Work Location: MD Remote Location (MD Remote Location, Virtual, MD 00000) Type of Service: Contingent Workforce - Technology Job Title Senior Software Engineer Job Description We are currently seeking a Software Engineering...

  • Senior Software Engineer

    3 hours ago

    Poughkeepsie, NY, United States Abacus Full time

    Senior Software Engineer Job Requisition Number: OMF-REQ-0003523 Number of Resources: 4 Start Date: 3/10/2025 End Date: 9/9/2025 Work Location: MD Remote Location (MD Remote Location, Virtual, MD 00000) Type of Service: Contingent Workforce - Technology Job Title Senior Software Engineer Job Description We are currently seeking a Software Engineering...

  • Senior Software Engineer

    1 week ago

    Poughkeepsie, NY, United States Curri Full time

    Senior Software Engineer The role: We're looking for a Senior Software Engineer to join our Routes Empowered Product Team (EPT) the team responsible for building Curri's route planning SaaS platform. This is a high-impact role where you'll drive the evolution of one of Curri's most mission-critical systems, used by major enterprise clients to plan and...

  • Senior Software Engineer

    2 weeks ago

    Poughkeepsie, NY, United States Creative Chaos Full time

    Senior Software Engineer For Node A Senior Software Engineer for Node is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A senior software engineer makes sure that the functionality, security and...