Senior Data Engineer

1 day ago

Dayton, OH, United States Curotec Full time
Senior Data Engineer

This is a remote position. We are seeking a Senior Data Engineer to support the ingestion, processing, and synchronization of data across our analytics platform. This role focuses on using Python Notebooks to ingest data via APIs into Microsoft Fabric's Data Lake and Data Warehouse, with some data being synced to a Synapse Analytics database for broader reporting needs. The ideal candidate will have hands-on experience working with API-based data ingestion and modern data architectures, including implementing Medallion layer architecture (Bronze, Silver, Gold) for optimal data organization and quality management, with bonus points for exposure to marketing APIs like Google Ads, Google Business Profile, and Google Analytics 4. This is a remote position. We welcome applicants globally, but this role has a preference for LATAM candidates to ensure smoother collaboration with our existing team.

Key Responsibilities

  • Build and maintain Python Notebooks to ingest data from third-party APIs
  • Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement
  • Store and manage data within Microsoft Fabric's Data Lake and Warehouse using delta parquet file formats
  • Set up data pipelines and sync key datasets to Azure Synapse Analytics
  • Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers
  • Collaborate with developers, analysts, and stakeholders to ensure data availability and accuracy
  • Monitor, test, and optimize data flows for reliability and performance
  • Document processes and contribute to best practices for data ingestion and transformation

Tech Stack You'll Use

  • Ingestion & Processing:
    • Python (Notebooks)
    • PySpark
  • Storage & Warehousing:
    • Microsoft Fabric Data Lake & Data Warehouse
    • Delta Parquet files
  • Sync & Reporting:
    • Azure Synapse Analytics
  • Cloud & Tooling:
    • Azure Data Factory, Azure DevOps

Requirements:

  • Strong experience with Python for data ingestion and transformation
  • Proficiency with PySpark for large-scale data processing
  • Proficiency in working with RESTful APIs and handling large datasets
  • Experience with Microsoft Fabric or similar modern data platforms
  • Understanding of Medallion architecture (Bronze, Silver, Gold layers) and data lakehouse concepts
  • Experience working with Delta Lake and parquet file formats
  • Understanding of data warehousing concepts and performance tuning
  • Familiarity with cloud-based workflows, especially within the Azure ecosystem

Nice to Have:

  • Experience with marketing APIs such as Google Ads or Google Analytics 4
  • Familiarity with Azure Synapse and Data Factory pipeline design
  • Understanding of data modeling for analytics and reporting use cases
  • Experience with AI coding tools
  • Experience with Fivetran, Aribyte, and Riverly

  • Senior Software Engineer

    3 days ago

    Dayton, OH, United States University of Dayton Full time

    Senior Software Engineer Job No: 503239 Work Type: Staff Full Time (1500 hours or greater) Location: Dayton, OH Category: Research Institute Staff Department: Enterprise Software Solut - 250625 Pay Grade: R3 - Exempt Advertised: December 23, 2025 Applications close: January 06, 2026 Position Summary: Ready to advance your career while making a difference?...

  • Senior Software Engineer

    1 week ago

    Dayton, OH, United States University of Dayton Full time

    Senior Software Engineer Job No: 503239 Work Type: Staff Full Time (1500 hours or greater) Location: Dayton, OH Category: Research Institute Staff Department: Enterprise Software Solut - 250625 Pay Grade: R3 - Exempt Advertised: December 23, 2025 Applications close: January 06, 2026 Position Summary: Ready to advance your career while making a difference?...

  • Senior Software Engineer

    7 days ago

    Dayton, OH, United States University of Dayton Full time

    Senior Software Engineer Job No: 503239 Work Type: Staff Full Time (1500 hours or greater) Location: Dayton, OH Category: Research Institute Staff Department: Enterprise Software Solut - 250625 Pay Grade: R3 - Exempt Advertised: December 23, 2025 Applications close: January 06, 2026 Position Summary: Ready to advance your career while making a difference?...

  • Senior Software Engineer

    5 days ago

    Dayton, OH, United States University of Dayton Full time

    Senior Software Engineer Job No: 503239 Work Type: Staff Full Time (1500 hours or greater) Location: Dayton, OH Category: Research Institute Staff Department: Enterprise Software Solut - 250625 Pay Grade: R3 - Exempt Advertised: December 23, 2025 Applications close: January 06, 2026 Position Summary: Ready to advance your career while making a difference?...

  • Senior Telecommunications Network Engineer

    2 weeks ago

    Dayton, OH, United States CompTech Computer Technologies Full time

    WELCOME TO COMPTECH Good people. Dedicated People. Hard-working people. CompTech is a service-oriented program management and technical company working to build lasting relationships with small and large companies, municipalities, and Government agencies. Headquartered in Dayton, OH, our clients nationwide are provided with services in client-focused...

  • Senior Data Scientist

    7 days ago

    Dayton, OH, United States Cape Fox Corporation Full time

    Job Title Senior Data Scientist Job Description Cape Fox is seeking a highly qualified Senior Data Scientist to support a government customer in addressing complex clinical and operational research challenges. The ideal candidate will bring deep expertise in data modeling, algorithm development, and predictive analytics to extract insights from large,...

  • Senior Data Scientist

    2 weeks ago

    Dayton, OH, United States Cape Fox Corporation Full time

    Job Title Senior Data Scientist Job Description Cape Fox is seeking a highly qualified Senior Data Scientist to support a government customer in addressing complex clinical and operational research challenges. The ideal candidate will bring deep expertise in data modeling, algorithm development, and predictive analytics to extract insights from large,...

  • Data Engineer

    2 weeks ago

    Dayton, OH, United States Veracity Full time

    Data Engineer - Must have a TS/SCI clearance Onsite Plant or customer site | Works in a SCIF 5 days a week. Beavercreek, OH As a member of our team, you will be working with cutting edge technical data for the intelligence community research efforts in Dayton, OH. This offers opportunities to work in a dynamic environment, with state-of-the-art...

  • Data Engineer

    7 days ago

    Dayton, OH, United States Veracity Full time

    Data Engineer - Must have a TS/SCI clearance Onsite Plant or customer site | Works in a SCIF 5 days a week. Beavercreek, OH As a member of our team, you will be working with cutting edge technical data for the intelligence community research efforts in Dayton, OH. This offers opportunities to work in a dynamic environment, with state-of-the-art...

  • Senior Computer Engineer

    7 days ago

    Dayton, OH, United States University of Dayton Full time

    Senior Computer Engineer Job No: 503105 Work Type: Staff Full Time (1500 hours or greater) Location: Dayton, OH Category: Research Institute Staff Department: UAS & Embedded Systems - 250651 Pay Grade: R3 - Exempt Advertised: September 29, 2025 Applications close: Position Summary: Join the University of Dayton Research Institute's cutting-edge Autonomy...