Technical Lead

22 hours ago

Greenfield, IN, United States TechnoGen Full time
Technical Lead / Data Engineering Specialist (Databricks, Azure Data Lake, Python)
Greenfield, IN 46140 (Onsite)
12+ months Contract
Pay rate: Market/Flexible

We are hiring a highly skilled Technical Lead/Data Engineering Specialist with extensive experience in Cloud technologies, DevOps development practices, Data Engineering to support and enhance RDAP initiatives.

Key Responsibilities:
  • Design, develop, and maintain Databricks Lakehouse solutions sourcing from Cloud platforms such as Azure Synapse and GCP
  • Implement and manage DevOps and CICD workflows using tools like GitHub
  • Apply best practices in test-driven development, code review, branching strategies, and deployment processes
  • Build, manage, and optimize Python packages using tools like setup, poetry, wheels, and artifact registries
  • Develop and optimize data pipelines and workflows in Databricks, utilizing PySpark and Databricks Asset Bundles
  • Manage and query SQL databases (Unity Catalog, SQL Server, Hive, Postgres)
  • Implement orchestration solutions using Databricks Workflows, Airflow, and Dagster
  • Work with event-driven architectures using Kafka, Azure Event Hub, and Google+C4 Cloud Pub/Sub
  • Develop and maintain Change Data Capture (CDC) solutions using tools like Debezium
  • Extensive experience in design and implementation of data migration projects specifically involving Azure Synapse and Databricks Lakehouse
  • Manage cloud storage solutions, including Azure Data Lake Storage and Google Cloud Storage
  • Configure and manage identity and access solutions using Azure Active Directory, including AD Groups, Service Principals, and Managed Identities
  • Effective interactions in Customer for understanding requirements, participating in design discussions and translating requirements into deliverables by working with the development team at Offshore; Effective in collaborating with cross-functional teams across development, operations, and business units; Strong interpersonal skills to build and maintain productive relationships with team members
  • Problem-Solving and Analytical Thinking - Capability to troubleshoot and resolve issues efficiently; Analytical mindset for optimizing workflows and improving system performance
  • Ability to convey complex technical concepts in a clear and concise manner to both technical and non-technical stakeholders; Strong documentation skills for creating process guidelines, technical workflows, and reports
Technologies & Skills & Experience:
  • Databricks (PySpark, Databricks Asset Bundles)
  • Python package builds(setup, poetry, wheels, artifact registries)
  • Open File Formats (Delta/Parquet/Iceberg/etc...)
  • SQL Databases (Unity Catalog, SQL Server, Hive, Postgres)
  • Orchestration Tools(Databricks Workflows, Airflow, Dagster)
  • Azure Data Lake Storage, Azure Active Directory (AD groups, Service Principles, Managed Identities)
  • Secondary/Other Skills/Good To have - Kafka, Azure Event Hub, Cloud Pub/Sub; Change Data Capture (Debizum) and Google Cloud Storage
  • Bachelor's Degree good in Computer Science, Information Technology or related with 12+ years of experience

Best & regards,

Asra Mohammad

Talent Acquisition Specialist

asra.m@technogeninc.com | 703-459-9610

  • Sr. Software Engineer

    4 days ago

    Greenfield, IN, United States Astemo Ltd. Full time

    Job Summary:We are seeking a highly skilled Senior .NET Developer with a strong background in manufacturing environments and MES (Manufacturing Execution Systems) to design, develop, and maintain our internally developed plant production and business systems. This role is hands-on, yet also requires the ability to independently lead projects from concept to...

  • Sr. Software Engineer

    21 hours ago

    Greenfield, IN, United States Astemo Ltd. Full time

    Job Summary:We are seeking a highly skilled Senior .NET Developer with a strong background in manufacturing environments and MES (Manufacturing Execution Systems) to design, develop, and maintain our internally developed plant production and business systems. This role is hands-on, yet also requires the ability to independently lead projects from concept to...

  • Manufacturing Maintenance Technician

    2 days ago

    Greenfield, IN, United States SIMOS Full time

    Description As a Manufacturing Maintenance Technician, you will play a critical role in our organization by ensuring the proper functioning, reliability, and longevity of machinery and equipment. Your primary responsibility will be to perform preventative maintenance, diagnose and troubleshoot issues, and carry out repairs in order to minimize downtime and...

  • Manufacturing Maintenance Technician

    2 weeks ago

    Greenfield, IN, United States SIMOS Full time

    Description As a Manufacturing Maintenance Technician, you will play a critical role in our organization by ensuring the proper functioning, reliability, and longevity of machinery and equipment. Your primary responsibility will be to perform preventative maintenance, diagnose and troubleshoot issues, and carry out repairs in order to minimize downtime and...

  • Manufacturing Maintenance Technician

    1 week ago

    Greenfield, IN, United States SIMOS Full time

    Description As a Manufacturing Maintenance Technician, you will play a critical role in our organization by ensuring the proper functioning, reliability, and longevity of machinery and equipment. Your primary responsibility will be to perform preventative maintenance, diagnose and troubleshoot issues, and carry out repairs in order to minimize downtime and...

  • Junior Design Engineer

    2 weeks ago

    Greenfield, IN, United States Actalent Full time

    Job Title: Junior Design EngineerJob Description Join a leading manufacturer of automotive systems, specializing in the production of internal combustion engine components and now expanding into inverters for electrified vehicles. As a Junior Design Engineer, you will play a vital role in the design engineering group, focusing on the development of...

  • Junior Design Engineer

    2 weeks ago

    Greenfield, IN, United States Actalent Full time

    Job Title: Junior Design EngineerJob Description Join a leading manufacturer of automotive systems, specializing in the production of internal combustion engine components and now expanding into inverters for electrified vehicles. As a Junior Design Engineer, you will play a vital role in the design engineering group, focusing on the development of...

  • Junior Design Engineer

    4 days ago

    Greenfield, IN, United States Actalent Full time

    Job Title: Junior Design Engineer Job Description Join a leading manufacturer of automotive systems, specializing in the production of internal combustion engine components and now expanding into inverters for electrified vehicles. As a Design Engineer, you will play a vital role in the design engineering group, focusing on the development of mechanical...

  • Junior Design Engineer

    1 week ago

    Greenfield, IN, United States Actalent Full time

    Job Title: Junior Design EngineerJob Description Join a leading manufacturer of automotive systems, specializing in the production of internal combustion engine components and now expanding into inverters for electrified vehicles. As a Junior Design Engineer, you will play a vital role in the design engineering group, focusing on the development of...

  • Study Director

    6 days ago

    Greenfield, IN, United States LabCorp Full time

    At Labcorp, we advance science, technology and innovation and recognized as one of the most respected companies in the world. Our team is driven by an energizing purpose to improve health and improve lives. Here, you can play a role in bringing new scientific discoveries to life and make a difference in the lives of millions. Join us and discover your...