Technical Lead Data Engineering

4 weeks ago

Nashville, United States Vital Care Infusion Services Full time

Job Summary:

The Technical Lead, Data Engineering will be responsible for architect design, develop and implement technology and data solutions to meet current and future data warehousing and reporting needs. The experienced lead engineer will set the technical data direction, establish best practices, and partner with all consumers of data to build and support the company's data warehouse, ETL, and reporting platforms.

Duties/Responsibilities:

Data Architecture and Design: Design, architect, and implement scalable and efficient data pipelines to ingest, process, and transform large volumes of structured and unstructured data from multiple sources. Define and implement data models, schemas, and storage solutions that optimize performance, reliability, and scalability. Evaluate and recommend appropriate data storage technologies, frameworks, and platforms based on the organization's requirements and objectives. Data Pipeline Development and Automation: Develop and maintain robust, fault-tolerant data pipelines using ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes. Implement data validation, error handling, and monitoring mechanisms to ensure data quality and integrity throughout the pipeline lifecycle. Automate data workflows, scheduling, and orchestration tasks using tools such as Apache Airflow, Luigi, or similar frameworks. Data Integration and Transformation: Integrate data from various internal and external sources, including databases, APIs, logs, and streaming platforms, to support business analytics, reporting, and machine learning initiatives. Transform raw data into meaningful insights and actionable information through data cleansing, enrichment, normalization, and aggregation techniques. Collaborate with data scientists and analysts to translate business requirements into technical specifications and data processing workflows. Performance Optimization and Scalability: Optimize the performance and efficiency of data pipelines, storage systems, and processing engines to meet service level agreements (SLAs) and performance targets. Identify and resolve performance bottlenecks, scalability issues, and resource constraints through system tuning, caching strategies, and infrastructure scaling. Data Security and Compliance: Implement and enforce data security controls, encryption mechanisms, and access policies to protect sensitive information and ensure compliance with regulatory requirements (e.g., GDPR, HIPAA, CCPA). Monitor data access patterns, audit trails, and user activities to detect and mitigate potential security threats and data breaches. Documentation and Collaboration: Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing, collaboration, and troubleshooting. Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data requirements, prioritize initiatives, and deliver solutions that meet business objectives.

Education and Experience:

Bachelor’s or master’s degree in computer science, Engineering, or a related field. Technical Leadership experience in data engineering, database development, or related roles, focusing on designing and building data pipelines and infrastructure.

Required Skills/Abilities:

Proficiency in SQL and other programming languages with data processing frameworks. Strong understanding of distributed systems, data modeling, database design principles, and performance optimization techniques. Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery, Dataflow). Familiarity with containerization and orchestration tools like Docker, Kubernetes, and infrastructure-as-code (IaC) concepts. Excellent problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced, collaborative environment. Effective communication and interpersonal skills, with the ability to communicate complex technical concepts to non-technical stakeholders and collaborate effectively with cross-functional teams.

#J-18808-Ljbffr

  • Solutions Technical Engineer Lead

    7 days ago

    Nashville, United States Schneider Electric Full time

    Location: Remote within U.S.What do you get to do in this position? The Solution Technical Engineer Leader shall be responsible for guiding the large-project technical team during the bid response and engagement of execution resources for large, complex Data Center projects. During offer development through project booking, this role will direct the...

  • Data Engineering Manager

    6 days ago

    Nashville, United States Vanderbilt Health Full time

    Discover Vanderbilt University Medical Center: Located in Nashville, Tennessee, and operating at a global crossroads of teaching, discovery, and patient care, VUMC is a community of diverse individuals who come to work each day with the simple aim of changing the world. It is a place where your expertise will be valued, your knowledge expanded, and your...

  • Data Engineer

    4 weeks ago

    Nashville, United States StaffSource Full time

    Job DescriptionJob DescriptionClearance: TS (preferred)Purpose of the Job:The Enterprise Data Architect is responsible for setting the strategy for the EPMs’s data architecture and providing technical architecture direction for the delivery of the target state. This person is an integral member of the Enterprise Architecture Team and will be responsible...

  • Data Engineering Manager

    6 days ago

    Nashville, United States Vanderbilt University Medical Center Full time

    Discover Vanderbilt University Medical Center: Located in Nashville, Tennessee, and operating at a global crossroads of teaching, discovery, and patient care, VUMC is a community of diverse individuals who come to work each day with the simple aim of changing the world. It is a place where your expertise will be valued, your knowledge expanded, and your...

  • Technical Lead

    1 month ago

    Nashville, United States i3 Verticals Management Services, Inc. Full time

    Job DescriptionJob DescriptionJOB TITLE: Technical LeadFLSA STATUS: ExemptDEPARTMENT: Public UtilitiesREPORTS TO: Director, Public UtilitiesSUPERVISORY RESPONSIBILITIES: NoJOB LOCATION: Nashville, TN – Corporate Office/RemoteTRAVEL: 0%SUMMARY OF POSITION:i3 Verticals is looking for a for technical team lead, with an emphasis in web application development,...

  • Technical Lead Software Developer

    3 weeks ago

    Nashville, Tennessee, United States HCA Healthcare Full time

    Description Technical Lead (Software Developer) must Design and architecture of information technology platform solutions. Utilize DevSecOps methodologies, standards, and leading practices. Engage in design, development, deployment, and maintenance of integration processes between applications across cloud and/or on-premises Cloud Integration, Application...

  • Lead Project Engineer

    22 hours ago

    Nashville, United States CESO Full time

    Are you a Civil Lead Project Engineer seeking purpose, challenge, and talented colleagues? With a diverse portfolio of residential, energy, commercial, light industrial and public programs, CESO has the opportunity for you to develop your career. We develop leaders and empower our associates to use their skills and talents to positively impact the world...

  • Sr. Azure Data Engineer

    4 weeks ago

    Nashville, United States Mozaic.io Full time

    Job DescriptionJob DescriptionWe are looking for an experienced and detail-oriented Senior Data/SQL Engineer to join our dynamic team. As a Senior Azure Data Engineer, you will play a crucial role in designing, implementing, and optimizing data storage solutions, ensuring efficient data retrieval, and supporting data-driven applications. The ideal candidate...

  • Lead Development Engineer

    2 weeks ago

    Nashville, United States Genesco Full time

    The Ideal Summary Development Engineers are responsible for researching, developing, implementing, and supporting new technology and products to support internal and external customer needs. They work closely with systems stakeholders and project personnel to ensure that solutions meet quality standards and are delivered on time and within budget. Additional...

  • Lead Development Engineer

    1 week ago

    Nashville, United States Genesco Full time

    The Ideal Summary Development Engineers are responsible for researching, developing, implementing, and supporting new technology and products to support internal and external customer needs. They work closely with systems stakeholders and project personnel to ensure that solutions meet quality standards and are delivered on time and within budget. Additional...

  • Technical Service Engineer

    2 days ago

    Nashville, United States NEXTracker Full time

    Job Description: The Technical Service Engineer will be based in Nashville, TN. Here is the key role of what you will do... •Provides technical support for mechanical, electrical, quality, communication, and installation issues for NEXTracker's customers worldwide, ensuring a best-in-class customer experience and providing product and systems expertise to...

  • Senior AWS Data Engineer

    10 hours ago

    Nashville, United States ekSource Technologies, Inc. Full time

    ekSource Technologies is committed to providing value through the effective use of technology. ekSource excels in putting together teams with strong functional knowledge and technical expertise. ekSource partners with leaders in the industry to fully harness their potential and bring the right solutions for your Business. ekSource is head quartered at...

  • Technical Service Engineer

    3 days ago

    Nashville, United States NEXTracker Full time

    Job Description: The Technical Service Engineer will be based in Nashville, TN. Here is the key role of what you will do... * Provides technical support for mechanical, electrical, quality, communication, and installation issues for NEXTracker's customers worldwide, ensuring a best-in-class customer experience and providing product and systems expertise to...

  • Azure Data Engineer

    1 day ago

    Nashville, Tennessee, United States Philips Full time

    Job TitleAzure Data EngineerJob DescriptionAzure Data Engineer, CG 60- NAM Comm Ops- Analytics, Insights & Automation (Nashville or Cambridge)We have an exciting opportunity for a Data Engineer to leverage their expertise in Azure, your role will help create and maintain the core foundation on the Azure Platform from which North American Analytics solutions...

  • Technical Support Lead

    10 hours ago

    Nashville, United States Neo Prism Solutions, LLC Full time

    Technical Support Lead Primary technical lead for Microsoft Azure AD, Intune MDM + MAM, and Office 365. SME on SSO integration with Enterprise Apps, MFA, Conditional Access, and device enrollment. Implement and monitor security best practices on the Azure/Windows 10/Office 365 infrastructure to comply with industry standard frameworks and policies. Strong...

  • Sr. Systems Engineer Team Lead

    2 weeks ago

    Nashville, United States Tabush Full time

    Job DescriptionJob DescriptionSalary: Overview: The Senior Systems Engineer Team Lead will manage a team of engineers overseeing and supporting our clients' critical IT infrastructure. This role involves resolving complex technical issues, conducting root-cause analyses, and implementing effective solutions. The Team Lead will also provide leadership and...

  • Senior Civil Engineer

    22 hours ago

    Nashville, United States Olsson Full time

    As a Senior Civil Engineer on our Data Center Civil Team, you will be a part of the firms largest and most complex projects. You will serve as a project manager on some projects and lead design engineer on others. Prepare planning and design documen Civil, Civil Engineer, Engineer, Senior, Data, Technology

  • Controls Technician

    1 day ago

    Nashville, United States Rise Technical Full time

    Controls Technician/Engineer (Facilities)$47-$52/hr + Great Company Benefits + Training + ProgressionNashville, Tennessee (Commutable from Brentwood, Smyrna, Franklin, Hendersonville, Ashland City)Are you a Controls Technician/Engineer from a Facilities background, looking to take the lead of a small team of technicians on complex, technical projects, where...

  • Controls Technician

    1 day ago

    Nashville, United States Rise Technical Full time

    Controls Technician/Engineer (Facilities)$47-$52/hr + Great Company Benefits + Training + ProgressionNashville, Tennessee (Commutable from Brentwood, Smyrna, Franklin, Hendersonville, Ashland City)Are you a Controls Technician/Engineer from a Facilities background, looking to take the lead of a small team of technicians on complex, technical projects, where...

  • Controls Technician

    21 hours ago

    Nashville, United States Rise Technical Full time

    Controls Technician/Engineer (Facilities)$47-$52/hr + Great Company Benefits + Training + ProgressionNashville, Tennessee (Commutable from Brentwood, Smyrna, Franklin, Hendersonville, Ashland City)Are you a Controls Technician/Engineer from a Facilities background, looking to take the lead of a small team of technicians on complex, technical projects, where...