Lead Data Engineer

4 days ago

Houston, United States Viable Teck Full time
Lead Data Engineer 

The Lead Data Engineer will collaborate with stakeholders across the organization to assess requests for analytics and reporting solutions. This role involves designing, developing, and refining data sourcing, modeling, pipelines, and orchestrations. Additionally, the individual will contribute to crafting strategies for data governance, user access, dashboard deployment, and data report optimization. The scope of responsibilities extends to proactive exploration of tools and platforms to enhance operational efficiency and cost-effectiveness. Strong interpersonal skills are essential for effective collaboration, and a steadfast dedication to delivering incremental business value is paramount.



Responsibilities

  • Collaborate with Business Analysts, Data Modelers, and ELT Technical resources to lead projects aimed at designing and implementing data sourcing, loading, and consumption models that align with reporting metrics.
  • Construct data pipelines within Azure Data Factory to facilitate the ingestion of inbound data and distribution of outbound data to external applications, integrating integrity and control checks throughout the process.
  • Develop and implement data sourcing strategies and pipelines to seamlessly integrate the analytics platform with enterprise applications such as SAP, Right Angle, Ariba, and Sales Force.
  • Define detailed business requirements, identifying challenges, opportunities, and solutions for delivering enterprise Datamart & analytics platform.
  • Engage with business stakeholders to generate functional specifications for the development of end-to-end analytics solutions.
  • Create and execute scripts for data exploration in Big Data systems, constructing models to visualize trends, patterns, and outliers for business insights.
  • Design and implement control scripts for monitoring daily data feeds from various systems and external flat files.
  • Develop SQL scripts in SQL Server or Oracle for conducting data quality checks against validation metrics and generating comparison reports to ensure data accuracy.
  • Collaborate with the release management team to plan and execute production deployments.
  • Address challenges in report utilization with users and facilitate necessary changes to reports and dashboards to enhance usability.
  • Cultivate and maintain relationships with users to identify and develop additional analytic and reporting capabilities.
  • Design and deploy data orchestrations supporting reports, dashboards, and visualizations to drive insights and enable timely business decisions.
  • Present complex ideas and solutions concisely to stakeholders.
  • Innovate and problem-solve difficult reporting and data visualization issues.
  • Evaluate emerging trends in data analytics, including predictive analytics, and recommend continuous improvements to the reporting platform.
  • Provide guidance in creating user-friendly, self-service reporting and analytical solutions.Train and support users in reporting toolsets like Power BI to foster a self-service reporting platform.
  • Collaborate across multiple departments and business segments to support all team initiatives for Reporting, Dashboards, and Data Visualizations.
  • Advocate for industry standards and simplification within Motiva, influencing change and managing stakeholder expectations across business segments.


Qualifications

  • Bachelor's degree in Computer Science or a related field preferred.
  • Minimum of 8 years of experience in the IT industry.
  • Proficiency in analyzing and designing business process improvements.
  • Action-oriented with a high level of energy and focus on delivering results.
  • Ability to implement best practices and enhancements in various aspects of daily work.
  • Self-reliant individual with a demonstrated ability to quickly contribute value to an organization.
  • Proven ability to collaborate with cross-functional teams to meet requirements.
  • Strong oral and written communication skills.
  • Capability to manage competing priorities across multiple stakeholders.
  • Hands-on experience with Databricks or similar tools, and Power BI or equivalent BI tools.
  • Experience working with Microsoft Azure cloud technologies, including Data Factory, Data Lake, or similar platforms.
  • Ability to read and interpret data schemas and models.
  • Proficiency in SQL or similar query languages.
  • Knowledge and experience in prototyping, designing, and requirement analysis.
  • Ability to lead or contribute effectively in a fast-paced delivery team environment.
  • Track record of successfully designing and implementing reports, dashboards, and visualizations using Power BI or similar tools.
  • Familiarity with data management and data quality processes and requirements.
  • Experience working on or supporting large enterprise-wide data projects and initiatives.
  • Strong analytical skills.
  • Strong interpersonal skills demonstrated through previous work experience.
  • Understanding of data mapping concepts and building requirements.

Preferred Education and Experience:

  • Experience implementing business process changes.
  • Familiarity with change management activities.
  • Proficiency in package software implementation.
  • Track record of delivering insightful reports and dashboards.
  • Prior experience in the Oil and Gas sector.
  • Understanding of data warehousing, data cleaning, and data pipelines.


  • Lead Data Engineer

    4 months ago

    Houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Lead Data Engineer

    3 months ago

    houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Lead Data Engineer

    3 months ago

    Houston, United States Harnham Full time

    Title: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...

  • Data Hub Lead Engineer

    1 month ago

    Houston, Texas, United States The University of Texas at Austin Full time

    Job SummaryThe University of Texas at Austin is seeking a highly skilled Data Hub Lead Engineer to lead the design, development, and deployment of complex data pipelines within our cloud data ecosystem.This role will involve technical leadership, project management, and team management responsibilities. The successful candidate will have experience in...

  • Lead Data Engineer Position

    2 weeks ago

    Houston, Texas, United States HCSS Employer, Inc. Full time

    Overview:At HCSS Employer, Inc., we strive to provide innovative solutions for the construction industry, helping our customers improve their business through high-quality software and exceptional service. We offer a collaborative environment where employees can grow professionally and personally, with opportunities for mentorship and career development.Why...

  • Cloud Data Engineer Lead

    2 weeks ago

    Houston, Texas, United States FIRST SOFTSOLUTIONS INC Full time

    About Us: At FIRST SOFTSOLUTIONS INC, we are actively hiring for a Cloud Data Engineer Lead position in Houston, Texas. This role requires 6-10 years of experience in data engineering and proficiency in GCP, Python, PySpark, and SQL.We offer a competitive salary range of $140,000 - $200,000 per year based on experience. Additionally, we provide benefits such...

  • Data Architect and Engineer Lead

    1 month ago

    Houston, Texas, United States HCSS Employer, Inc. Full time

    HCS Employer, Inc. is a software company based in Sugar Land, Texas, providing innovative solutions for the construction industry to streamline their operations.We're looking for a highly skilled Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and management of scalable data architectures and...

  • Lead Data Systems Engineer

    4 weeks ago

    Houston, United States Gulf States Toyota Full time

    Job Summary The Lead Data Systems Engineer will play a key role in designing and managing robust, scalable data platforms for the Data Science and Analytics team. Responsibilities include architecting data solutions, implementing data pipelines, and ensuring compliance with data governance policies. This position requires strong collaboration with...

  • Data Engineering Team Lead

    2 weeks ago

    Houston, Texas, United States Saxon Global Full time

    About the Role:This is a fantastic opportunity to join a dynamic team of data engineers at Saxon Global. As a Sr. Data Engineer, you will play a critical role in shaping our data infrastructure and ensuring that our customers receive accurate and timely insights from their data. We offer a highly competitive salary range of $120,000 - $180,000 per year and a...

  • Lead Mechanical Project Manager

    1 week ago

    Houston, Texas, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    As a Lead Mechanical Project Manager, you will be responsible for overseeing multiple mechanical engineering projects from start to finish.About the Role:You will be responsible for:Project Management: Plan, coordinate, and schedule projects to ensure timely completion and within budget.Talent Management: Lead and develop cross-functional teams to achieve...

  • Mechanical Design Engineer

    1 week ago

    Houston, Texas, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Chemical & Industrial Engineer is seeking a highly skilled Mechanical Design Engineer to join our team in $120,000/year salary.About the Role:We are looking for a talented individual with expertise in mechanical engineering and project management. As a Staff Mechanical Engineer, you will be responsible for planning, coordinating, and scheduling projects from...

  • Data Engineer Manager

    1 month ago

    Houston, United States Brooksource Full time

    Data Engineer ManagerLocation: On-site in Houston, TX 5 times a yearMust live in one of the following states: TX, GA, FL, LA, SC, TN, IN, NE, OKJob Type: Full-time Overview:We are seeking an experienced Data Engineer Manager to lead a team of data engineers and oversee data ingestion from Epic and other platforms into our Snowflake data warehouse. This role...

  • Solutions & Data Engineer - Team Lead

    1 month ago

    Houston, United States Genesis Resources Full time

    Responsibilities This is an exempt staff position involved in data and application development on the IT team. This position will report to and work closely with the AVP of IT and the business to support the strategic vision for bringing together application solutions for underwriting and workflow and data analysis. Critical thinking and analytical mindset...

  • Lead Data Scientist

    4 weeks ago

    Houston, United States Resource Informatics Group Full time

    Lead Data Scientist Location: Houston, Texas Duration: 6 months We are currently seeking an experienced data scientist to join the Big Data and Advanced Analytics department. As part of the Data Analytics team, the Lead Data Scientist will work closely with the Data Engineering team and business functions to solve real-world oil and gas midstream problems...

  • Principal Data Engineer

    2 weeks ago

    Houston, United States Understanding Recruitment Full time

    🚀 Principal Data Engineer Opportunity – Houston, TXAre you passionate about building scalable data platforms and driving advanced analytics? We’re hiring a Principal Data Engineer to join a leading organization in the automotive industry and an innovative Data and Analytics team in Houston, TX (4 days per week in office, 1 wfh).What You’ll...

  • Principal Data Engineer

    6 days ago

    Houston, United States Understanding Recruitment Full time

    🚀 Principal Data Engineer Opportunity – Houston, TXAre you passionate about building scalable data platforms and driving advanced analytics? We’re hiring a Principal Data Engineer to join a leading organization in the automotive industry and an innovative Data and Analytics team in Houston, TX (4 days per week in office, 1 wfh).What You’ll...

  • Data Science Team Lead

    1 month ago

    Houston, Texas, United States Occidental Petroleum Corporation Full time

    About Occidental Petroleum CorporationWe are an international energy company with a diverse portfolio of assets, primarily in the United States, the Middle East, and North Africa. Our goal is to be a leading producer of oil and gas in the U.S., while also advancing sustainable practices that benefit our employees, customers, and the environment.Job Title:...

  • Senior Data Engineer

    1 month ago

    Houston, Texas, United States Dimensional Fund Advisors, L.P. Full time

    About Dimensional Fund Advisors, L.P.We're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer at Dimensional, you'll be responsible for designing and developing robust, secure, and maintainable data architectures, pipelines, and services.Key Responsibilities:Design and engineer data solutions across various domains,...

  • Senior Data Engineer

    1 month ago

    Houston, Texas, United States Lorven Technologies Full time

    • We are seeking a highly skilled and experienced Senior Data Engineer to join our team at Lorven Technologies.• As a Senior Data Engineer, you will be responsible for designing, developing, and implementing robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.• You will ensure scalable, reliable, and...

  • Chief Data Engineering Strategist

    1 week ago

    Houston, Texas, United States Greer Financial Services Full time

    Job OverviewWe are seeking an experienced Chief Data Engineering Strategist to lead our data strategy and drive data insights across the organization in Houston, TX.This is a dynamic role that combines technical leadership with strategic partnership to enable data-driven decision making.The ideal candidate will have 5+ years of leadership experience in...