Lead Data Engineer
4 months ago
Title: Lead Data Engineer
Location: Houston, TX 77077 - Onsite 4 days per week.
Overview of Role:
As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.
Company Description:
Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.
Role Description:
- Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
- Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
- Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
- Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
- Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
- Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.
Skills and Experience:
- Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
- Extensive background and experience in ETL/ELT pipelining.
- 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
- Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
- Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
- ML model deployment experience is a plus
- Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.
Benefits:
- Health, Dental, and Vision Insurance
- 15+ Days of PTO Annually
- Educational Assistance available
- Annual bonus (20%)
- 401(k) Matching Program
Please note: Candidates must be authorized to work in the United States to be considered at this time.
-
Lead Data Engineer
2 months ago
houston, United States Harnham Full timeTitle: Lead Data EngineerLocation: Houston, TX 77077 - Onsite 4 days per week.Overview of Role:As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering,...
-
Data Hub Lead Engineer
1 month ago
Houston, Texas, United States The University of Texas at Austin Full timeJob SummaryThe University of Texas at Austin is seeking a highly skilled Data Hub Lead Engineer to lead the design, development, and deployment of complex data pipelines within our cloud data ecosystem.This role will involve technical leadership, project management, and team management responsibilities. The successful candidate will have experience in...
-
Lead Data Engineer
3 days ago
Houston, United States Viable Teck Full timeLead Data Engineer The Lead Data Engineer will collaborate with stakeholders across the organization to assess requests for analytics and reporting solutions. This role involves designing, developing, and refining data sourcing, modeling, pipelines, and orchestrations. Additionally, the individual will contribute to crafting strategies for data governance,...
-
Lead Data Engineer
4 days ago
Houston, United States Viable Teck Full timeLead Data Engineer The Lead Data Engineer will collaborate with stakeholders across the organization to assess requests for analytics and reporting solutions. This role involves designing, developing, and refining data sourcing, modeling, pipelines, and orchestrations. Additionally, the individual will contribute to crafting strategies for data governance,...
-
Lead Data Engineer Position
2 weeks ago
Houston, Texas, United States HCSS Employer, Inc. Full timeOverview:At HCSS Employer, Inc., we strive to provide innovative solutions for the construction industry, helping our customers improve their business through high-quality software and exceptional service. We offer a collaborative environment where employees can grow professionally and personally, with opportunities for mentorship and career development.Why...
-
Cloud Data Engineer Lead
2 weeks ago
Houston, Texas, United States FIRST SOFTSOLUTIONS INC Full timeAbout Us: At FIRST SOFTSOLUTIONS INC, we are actively hiring for a Cloud Data Engineer Lead position in Houston, Texas. This role requires 6-10 years of experience in data engineering and proficiency in GCP, Python, PySpark, and SQL.We offer a competitive salary range of $140,000 - $200,000 per year based on experience. Additionally, we provide benefits such...
-
Data Architect and Engineer Lead
1 month ago
Houston, Texas, United States HCSS Employer, Inc. Full timeHCS Employer, Inc. is a software company based in Sugar Land, Texas, providing innovative solutions for the construction industry to streamline their operations.We're looking for a highly skilled Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and management of scalable data architectures and...
-
Lead Data Systems Engineer
3 weeks ago
Houston, United States Gulf States Toyota Full timeJob Summary The Lead Data Systems Engineer will play a key role in designing and managing robust, scalable data platforms for the Data Science and Analytics team. Responsibilities include architecting data solutions, implementing data pipelines, and ensuring compliance with data governance policies. This position requires strong collaboration with...
-
Lead Mechanical Project Manager
1 week ago
Houston, Texas, United States CHEMICAL & INDUSTRIAL ENGINEER Full timeAs a Lead Mechanical Project Manager, you will be responsible for overseeing multiple mechanical engineering projects from start to finish.About the Role:You will be responsible for:Project Management: Plan, coordinate, and schedule projects to ensure timely completion and within budget.Talent Management: Lead and develop cross-functional teams to achieve...
-
Data Engineering Team Lead
2 weeks ago
Houston, Texas, United States Saxon Global Full timeAbout the Role:This is a fantastic opportunity to join a dynamic team of data engineers at Saxon Global. As a Sr. Data Engineer, you will play a critical role in shaping our data infrastructure and ensuring that our customers receive accurate and timely insights from their data. We offer a highly competitive salary range of $120,000 - $180,000 per year and a...
-
Mechanical Design Engineer
7 days ago
Houston, Texas, United States CHEMICAL & INDUSTRIAL ENGINEER Full timeChemical & Industrial Engineer is seeking a highly skilled Mechanical Design Engineer to join our team in $120,000/year salary.About the Role:We are looking for a talented individual with expertise in mechanical engineering and project management. As a Staff Mechanical Engineer, you will be responsible for planning, coordinating, and scheduling projects from...
-
Data Engineer Manager
4 weeks ago
Houston, United States Brooksource Full timeData Engineer ManagerLocation: On-site in Houston, TX 5 times a yearMust live in one of the following states: TX, GA, FL, LA, SC, TN, IN, NE, OKJob Type: Full-time Overview:We are seeking an experienced Data Engineer Manager to lead a team of data engineers and oversee data ingestion from Epic and other platforms into our Snowflake data warehouse. This role...
-
Lead Data Scientist
4 weeks ago
Houston, United States Resource Informatics Group Full timeLead Data Scientist Location: Houston, Texas Duration: 6 months We are currently seeking an experienced data scientist to join the Big Data and Advanced Analytics department. As part of the Data Analytics team, the Lead Data Scientist will work closely with the Data Engineering team and business functions to solve real-world oil and gas midstream problems...
-
Solutions & Data Engineer - Team Lead
1 month ago
Houston, United States Genesis Resources Full timeResponsibilities This is an exempt staff position involved in data and application development on the IT team. This position will report to and work closely with the AVP of IT and the business to support the strategic vision for bringing together application solutions for underwriting and workflow and data analysis. Critical thinking and analytical mindset...
-
Lead Data Scientist
2 months ago
Houston, United States Resource Informatics Group Full timeLead Data Scientist Location: Houston, Texas Duration: 6+ months We are currently seeking an experienced data scientist to join the Big Data and Advanced Analytics department. As part of the Data Analytics team, the Lead Data Scientist will work closely with the Data Engineering team and business functions to solve real-world oil and gas midstream problems...
-
Principal Data Engineer
2 weeks ago
Houston, United States Understanding Recruitment Full time🚀 Principal Data Engineer Opportunity – Houston, TXAre you passionate about building scalable data platforms and driving advanced analytics? We’re hiring a Principal Data Engineer to join a leading organization in the automotive industry and an innovative Data and Analytics team in Houston, TX (4 days per week in office, 1 wfh).What You’ll...
-
Principal Data Engineer
5 days ago
Houston, United States Understanding Recruitment Full time🚀 Principal Data Engineer Opportunity – Houston, TXAre you passionate about building scalable data platforms and driving advanced analytics? We’re hiring a Principal Data Engineer to join a leading organization in the automotive industry and an innovative Data and Analytics team in Houston, TX (4 days per week in office, 1 wfh).What You’ll...
-
Data Science Team Lead
1 month ago
Houston, Texas, United States Occidental Petroleum Corporation Full timeAbout Occidental Petroleum CorporationWe are an international energy company with a diverse portfolio of assets, primarily in the United States, the Middle East, and North Africa. Our goal is to be a leading producer of oil and gas in the U.S., while also advancing sustainable practices that benefit our employees, customers, and the environment.Job Title:...
-
Senior Data Engineer
1 month ago
Houston, Texas, United States Dimensional Fund Advisors, L.P. Full timeAbout Dimensional Fund Advisors, L.P.We're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer at Dimensional, you'll be responsible for designing and developing robust, secure, and maintainable data architectures, pipelines, and services.Key Responsibilities:Design and engineer data solutions across various domains,...
-
Senior Data Engineer
4 weeks ago
Houston, Texas, United States Lorven Technologies Full time• We are seeking a highly skilled and experienced Senior Data Engineer to join our team at Lorven Technologies.• As a Senior Data Engineer, you will be responsible for designing, developing, and implementing robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.• You will ensure scalable, reliable, and...