Data Lakehouse Engineer

3 weeks ago


Houston, United States Resource Informatics Group Full time

Job Title: Data Lakehouse Engineer
Duration: 12+ Months
Location: Houston, TX

JOB DESCRIPTION
We are currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for Gathering, Processing, and Transformation business units.

Responsibilities include:

  • Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse
  • Design and implement data quality pipelines to ensure data correctness and building trusted data sets
  • Design and implement a Data Lakehouse solution which accurately reflects business operations
  • Assist with data platform performance tuning and physical data model support including partitioning and compaction
  • Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
  • The successful candidate will meet the following qualifications:
  • 10+ years of experience as a Data Engineer designing and maintaining data pipeline architectures
  • Expert knowledge of ANSI SQL, PLSQL, TSQL, and Python
  • Experience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data Capture
  • Experience in data management practices including data catalog, data lineage, and master data management
  • Experience in business analysis and defining business performance metrics
  • Experience in software development practices such as Design Principles and Patterns, Testing, CI/CD, and version control
  • Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake
  • Knowledgeable of common data visualization tools such as Power BI and Tibco Spotfire
  • Experience with Dremio is preferred

  • Data Architect

    1 month ago


    Houston, United States iLink Systems Inc. Full time

    Bachelor's degree in Computer Science, Software Engineering, or equivalent combination of education and experience. - Total 12 + yrs of IT experience in ETL /Big Data Technologies - 3-5 years experience with Azure storage solutions such as Azure Storage, Azure Storage Disks, and Azure Files - 1-3 years experience with tools such as Databricks (Lakehouse),...

  • Data Architect

    4 days ago


    Houston, United States iLink Digital Full time

    Houston, United States | Posted on 04/16/2024 iLink Digital is aGlobal Software Solution Provider and SystemsIntegrator, delivers next-generation technologysolutions to help clients solve complex businesschallenges, improve organizational effectiveness,increase business productivity, realize sustainableenterprise value and transform your businessinside-out....

  • Data Engineer

    4 weeks ago


    Houston, United States Client of Reputable Staffing & Recruiting Firm Full time

    Job DescriptionJob DescriptionBrookwoods Group is working with a Houston-based Energy Company to identify a Data Engineer. The Data Engineer role is a technical individual contributor role, focused on supporting data infrastructure to enable data analytics and machine learning. This role involves designing and building data pipelines, ensuring data...

  • Data Engineer

    1 month ago


    Houston, Texas, United States Apollose Full time

    Responsiblities Developing and maintaining scalable reusable data pipelines for both streaming and batch requirements to support continuing increases in data volume and complexity for user accesses via dashboard report self-service data platform to structured and unstructured data. Data processing & QC checks across multiple layers of data warehouses...

  • Data Engineer

    2 weeks ago


    Houston, United States Vantage Bank Full time

    JOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 5151 San Felipe St., Suite 730, Houston TX 77056 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...

  • Data Engineer

    3 weeks ago


    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerOffice Status: RemoteRequirements:Standard data engineering responsibilities such as building pipelines, etc. 5-10 years of experiencePython coding experienceDatabricks,Trino, DBT core expeienceSQL backgroundData Modeling

  • Data Engineer

    6 days ago


    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform and...

  • Data Engineer

    2 weeks ago


    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Data Engineer

    2 weeks ago


    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Data Engineer

    2 weeks ago


    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Trading Data Engineer

    2 weeks ago


    Houston, United States Trafigura Group Pte. Ltd. Full time

    Main Purpose: We are recruiting an experienced data engineer to work directly with the traders and research analysts in the Gas and Power teams in our Houston office. This is an exciting opportunity to work in a fast-paced commercial setting, playing a critical role in a real time, data driven trading environment. Whilst being physically co-located with the...

  • Data Engineer

    1 month ago


    Houston, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience...

  • Data Engineer

    1 month ago


    Houston, Texas, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience with the...

  • Lead Data Engineer

    2 weeks ago


    Houston, United States Infinity Consulting Solutions Full time

    Responsibilities: - Lead a team of 2-3 data engineers to deliver high-quality solutions. - Design, develop, and maintain data pipelines and ETL processes. - Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. - Architect and implement scalable data solutions on AWS cloud infrastructure. - Ensure data...

  • Junior Data Engineer

    2 weeks ago


    Houston, United States MHK TECH INC Full time

    Responsibilities • Develop, maintain, and optimize data pipelines to extract, transform, and load large datasets from diverse sources into our data ecosystem • Design and implement efficient and scalable data models that align with business requirements, ensuring data integrity and performance • Collaborate with cross-functional teams to understand...

  • Jr. Data Engineer

    1 month ago


    Houston, Texas, United States Dash techology Full time

    Dash technology Job OverviewWe are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data...

  • Lead Data Engineer

    2 weeks ago


    Houston, United States iSphere Full time

    iSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast, you will collaborate with...

  • Data Python Engineer

    3 weeks ago


    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Description:We are currently seeking an experienced Python Software Engineer. The Python Software Engineer will work closely with Data Engineers and Data Scientists using advanced analytics and machine learning.Work directly with subject matter experts to develop high quality, reliable, scalable, software products.Design and...

  • AWS Data Engineer

    2 weeks ago


    Houston, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 1.000 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and Corporate for their projects in financial engineering, quantitative research, regulatory implementation, SI transformation, and...

  • AWS Data Engineer

    2 weeks ago


    Houston, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 1.000 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and Corporate for their projects in financial engineering, quantitative research, regulatory implementation, SI transformation, and...