Data Engineer

3 weeks ago

Houston, United States IntagHire Full time

Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits package


About the Role:

We are seeking a skilled mid to senior level Python Data Engineer to join our clients’ team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about transforming data into actionable insights and have a strong background in data engineering, we want to hear from you.

The ideal candidate will have 5+ years of experience in data engineering with a focus on Node.js, Python, SQL, and Java, and will work closely with our clients’ Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. Experience with Slurm and Kubernetes are highly preferred. The candidate will be required to work on-site at our clients’ office in Downtown Houston.


Responsibilities:

  • Data Pipeline Development: Build and maintain efficient data pipelines for collecting, processing, and storing large volumes of data.
  • Data Integration: Collaborate with cross-functional teams to integrate data from various sources into our systems.
  • Database Management: Design, optimize, and maintain databases using SQL and NoSQL technologies.
  • Software Development: Write clean and efficient code using tech stacks such as Node.js, Python, Java, and more (the more, the better).
  • Linux Job Scheduling: Utilize Slurm or similar Linux job scheduling systems for resource management and job scheduling.
  • Containerization: Experience with Kubernetes (Kube) is preferred for container orchestration.
  • Streaming Data: Work with real-time data processing and streaming technologies, including MQTT and Kafka.
  • Data Quality: Ensure data quality, accuracy, and consistency by implementing data validation and cleansing processes.
  • Performance Optimization: Identify and resolve bottlenecks in data processing, storage, and retrieval.
  • Documentation: Maintain comprehensive documentation for data pipelines, systems, and processes.


Requirements:

  • Bachelor's degree in Computer Science, Information Systems, or a related field
  • At least 5 years of data engineering experience, with a strong track record of designing and implementing data solutions.
  • Proficiency in data engineering technologies, including Node.js, Python, SQL, and Java (additional programming languages are a plus).
  • Experience with Linux job scheduling, particularly with Slurm, or similar job scheduling systems.
  • Familiarity with containerization technologies, with a preference for Kubernetes experience.
  • Excellent knowledge of streaming data technologies, including MQTT and Kafka.
  • Strong problem-solving skills and the ability to work in a collaborative team environment.
  • Strong communication skills and the ability to translate complex technical concepts to non-technical stakeholders.
  • A commitment to best practices in data engineering, including data security and privacy considerations.
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills


This is an exciting opportunity to be part of a startup organization, as well as to work directly with a Fortune 200 company. If you are a strategic thinker with a passion for delivering innovative products, we would love to hear from you.


Benefits:

  • Profit Sharing
  • 401k with match
  • 100% paid medical premiums
  • Career development/training opportunities

  • Data Engineer

    4 weeks ago

    Houston, United States Client of Reputable Staffing & Recruiting Firm Full time

    Job DescriptionJob DescriptionBrookwoods Group is working with a Houston-based Energy Company to identify a Data Engineer. The Data Engineer role is a technical individual contributor role, focused on supporting data infrastructure to enable data analytics and machine learning. This role involves designing and building data pipelines, ensuring data...

  • Data Engineer

    4 weeks ago

    Houston, Texas, United States Apollose Full time

    Responsiblities Developing and maintaining scalable reusable data pipelines for both streaming and batch requirements to support continuing increases in data volume and complexity for user accesses via dashboard report self-service data platform to structured and unstructured data. Data processing & QC checks across multiple layers of data warehouses...

  • Data Engineer

    1 week ago

    Houston, United States Vantage Bank Full time

    JOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 5151 San Felipe St., Suite 730, Houston TX 77056 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...

  • Data Engineer

    3 weeks ago

    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerOffice Status: RemoteRequirements:Standard data engineering responsibilities such as building pipelines, etc. 5-10 years of experiencePython coding experienceDatabricks,Trino, DBT core expeienceSQL backgroundData Modeling

  • Data Engineer

    5 days ago

    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform and...

  • Data Engineer

    2 weeks ago

    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Data Engineer

    2 weeks ago

    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Data Engineer

    2 weeks ago

    Houston, United States Kaizen Technologies Full time

    Job Title: Data Engineer (Full time) Location: Houston, TX (Onsite) USABand: U3Year of Experience: 5 to 7 YearsDuration: 6 Months (Will be extended for 12 months)No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.110K to 130K PA   Responsibilities- High LevelConnect and Collect data exploration and preparation.Transform...

  • Trading Data Engineer

    1 week ago

    Houston, United States Trafigura Group Pte. Ltd. Full time

    Main Purpose: We are recruiting an experienced data engineer to work directly with the traders and research analysts in the Gas and Power teams in our Houston office. This is an exciting opportunity to work in a fast-paced commercial setting, playing a critical role in a real time, data driven trading environment. Whilst being physically co-located with the...

  • Data Engineer

    4 weeks ago

    Houston, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience...

  • Data Engineer

    4 weeks ago

    Houston, Texas, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience with the...

  • Lead Data Engineer

    2 weeks ago

    Houston, United States Infinity Consulting Solutions Full time

    Responsibilities: - Lead a team of 2-3 data engineers to deliver high-quality solutions. - Design, develop, and maintain data pipelines and ETL processes. - Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. - Architect and implement scalable data solutions on AWS cloud infrastructure. - Ensure data...

  • Junior Data Engineer

    1 week ago

    Houston, United States MHK TECH INC Full time

    Responsibilities • Develop, maintain, and optimize data pipelines to extract, transform, and load large datasets from diverse sources into our data ecosystem • Design and implement efficient and scalable data models that align with business requirements, ensuring data integrity and performance • Collaborate with cross-functional teams to understand...

  • Data Engineer III

    2 weeks ago

    Houston, United States VC5 Consulting Full time

    Lead Python Data Engineer Job Description We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department.  As part of the Data Engineering team, the Lead Python Data Engineer will work closely with Business domain experts and Data Scientists to solve real-world oil and gas midstream problems using...

  • Jr. Data Engineer

    4 weeks ago

    Houston, Texas, United States Dash techology Full time

    Dash technology Job OverviewWe are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data...

  • Lead Data Engineer

    1 week ago

    Houston, United States iSphere Full time

    iSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast, you will collaborate with...

  • Data Python Engineer

    3 weeks ago

    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Description:We are currently seeking an experienced Python Software Engineer. The Python Software Engineer will work closely with Data Engineers and Data Scientists using advanced analytics and machine learning.Work directly with subject matter experts to develop high quality, reliable, scalable, software products.Design and...

  • AWS Data Engineer

    2 weeks ago

    Houston, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 1.000 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and Corporate for their projects in financial engineering, quantitative research, regulatory implementation, SI transformation, and...

  • AWS Data Engineer

    2 weeks ago

    Houston, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 1.000 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and Corporate for their projects in financial engineering, quantitative research, regulatory implementation, SI transformation, and...

  • AWS Data Engineer

    2 weeks ago

    Houston, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 1.000 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and Corporate for their projects in financial engineering, quantitative research, regulatory implementation, SI transformation, and...