Current jobs related to Data Engineer - Houston - Solugen

  • Snowflake Data Engineer

    1 week ago

    Houston, United States Data Piper Full time

    Develop and implement scalable and efficient data architectures using Snowflake.5+ years of experience in data engineering, with a focus on Snowflake.Proven experience with Snowflake design, development, and optimization.Strong proficiency in SQL and query optimization techniques.Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache...

  • Snowflake Data Engineer

    1 month ago

    Houston, Texas, United States Data Piper Full time

    Company DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments, we will take the hassle out of...

  • Snowflake Data Engineer

    1 month ago

    Houston, United States Data Piper Full time

    Job DescriptionJob DescriptionCompany DescriptionData Piper provides specialized and competitive talent to help you build your team's capabilities and success. Our staff have proven experience from the most competitive companies in Silicon Valley, so you know they have the experience and dedication that you can trust. For short or long-term assignments,...

  • Data Engineer

    3 weeks ago

    Houston, Texas, United States Lyondell Basell North America Full time

    LyondellBasellBasic Function LyondellBasell has fully committed to achieving its vision as "The Chemical Company of the Future" and an industry leader in the areas of Sustainability and Customer Experience. The Digital Enterprise that will act as the foundation for enabling this vision will be built upon three pillars: A modern and extensible technology...

  • Data Engineer

    5 months ago

    Houston, Texas, United States Apollose Full time

    Responsiblities Developing and maintaining scalable reusable data pipelines for both streaming and batch requirements to support continuing increases in data volume and complexity for user accesses via dashboard report self-service data platform to structured and unstructured data. Data processing & QC checks across multiple layers of data warehouses...

  • Data Engineer

    1 week ago

    Houston, United States RJC Group Full time

    Data Engineer - Energy Trading - HoustonWe are working with a leading energy trading firm who are passionate about leveraging cutting-edge technology that are seeking a motivated Data Engineer to be responsible for building and maintaining their market data analytics for their trading team.You will work closely with quantitative analysts, data scientists and...

  • Data Engineer

    3 weeks ago

    Houston, United States Brooksource Full time

    Data EngineerBrooksourceFortune 500 Utility ClientDowntown Houston, TXOur client is scaling their Analytics organization and creating specialized verticals based on business unit. They need a senior-level Data Engineer to join the group that does Analytics Enablement for these verticals who will build data sets from unstructured sources to solve business...

  • Data Engineer

    17 hours ago

    Houston, United States Brooksource Full time

    Data EngineerBrooksourceFortune 500 Utility ClientDowntown Houston, TXOur client is scaling their Analytics organization and creating specialized verticals based on business unit. They need a senior-level Data Engineer to join the group that does Analytics Enablement for these verticals who will build data sets from unstructured sources to solve business...

  • Data Engineer

    3 months ago

    Houston, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerOffice Status: RemoteRequirements:Standard data engineering responsibilities such as building pipelines, etc. 5-10 years of experiencePython coding experienceDatabricks,Trino, DBT core expeienceSQL backgroundData Modeling

  • Battery Data Engineer

    7 days ago

    Houston, United States Fluence Full time

    Fluence is a leader in energy storage solutions, committed to innovation and excellence in battery technology. We are dedicated to advancing the integration of renewable energy and ensuring the reliability and efficiency of energy storage systems. Join our team and contribute to a sustainable future. We are seeking a highly skilled and experienced Senior...

  • Cloud Data Engineer

    9 hours ago

    Houston, Texas, United States Compunnel Inc. Full time

    Job DescriptionCompunnel Inc. is seeking a highly skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures.ResponsibilitiesData Engineering: Design, develop, and deploy scalable data pipelines and architectures to...

  • Lead Data Engineer

    1 month ago

    Houston, United States Compunnel Inc. Full time

    Required Skills & Experience* 10+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses* 2+ years of experience working as a lead and developing/mentoring other engineers* Strong proficiency in SQL, Python and PySpark programming languages* Strong experience with the Azure...

  • Data Engineer

    5 months ago

    Houston, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience...

  • Data Engineer

    5 months ago

    Houston, Texas, United States Tek Ninjas consulting services Full time

    Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets. Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience with the...

  • Lead Data Engineer

    2 days ago

    Houston, United States Harnham Full time

    As a Lead Data Engineer you will:Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient...

  • Sr Data Engineer

    2 months ago

    Houston, Texas, United States Apollose Full time

    Responsibilities Lead the development of our data warehousing strategy including data modeling and architecture. Design and maintain data models that facilitate data analytics reporting and machine learning. Ensure the data infrastructure meets the evolving needs of the organization with an emphasis on data warehousing solutions. Take the lead in ensuring...

  • Senior Data Engineer

    2 weeks ago

    Houston, United States Harnham Full time

    JOB SUMMARYAs a Sr. Data Engineer you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure. This position demands a blend of systems engineering, data integration, and data analytics skills to enhance our data capabilities, supporting advanced analytics, machine learning projects, and real-time data...

  • Jr. Data Engineer

    5 months ago

    Houston, Texas, United States Dash techology Full time

    Dash technology Job OverviewWe are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data...

  • Senior Data Engineer

    4 weeks ago

    Houston, United States Plains Full time

    Job Type:RegularPlains All American is an industry-leading transportation and midstream provider specializing in transportation, storage, processing and marketing solutions for crude oil and natural gas liquids (NGLs). We own an extensive network of pipeline transportation, terminalling, storage and gathering assets in key crude oil and NGL producing basins...

  • Data Engineer

    3 weeks ago

    Houston, United States LyondellBasell Full time

    LyondellBasell Basic Function LyondellBasell has fully committed to achieving its vision as “The Chemical Company of the Future” and an industry leader in the areas of Sustainability and Customer Experience. The Digital Enterprise that will act as the foundation for enabling this vision will be built upon three pillars: A modern and extensible...

Data Engineer

1 month ago

Houston, United States Solugen Full time

Solugen

Houston, TX 77035

Position

Data Engineer

Mission

Solugen’s mission is to decarbonize chemicals manufacturing. With Solugen’s first 10,000 tpy commercial plant up and running in Houston, TX the company is continuing to expand with new commercial plants under development and new molecules being developed for commercialization. As a Solugen Data Engineer the successful candidate will play a pivotal role, ensuring every byte of data, whether from mainstream sources like NetSuite and Salesforce or specialized streams like high-throughput Biology and Chemistry laboratories and sensors across our manufacturing facilities, is seamlessly channeled, processed, and made accessible to support this continued growth.

Key Responsibilities

  1. Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from disparate sources into data warehouses, data lake houses, or data lakes.
  2. Create and maintain data models including optimizing data schemas, tables, and indexes.
  3. Integrate data from multiple sources, including databases, APIs, and external data providers, to ensure comprehensive and up-to-date data availability.
  4. Implement data transformation processes to cleanse, enrich, and aggregate data as required for analysis.
  5. Develop and implement data quality checks and validation processes in line with the enterprise data quality program to identify and rectify data quality issues.
  6. Manage data warehouses, lake houses, or data lakes, optimizing performance, and ensuring data security and compliance with relevant regulations.
  7. Maintain documentation for data pipelines, data sources, and data models to facilitate collaboration and knowledge sharing.
  8. Optimize data infrastructure for performance, scalability, and cost-efficiency.
  9. Implement security measures to protect sensitive data and ensure compliance with relevant data privacy regulations, such as GDPR or HIPAA.
  10. Monitor data pipelines for errors or performance issues. Troubleshoot and resolve issues as they arise.
  11. Collaborate with data scientists, data analysts, developers, and other business stakeholders to understand data requirements and deliver data solutions that meet business needs.
  12. Other activities as defined by the department head.

Key Outcomes

  1. Holistic Data Integration: Efficiently extract and integrate varied data sources, from mainstream platforms like NetSuite and Salesforce to unique data from our high-throughput labs and manufacturing sensors.
  2. Tailored Connectors: Develop and deploy specialized connectors for unique data sources, leveraging tools like Fivetran when suitable, ensuring streamlined data flow into our cloud data store.
  3. ETL Excellence: Manage and optimize the transformation process within our cloud data store, ensuring data is ready for analysis.
  4. Analytics Tool Integration: Foster a seamless connection between our cloud data store and analytics tools such as Sigma or Tableau. Collaborate closely with data analysts and business stakeholders to ensure easy and efficient access to data insights.
  5. Collaborative Synergy: Work in tandem with data stewards to ensure data accuracy and integrity, and partner with data analysts, data scientists, and business stakeholders across the company, enabling their data-driven projects.

Key Competencies

Job Specific

  • Diverse Data Mastery: Comprehensive expertise in handling varied data sources, from conventional business platforms to specialized laboratory and manufacturing streams.
  • Integration Prowess: Demonstrated ability to connect data reservoirs to analytical tools, using pre-built connectors or custom solutions when necessary.
  • Technical Expertise: Deep familiarity with Python and SQL, as well as extensive experience in cloud-based data storage including, data lakes, data warehouses, and data lake houses warehousing; and ETL processes.
  • Collaborative Instinct: Natural inclination to work harmoniously with data stewards, data analysts, and business stakeholders, facilitating their access to and understanding of the data.
  • Forward-Thinking: Staying ahead of the curve in the evolving landscape of data engineering, incorporating best practices and innovative solutions to Solugen's processes

Company Specific

  • Ask a lot of questions, be curious, and have insights into your work.
  • Be nimble, embrace the speed and ambiguity of startup culture.
  • A passion for green chemistry and fighting climate change.
  • Ability to self-manage and set your own priorities and schedule.
  • Be comfortable working in multiple roles.
  • Emphasize safety above all else.
  • Respect for others.
  • Creative problem solving.
  • Willingness to learn and research new information technology/engineering/science concepts.

Qualifications

  • Bachelor's degree in a related field (e.g., Computer Science, Data Science, Information Management); a Master's degree is a plus.
  • Proficiency in programming languages such as Python, R, SQL, Java, or Scala.
  • Strong knowledge of database systems, SQL, and NoSQL databases.
  • Experience with data warehousing and ETL tools like Apache Spark, Apache Hadoop, or AWS Glue.
  • Familiarity with cloud computing platforms like AWS, Azure, or Google Cloud.
  • Understanding of data modeling techniques and data warehousing concepts.
  • Strong problem-solving and analytical skills, both written and verbal.
  • Excellent communication and collaboration skills.
  • Knowledge of data privacy and security regulations is a plus.
  • Ability to collaborate effectively with cross-functional teams and business stakeholders.
  • Chemical manufacturing industry experience.
  • Relevant certifications from cloud providers or data engineering organizations can be beneficial.
  • Experience with as many as possible of the below categories:
    • Data storage solutions such as data warehouses, data lakes, and lake houses, and associated tools
    • Tools and/or workflows to move data onto such storage solutions
    • Databases and Data Management tools, such as SQL Server, Postgress, etc.
    • Cloud computing platforms, AWS, Azure
    • Analytics tools such as Sigma or Tableau

Solugen is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, gender, sexual orientation, national origin, disability status, protected veteran status or any other legally protected status.