Senior Data Engineer

12 hours ago

Houston, TX, United States Elios, Inc. Full time
Senior Data Engineer - (100% Remote)

  • Fully Remote: Work from anywhere with flexible hours that fit your lifestyle.
  • Award-Winning Culture: Be part of a company recognized for exceptional employee satisfaction, inclusivity, and professional development.
  • Competitive Compensation: Generous salary, performance bonuses, and comprehensive benefits package.
  • Professional Growth: Access to mentorship programs, certifications, and opportunities to advance your career.
  • Cutting-Edge Tech: Work with state-of-the-art tools and technologies on impactful, high-visibility projects.
Key Responsibilities:
  • Design and implement scalable, efficient data pipelines using Azure Data Lake, Databricks, Snowflake, and Synapse Analytics.
  • Develop and optimize workflows with Apache Spark and Scala for batch and streaming data processing.
  • Build, maintain, and enhance robust ETL/ELT pipelines tailored to big data applications within Azure ecosystems.
  • Manage and optimize data storage solutions like Azure Data Lake Storage, Snowflake, and Synapse Analytics to ensure peak performance and cost-efficiency.
  • Partner with data scientists, analysts, and business teams to ensure the reliability and availability of data platforms.
  • Monitor and fine-tune the performance of data platforms in production environments.
  • Enforce best practices for data governance, security, and compliance in Azure-based data frameworks.
  • Stay ahead of the curve by researching and integrating new big data technologies to enhance scalability and performance.
Requirements:

Essential Skills and Experience:
  • A minimum of 5 years of experience in data engineering or related fields.
  • At least 3 years of hands-on expertise in Apache Spark using Scala.
  • Advanced knowledge of Azure data services, including Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory.
  • Proficiency with Snowflake, including schema design, performance optimization, and integration with cloud platforms.
  • Solid expertise in cloud-based big data solutions, particularly within the Azure ecosystem.
  • Strong knowledge of data modeling, ETL/ELT pipelines, and database concepts.
  • Experience with streaming platforms such as Spark Streaming, Kafka, or Event Hubs.
  • Familiarity with data lake and data warehouse architecture (e.g., Delta Lake, Snowflake, Synapse).
  • Proficiency in DevOps practices, including CI/CD pipelines for data engineering workflows.
Preferred Skills:
  • Knowledge of Python for data engineering tasks.
  • Experience with Azure Machine Learning or other machine learning platforms integrated with data workflows.

  • Senior Data Engineer

    11 hours ago

    Houston, TX, United States Gateway Recruiting Full time

    Job Description: The Senior Data Engineer will support the development, maintenance, optimization, and use of the Company’s data infrastructure. This role is looking for a collaborative, well-rounded professional with expertise in building scalable data solutions and enabling data-driven insights. As a key member of the growing data team, the Senior Data...

  • Senior Data Engineer

    3 days ago

    Houston, TX, United States Best Flow Full time

    Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of data-driven...

  • Senior Data Engineer

    8 hours ago

    Houston, TX, United States LINQX Full time

    Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of data-driven...

  • Senior Data Engineer

    9 hours ago

    Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...

  • Senior Data Engineer

    1 week ago

    Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...

  • Senior Data Engineer

    1 week ago

    Houston, TX, United States Scout 1 Solutions Full time

    Senior Data Engineer (Contractor - Hybrid, Houston, TX) Core Requirements: Python: Advanced proficiency for scripting, ETL/ELT, and pipeline automation. Snowflake: Hands-on experience with query tuning, security (RBAC, dynamic masking), data sharing, and cost optimization. Key Responsibilities: Design and optimize scalable data pipelines (batch/real-time)...

  • Senior Data Engineer

    2 weeks ago

    Houston, TX, United States Wilks Brothers Full time

    Overview Company Information: LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector, leveraging advanced data analytics to optimize engineering and operations. Its cloud-based platforms deliver AI-driven insights that enhance reservoir performance and streamline workflows. Driven by a mission of...

  • Senior Data QA Engineer

    1 week ago

    Houston, TX, United States RxVantage Full time

    Senior Data QA Engineer We're looking for a US based Senior Data QA Engineer to join our high-performing, fully remote engineering team. This is a senior-level role for someone who thrives in fast-paced environments, excels at solving complex problems, and is comfortable leading technical initiatives across product, data, and analytics domains through both...

  • Senior Software Engineer in Test, Data

    2 weeks ago

    Houston, TX, United States DoiT International Full time

    Senior Software Engineer In Test, Data / ETL Senior Software Engineer In Test, Data / ETL Location: Remote Estonia Our Senior Software Engineer In Test, Data / ETL will be an integral part of our Engineering team in EMEA. This full-time remote role is open to employees based in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel, and to contractors...

  • Senior Software Engineer in Test, Data

    2 weeks ago

    Houston, TX, United States DoiT International Full time

    Senior Software Engineer In Test, Data / ETL Senior Software Engineer In Test, Data / ETL Location: Remote Estonia Our Senior Software Engineer In Test, Data / ETL will be an integral part of our Engineering team in EMEA. This full-time remote role is open to employees based in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel, and to contractors...