Data Engineer

5 days ago


Houston, United States AgileEngine Full time
Job Description
AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions

If you like a challenging environment where you're working with the best and are encouraged to learn and experiment every day, there's no better place - guaranteed :)

What you will do

  • Work collaboratively with other engineers, architects, data scientists, analytics teams, and business product owners in an agile environment;
  • Architect, build, and support the operation of Cloud and On-Premises enterprise data infrastructure and tools;
  • Design and build robust, reusable, and scalable data driven solutions and data pipeline frameworks to automate the ingestion, processing and delivery of both structured and unstructured batch and real-time streaming data;
  • Build data APIs and data delivery services to support critical operational processes, analytical models and machine learning applications;
  • Assist in selection and integration of data related tools, frameworks, and applications required to expand platform capabilities;
  • Understand and implement best practices in management of enterprise data, including master data, reference data, metadata, data quality and lineage.
Must haves
  • 4+ years of experience with Python or Java (Python preferably, or willingness to work with this language);
  • 4+ years of experience in building data lake, cloud data platform leveraging cloud (GCP/AWS) cloud native architecture, ETL/ELT, and data integration ;
  • Three years of development experience with cloud services ( AWS,GCP,AZURE) utilizing various support tools (e.g. GCS, Dataproc, Cloud Data flow, Airflow(Composer), Kafka , Cloud Pub/Sub);
  • Expertise in developing distributed data processing and Streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink);
  • Experience with Snowflake is a must;
  • In-depth knowledge of NoSQL database technologies (e.g. MongoDB, BigTable, DynamoDB);
  • Expertise in build and deployment tools - (Visual Studio, PyCharm, Git/Bitbucket/Bamboo, Maven, Jenkins, Nexus);
  • 4+ years of experience and expertise in database design techniques and philosophies (e.g. RDBMS, Document, Star Schema, Kimball Model);
  • 4 years of experience with integration and service frameworks (e.g API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices);
  • Expertise with containerized Microservices and REST/GraphQL based API development;
  • Experience leveraging continuous integration/development tools (e.g. Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a Ci/CD pipeline;
  • Advanced understanding of software development and research tools;
  • Attention to detail and results oriented, with a strong customer focus;
  • Ability to work as part of a team and independently;
  • Analytical and problem-solving skills;
  • Problem-solving and technical communication skills;
  • Ability to prioritize workload to meet tight deadlines;
  • Should have working experience with wealth asset management projects;
  • Upper-intermediate English level.
Nice to haves
  • Airflow;
  • Big Query;
  • Kafka.
The benefits of joining us
  • Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.
  • Data Engineer

    3 months ago


    Houston, United States Jobot Full time

    Job DescriptionJob Description100% Remote, Silicon Valley Health & Wellness start-up, Salary + EquityThis Jobot Job is hosted by: Duran WorkmanAre you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume.Salary: $70,000 - $85,000 per yearA bit about us:We are currently seeking a highly skilled and motivated Data Engineer to join...

  • Data Engineer

    2 weeks ago


    Houston, United States SysMind Tech Full time

    Title: Data Engineer Location: Houston, TX (On-site) Client: Quest Global/Halliburton Roles: This role is a part of the Production Enhancement Data Backbone team. The team, as well as a successful candidate, will create useful data products to be used in operations, data science modeling, business intelligence, and reporting. Overview: The candidate...

  • Data Engineer

    2 weeks ago


    Houston, United States TEKsystems Full time

    *Description:* Top Skills' Details 1. Snowflake 2. SQL 3. Upstream Oil & Gas - operations & production, GGRE, wells, supply chain 4. Work hand-in-hand with stakeholders to migrate, integrate, and test all of the data across the industry This project is to impact the validation & migration of data within operations & production, maintenance and reliability,...

  • Data Engineer

    2 weeks ago


    Houston, United States Chord Energy Full time

    Position Summary Chord Energy is looking for an experienced Data Engineer to join our Data Solutions Team. This individual must have a strong foundation in data engineering and experience building data analytics solutions. The successful candidate will work with Microsoft Azure Data Factory, Airbyte, DBT or similar data pipeline tools, and will have...

  • Data Engineer

    2 weeks ago


    Houston, United States OTTER PRODUCTS, LLC DBA OTTERBOX Full time

    The Data Engineer applies professional experience, concepts, and company objectives toward building and operationalizing the minimally inclusive data necessary for the enterprise data initiatives following industry standard practices and tools. The bulk of the Data Engineer’s work would be in designing, managing and optimizing data pipelines, then moving...

  • Cloud Data Engineer

    1 week ago


    Houston, Texas, United States FIRST SOFTSOLUTIONS INC Full time

    We are seeking a highly skilled Data Engineer to join our team at First Softsolutions Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data structures, pipelines, and efficient ETL workflows to support our business applications.Key Responsibilities:Design and develop scalable data...


  • Houston, Texas, United States Dimensional Fund Advisors, L.P. Full time

    About Dimensional Fund Advisors, L.P.We're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer at Dimensional, you'll be responsible for designing and developing robust, secure, and maintainable data architectures, pipelines, and services.Key Responsibilities:Design and engineer data solutions across various domains,...


  • Houston, Texas, United States Lorven Technologies Full time

    • We are seeking a highly skilled and experienced Senior Data Engineer to join our team at Lorven Technologies.• As a Senior Data Engineer, you will be responsible for designing, developing, and implementing robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.• You will ensure scalable, reliable, and...


  • Houston, United States Brooksource Full time

    Data Engineer ManagerLocation: On-site in Houston, TX 5 times a yearMust live in one of the following states: TX, GA, FL, LA, SC, TN, IN, NE, OKJob Type: Full-time Overview:We are seeking an experienced Data Engineer Manager to lead a team of data engineers and oversee data ingestion from Epic and other platforms into our Snowflake data warehouse. This role...


  • Houston, Texas, United States Gulf States Toyota Full time

    Gulf States Toyota is seeking a highly skilled Data Engineer to join our Data Science and Analytics team. This is an excellent opportunity for a motivated individual to leverage their expertise in designing, implementing, and managing robust data platforms.About the RoleThe successful candidate will play a crucial role in architecting and implementing...

  • Azure Data Engineer

    4 days ago


    Houston, United States Strategic Staffing Solutions Full time

    STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!Job Title: Azure Data Engineer - Hiring FAST!Location: Houston, TX Pay Rate: upto 75$ on W2 hourly Setting: RemoteDuration: 3 months contract with a possibility to convert/extend Required Qualifications: 8+ years professional experience with data engineering and orchestration. Highly proficient skill level...

  • Data Engineer

    2 weeks ago


    Houston, United States Apex Health Solutions Full time

    Description Summary: The Data Engineer will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision-making. In this role, the Data Engineer will play a critical role in connecting our partners and enabling our critical solutions using...


  • Houston, United States Understanding Recruitment Full time

    Principal Data Engineer - Houston, TX - Automotive What You'll Be Doing:As a Principal Data Engineer, you'll be the architect of the data ecosystem, transforming complex data challenges into powerful insights. Your key responsibilities include:Designing cutting-edge data solutions on Databricks, creating robust data warehouses and lakesBuilding scalable data...


  • Houston, Texas, United States Oasis Petroleum Full time

    Job SummaryWe are seeking an experienced Data Engineer to join our team at Chord Energy in downtown Houston.Main ResponsibilitiesDesign, develop, and maintain robust data architecture using Microsoft Azure Services, Airbyte, DBT, or similar data pipeline tools.Ensure data pipelines are reliable, efficient, and scalable for large-scale data...

  • Data Engineer

    1 month ago


    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    1 month ago


    Houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    4 weeks ago


    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports


  • Houston, Texas, United States Data Management Group Full time

    Job OverviewWe are seeking a highly skilled Senior Cybersecurity Operations Engineer to join our team at Data Management Group. The ideal candidate will have extensive experience in planning and operating security infrastructure, including managing host-based security systems and network IDS/IPS systems.Estimated SalaryThe estimated salary for this position...

  • Senior Data Engineer

    2 weeks ago


    Houston, United States HCSS Employer, Inc. Full time

     We’re HCSS. We’re a software company based in Sugar Land, TX and we provide innovative solutions for the construction industry that help streamline their operations. Our mission at HCSS is to help customers dramatically improve their business through our innovative, high-quality software and exceptionally helpful service while providing a great life...


  • Houston, Texas, United States ClearpointCo. Full time

    Job SummaryWe are seeking a skilled Data Engineer to join our team in Houston, TX. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines to support our data-driven business.The ideal candidate will have 3+ years of experience in data engineering with a focus on Python and will work closely with our Data...