AWS Data Engineer

3 weeks ago

Houston, United States QUANTEAM (Groupe RAINBOW PARTNERS) Full time

As the founding entity of RAINBOW PARTNERS, Quanteam is a consulting firm specializing in the fields of Banking, Finance, and Financial Services. Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 1,000 expert consultants, representing 35 different nationalities, collaborates across 10 international offices: Paris, Lyon, New York, Montreal, London, Brussels, Geneva, Lisbon, Porto and Casablanca.


Overview:


We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have extensive experience with Python, particularly Pandas and Numpy, and deep knowledge of AWS services. This role is essential for developing dashboards and generating KPIs to visualize our client's activities in wind and solar energy sectors.


Key Responsibilities:


- Design, develop, and maintain data pipelines and ETL processes using Python (Pandas & Numpy).

- Leverage AWS services (such as S3, Lambda, Redshift, EC2, and RDS) to manage and process large datasets.

- Develop interactive and responsive dashboards using Grafana, Dash Plotly, and AG Grid.

- Utilize data visualization tools like Tableau or Power BI to create comprehensive and insightful reports.

- Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.

- Implement best practices in data management and ensure data integrity and quality.

- Optimize data workflows and pipelines for performance and scalability.

- Maintain clear and detailed documentation of data processes and workflows.

- Lead projects from concept to deployment, ensuring timely delivery and adherence to project goals.


Requirements:


- Minimum 5 years of experience working with Python, including Pandas and Numpy.

- Strong experience with AWS services (S3, Lambda, Redshift, EC2, RDS).

- Proven experience in UI Development and creating dashboards with Grafana, Dash Plotly, and AG Grid.

- Proficiency in data visualization tools like Tableau or Power BI.

- AWS certification (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics) is required.

- Experience managing projects involving data visualization and KPI generation.

- Strong problem-solving skills and ability to work independently as well as in a team.

- Excellent communication skills and the ability to translate technical concepts to non-technical stakeholders.

- Bachelor's degree in Computer Science, Information Technology, or a related field.

  • Lead Data Engineer

    2 weeks ago

    Houston, United States myGwork - LGBTQ+ professionals & allies Full time

    This inclusive employer is a member of myGwork – the largest global platform for the LGBTQ+ business community. Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorgan...

  • Sr. Snowflake Data Engineer

    5 days ago

    Houston, United States Delphi-US Full time

    Job Title: Sr. Snowflake Data Engineer (Contract) - Job#4996Worksite: Houston TX (Onsite 3x/week) Tue-Thurs. You will help optimize data flow and collection across our Business Portfolio. Play an active role in our pipelines, data wrangling, and optimization of data systems builds from the ground up. Support data product owners, developers, data architects,...

  • Sr. Data Engineer

    1 month ago

    Houston, United States Recru Full time

    We're looking for a Senior AWS Data Engineer skilled in Python open to working hybrid in Houston! This role is contract-to-hire. PurposeEstablish data feeds to the digital platform and manage ETL processes. Design raw file data structures to be used in data science applications. Associated commercial data includes data required for forecasting, analysis,...

  • Sr. Data Engineer

    3 weeks ago

    Houston, United States Recru Full time

    We're looking for a Senior AWS Data Engineer skilled in Python open to working hybrid in Houston! This role is contract-to-hire. PurposeEstablish data feeds to the digital platform and manage ETL processes. Design raw file data structures to be used in data science applications. Associated commercial data includes data required for forecasting, analysis,...

  • Sr. Data Engineer

    1 month ago

    Houston, United States Recru Full time

    We're looking for a Senior AWS Data Engineer skilled in Python open to working hybrid in Houston! This role is contract-to-hire. PurposeEstablish data feeds to the digital platform and manage ETL processes. Design raw file data structures to be used in data science applications. Associated commercial data includes data required for forecasting, analysis,...

  • Sr Data Engineer

    2 weeks ago

    Houston, United States IntagHire Full time

    Senior Data Engineer Real-time Operations (Python/AWS) - Onsite in Houston, TX. Fulltime position with a benefits package. No C2C please. Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the clients development teams, you will...

  • Sr Data Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Senior Data Engineer Real-time Operations (Python/AWS) - Onsite in Houston, TX. Fulltime position with a benefits package. No C2C please. Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the clients development teams, you will...

  • Sr Data Engineer

    2 weeks ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    2 weeks ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    1 week ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Sr Data Engineer

    2 weeks ago

    Houston, United States IntagHire Full time

    Senior Data Engineer – Real-time Operations (Python/AWS) - Onsite in Houston, TX.Fulltime position with a benefits package. No C2C please.Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will...

  • Senior Data Engineer

    4 days ago

    Houston, United States Virtual Full time

    ** Sr. Data Engineer ** ** Direct Hire – no C2C **  eligible to work without sponsorship ** onsite in West Houston ** We have the following Senior Data Engineer role that plays a crucial role in architecting, implementing, and managing robust, scalable data infrastructures. This position demands a blend of systems engineering, data integration, and data...

  • Senior Data Engineer

    3 weeks ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Data Engineer

    3 weeks ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Senior Data Engineer

    1 week ago

    Houston, United States Harnham Full time

    Title: Senior Data Engineer Location: Houston, TX 77077 - Onsite 4 days per week. Overview of Role:As Senior Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems...

  • Trading Data Engineer

    2 weeks ago

    Houston, United States Trafigura Group Pte. Ltd. Full time

    Main Purpose: We are recruiting an experienced data engineer to work directly with the traders and research analysts in the Gas and Power teams in our Houston office. This is an exciting opportunity to work in a fast-paced commercial setting, playing a critical role in a real time, data driven trading environment. Whilst being physically co-located with the...

  • Trading Data Engineer

    1 week ago

    Houston, United States Trafigura Group Pte. Ltd. Full time

    Main Purpose: We are recruiting an experienced data engineer to work directly with the traders and research analysts in the Gas and Power teams in our Houston office. This is an exciting opportunity to work in a fast-paced commercial setting, playing a critical role in a real time, data driven trading environment. Whilst being physically co-located with the...

  • Trading Data Engineer

    5 days ago

    Houston, United States Trafigura Group Pte. Ltd. Full time

    Main Purpose: We are recruiting an experienced data engineer to work directly with the traders and research analysts in the Gas and Power teams in our Houston office. This is an exciting opportunity to work in a fast-paced commercial setting, playing a critical role in a real time, data driven trading environment. Whilst being physically co-located with the...

  • Data Engineer

    3 weeks ago

    Houston, United States IDR, Inc. Full time

    IDR is seeking a Data Engineer to join one of our top clients for a Hybrid Position in the Houston, TX area! If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!Position Overview & Responsibilities for the Data Engineer:They are responsible for working closely with...

  • Data Engineer

    3 weeks ago

    Houston, United States IDR, Inc. Full time

    IDR is seeking a Data Engineer to join one of our top clients for a Hybrid Position in the Houston, TX area! If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!Position Overview & Responsibilities for the Data Engineer:They are responsible for working closely with...