Python Data Engineer

4 weeks ago

Houston, United States ENVISN INCORPORATED Full time
Job Title: Python Data Engineer
Location: Houston, TX (Onsite role)
Duration: Long term contract
 
Job Description:
We are looking for a talented Data Engineer with expertise in Python data processing. The ideal candidate will have a strong background in Python API development, parallel data processing, and distributed systems design. You will be responsible for building and maintaining systems that handle large-scale data processing tasks, ensuring high performance and scalability.

Key Responsibilities:
Python API Development:
o    Develop and maintain RESTful APIs using Python web frameworks such as FastAPI or Django.
o    Collaborate with front-end developers to integrate user-facing elements with server-side logic.

Parallel Data Processing:
o    Utilize Pandas, NumPy, and other libraries to process large datasets efficiently.
o    Implement multithreading, multiprocessing, and asynchronous programming techniques.
o    Optimize data processing pipelines to handle millions of rows with minimal latency.

Distributed Systems Design:
o    Design and implement distributed systems with a focus on scalability and reliability.
o    Understand and apply core concepts such as load balancing and task queues.
o    Use Docker to containerize applications and manage dependencies.
o    (Preferred) Experience with Kubernetes for container orchestration.

Technical Communication:
o    Clearly articulate complex technical concepts to team members and stakeholders.
o    Document system designs, processes, and code effectively.
o    Collaborate with cross-functional teams to align on project goals and deliverables.

Must-Have Qualifications:
 Experience in Python Web Frameworks:
o    Proficiency with FastAPI, Django, or similar frameworks.
O   C# coding
o    Understanding of RESTful API principles and best practices.

Docker Knowledge:
 o    Ability to create and manage Docker Files.
 o    Experience with containerization for deployment and development workflows.
 
 Systems Design Understanding:
o    Basic knowledge of load balancing, task queues, and distributed system concepts.
o    Ability to design systems that are scalable and maintainable.

Concurrent and Parallel Computing Skills:
o    Proficiency in multithreading and multiprocessing without relying solely on external libraries or frameworks.
o    Familiarity with asynchronous programming, particularly asyncIO in Python.

Communication Skills:
o    Excellent technical communication abilities.
o    Experience collaborating in team environments and conveying complex ideas clearly.

Preferred Qualifications:
Education:
o    BS or MS in Computer Science

Advanced Data Processing Tools:
o    Experience with Polars, PySpark, or similar tools.
o    Handling of large-scale data processing tasks efficiently.

Distributed Computing Experience:
o    Hands-on experience with distributed architectures in Docker.
o    Familiarity with concepts like task queuing, MapReduce, and saga patterns.

Kubernetes Experience:
o    Knowledge of container orchestration using Kubernetes.
o    Experience deploying and managing applications in a Kubernetes cluster.

Problem-Solving at Scale: 
o    Demonstrated ability to solve complex problems using parallel or distributed computing. 
o    Innovative thinking beyond single-threaded processes.
 

  • Python Data Engineer

    4 days ago

    Houston, United States Clearpoint Full time

    TITLE: Python Data Engineer CLIENT: Oil & Gas LOCATION: Downtown Houston TYPE: Contract RATE: DOE URGENCY: Open to interview and hire WORK SCHEDULE: 5 days a week on-site-location-downtown Houston area (LOCAL HOUSTON CANDIDATES PLEASE) SUMMARY: Excellent opportunity to work for an organization that has continuously been voted as one of the best companies to...

  • Python Data Engineer

    3 days ago

    Houston, United States ENVISN INCORPORATED Full time

    Job Title: Python Data Engineer Location: Houston, TX (Onsite role) Duration: Long term contract Job Description: We are looking for a talented Data Engineer with expertise in Python data processing. The ideal candidate will have a strong background in Python API development, parallel data processing, and distributed systems design. You will be responsible...

  • Senior Python Data Engineer

    4 weeks ago

    Houston, Texas, United States ENVISN INCORPORATED Full time

    **Job Title:** Senior Python Data Engineer**Location:** Onsite role**Duration:** Long term contractWe are seeking an experienced Python Data Engineer to join our team at ENVISN INCORPORATED. The ideal candidate will have a solid background in DevOps and at least 5 years of hands-on experience with Python Data Engineering.The successful candidate will be able...

  • Senior Python Data Engineer

    4 weeks ago

    Houston, Texas, United States ENVISN INCORPORATED Full time

    Job Title: Senior Python Data EngineerLocation: Onsite roleDuration: Long term contractAs a seasoned Python Data Engineer, you will be responsible for designing and implementing data engineering solutions. A solid DevOps background is required for this position. You must be able to work onsite and have at least 5 years of hands-on experience with Python Data...

  • Senior Python Engineer

    1 month ago

    Houston, Texas, United States The Dignify Solutions LLC Full time

    Key Responsibilities:As a Senior Python Engineer at The Dignify Solutions LLC, you will be responsible for leveraging your expertise in Python development to drive business growth. With a strong background in Django framework and time series data, you will design and implement efficient solutions to meet the company's needs.Requirements: 5+ years of...

  • Senior Python Software Engineer

    4 weeks ago

    Houston, Texas, United States CloudBC Labs Full time

    Key Responsibilities:As a Python Developer at CloudBC Labs, you will be responsible for building internal data applications using Python scripting.Technical Requirements:* Strong experience with Oracle and PL/SQL* Experience with data engineering projects, including generative AI and ML* API development using Rest API Dev and messaging platforms like...

  • Data Engineer

    4 weeks ago

    Houston, Texas, United States VMC Soft Technologies , Inc Full time

    Job Title: Python Data EngineerJob Description:We are seeking a skilled Data Engineer with expertise in Python data processing to join our team at VMC Soft Technologies, Inc. The ideal candidate will have a strong background in Python API development, parallel data processing, and distributed systems design.Key Responsibilities:Python API Development:Develop...

  • Data Engineer

    4 weeks ago

    Houston, Texas, United States The Select Group Full time

    Data Engineer Job DescriptionThe Select Group is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for developing, constructing, testing, and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing.Key Responsibilities:Develop...

  • Senior Data Engineer

    4 weeks ago

    Houston, Texas, United States ShiftCode Analytics Full time

    Job Description:At ShiftCode Analytics, we are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have 12+ years of experience in designing and implementing data pipelines, with a strong focus on Python and ETL. Prior experience with data lakes is also required.Key Responsibilities:Design and...

  • GoLang/Python Engineer

    3 weeks ago

    Houston, United States Saxon Global Full time

    USC, GC Job Title: GoLang/Python Engineer Client: HPE Location: Remote Duration: 1 year Rate: $70-75/hr on C2C Skills GoLang, Python, CICD, Gitlab, Kubernetes, Jenkins, Terraform, Aruba. WWT is looking for GoLang/Python Engineer that will be responsible for designing, implementing, and maintaining the infrastructure for a major client platform, with a focus...

  • Senior Software Engineer

    4 weeks ago

    Houston, Texas, United States DRW Full time

    DRW is a leading diversified trading firm with a rich history of innovation and excellence in the commodities trading industry. We are seeking a highly skilled Senior Software Engineer (Python) to join our Commodities Trading group and contribute to the development of a first-in-class platform for quantitative and fundamental research.The ideal candidate...

  • Data Engineer

    2 weeks ago

    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    2 weeks ago

    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    3 weeks ago

    Houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BICommunication with business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    3 weeks ago

    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BIOOOOb experienceCommunication with E&P business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    3 weeks ago

    houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BIOOOOb experienceCommunication with E&P business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    3 weeks ago

    Houston, United States Addison Group Full time

    Looking for a Data Engineer in the Houston area able to go onsite 3x a week with a background working in Oil and Gas!Description:SQL: writing views; Snowflake a plusPython: ETL workflows with REST endpointsPower BIOOOOb experienceCommunication with E&P business stakeholdersAbility to work with large datasetsMake adjustments and fixes to data reports

  • Data Engineer

    2 months ago

    Houston, United States VC5 Consulting Full time

    We are looking for highly-motivated individuals who enjoy working as part of a team in a dynamic and entrepreneurial work environment. Position Summary: The company is initiating new initiatives within the Enterprise Data Engineering team where an experienced Azure Data Engineer.  We are seeking someone who can demonstrate their qualifications and...

  • Python Engineer

    2 months ago

    Houston, United States Jobot Full time

    Job DescriptionJob DescriptionGreat compensation and growth potential!This Jobot Job is hosted by: Jason LeonardAre you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume.Salary: $100,000 - $140,000 per yearA bit about us:Our client if a large global organization in the energy industry looking to add to their growing team!Why...

  • Data Architect

    2 months ago

    houston, United States KWA Analytics Full time

    We are seeking Databricks Architect and Engineers based in US or Canada. You will be responsible for serving as a member of the Data Engineering Solution team supporting the client’s Trading-related data platform solutions and project implementation. The location can be Houston or remote with flexibility to travel.ResponsibilitiesProvides operational...