Python/Data Engineer

1 day ago

New York, United States Inficare Full time

UST is looking for a talented and versatile Java / Python Microservice Data Engineer to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and microservices that facilitate the seamless flow of data across our systems. Your expertise in both Java and Python programming languages will be crucial in building scalable and efficient data solutions.
Primary Responsibilities-Strong proficiency in backend Python development, with a strong familiarity with FastAPI and asynchronous programming.
-Strong proficiency in cloud-native architecture. Azure experience is preferred but not mandatory.
-Strong proficiency in containerization and orchestration using Docker and Kubernetes.
-Strong proficiency in DevOps / CI/CD, particularly with GitHub workflows.-Proficiency in at least one JVM language (Java, Kotlin, Scala) and experience in backend development with any web framework such as Spring Boot, Vert.x, Javalin, etc.
-Proficiency in Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, Pulumi, or Bicep, with a preference for Terraform.
-Proficiency in database technologies, with a preference for Snowflake.
Qualifications &
Experience
6+ Years of experience with Bachelor's / Masters degree in Computer Science, Engineering, or a related field.
Strong understanding of data modeling, data structures, and algorithms.
Knowledge of cloud-based data services and platforms (AWS, Azure, GCP) is a plus.
Understanding of DevOps practices and containerization technologies (Docker, Kubernetes) is advantageous.
Strong communication skills and ability to work collaboratively in a team-oriented environment.
Significant experience of designing, deploying, and supporting production cloud environments like Azure and Kubernetes
Additional Qualifications -Financial proven experience: Capital markets/Private Equity and/or securities processing-Understanding of cloud-native RBAC models is a plus.
-Familiarity with LLM frameworks such as Langchain, Langgraph, Semantic Kernel, OpenAI SDK, is a plus but not required
.-Understanding of MLOps, LLMOps is also a plus but not required.
Soft Skills:-Has extensive experience working remotely with a global team and possesses excellent communication skills, both verbal and written.
-Is a proven problem solver, capable of complete transparency through the RFC, design, and execution phases
.-Thrives in a hyper-paced environment.
Experience in start-ups, series-A, series-B stages is a huge plus.
-Has a strong discipline and foundational understanding of 12-factor app development.
- Strong proficiency in backend Python development, with a strong familiarity with FastAPI and asynchronous programming.
- Strong proficiency in cloud-native architecture. Azure experience is preferred but not mandatory.
- Strong proficiency in containerization and orchestration using Docker and Kubernetes.
- Strong proficiency in DevOps / CI/CD, particularly with GitHub workflows.
- Proficiency in at least one JVM language (Java, Kotlin, Scala) and experience in backend development with any web framework such as Spring Boot, Vert.x, Javalin, etc.
- Proficiency in Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, Pulumi, or Bicep, with a preference for Terraform.
- Proficiency in database technologies, with a preference for Snowflake
Also ensure that while they have worked on most of these skills, they should be heavier in the programming side. Few profiles heavy on Dev Ops side were rejected by him.

  • Python Data Engineer

    2 days ago

    New York, United States CloudBC Labs Full time

    Python Data EngineerNew York, Charlotte, NCW2 Role Job Responsibilities: Integration Engineer responsible for daily support and project-based development of credit risk management systems. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. This is an...

  • Data Engineer for Cloud Data Platforms

    4 weeks ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on Snowflake, FiveTran, and DBT.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team and help our...

  • Data Engineer for Cloud Data Platforms

    1 month ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...

  • Data Engineer for Cloud Data Platforms

    2 weeks ago

    New York, New York, United States The Data Sherpas Full time

    Job Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...

  • Data Engineering Specialist

    1 week ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...

  • Data Engineer for Cloud Data Platforms

    2 weeks ago

    New York, New York, United States The Data Sherpas Full time

    Who We Are:The Data Sherpas are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. We have expertise in cloud, data, and applications, and we're passionate about delivering innovative solutions that drive business value.What We're Looking For:We're seeking a self-motivated and data-driven engineer to...

  • Senior Azure Data Engineer

    1 week ago

    New York, New York, United States Hudson Data Full time

    Job Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...

  • Azure Data Engineer

    2 weeks ago

    New York, New York, United States Hudson Data Full time

    Job Title: Azure Data Engineer - Design and Implement Data SolutionsLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate will have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes,...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Akraya Full time

    Job Summary:A leading fortune 500 Media and Entertainment company is seeking a Senior Data Engineer with expertise in Scala and Python to abstract complex business logic and drive the success of the Core Data platform. The ideal candidate will collaborate with product managers, architects, and engineers to develop and document standards and best practices...

  • Senior Data Engineer

    1 week ago

    New York, New York, United States Capgemini Full time

    Role SummaryCapgemini is seeking a highly skilled Senior Data Engineer - Python/PySpark to join our dynamic data engineering team. The ideal candidate will have a strong background in building scalable distributed data processing systems using PySpark and working on large datasets.Key ResponsibilitiesCollaborate with data scientists engineers and other...

  • Data Engineer Python LLM Specialist

    2 weeks ago

    New York, New York, United States Jobot Full time

    About UsWe're a fast-growing SaaS company with a stable and supportive leadership team. Our company culture values collaboration, open-mindedness, and a willingness to speak up.Job DetailsWe're seeking an experienced data engineer with a strong background in building out data pipelines and storage procedures for large amounts of data. The ideal candidate...

  • Data Engineer

    4 weeks ago

    New York, United States Randstad Digital Full time

    job summary:The ideal candidate should have proficiency in Python programming language and experience in Extract, Transform, Load (ETL) processes. They should be able to design and develop efficient ETL workflows to extract data from various sources, transform it as per business requirements, and load it into target systems.The candidate should also have...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States The Data Sherpas Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...

  • Principal Data Engineer

    3 weeks ago

    New York, United States Randstad Digital Full time

    Job DescriptionWe are seeking Data Engineers in a contract capacity to join our talented Data Onboarding Engineering team. In this role, you'll contribute to building robust data pipelines that ingest over 30TB of data each day.You will take on the following responsibilities:Work closely with business partners across org to understand their data needsWork...

  • Senior PySpark/Python Engineers

    1 day ago

    New York, United States Tech Tammina Full time

    Senior Fullstack Pyspark / Python Engineers Location: NYC, NY Duration: 1+ YearThe client is looking for Senior PySpark/Python Engineers who can: Improve performance and user experience of new applications. Work with data lakes, data warehouses, and ETL processes. Contribute to digital transformation projects. Utilize Agile software development frameworks....

  • Scala / Python Engineer

    2 weeks ago

    New York, United States Eliassen Group Full time

    W2 OnlyLOCATION: On site in NYC 4 days/weekOur major streaming client is seeking a Senior Software Engineer - you will be working on building highly resilient and scalable data pipelines which will publish enriched data of transactions into their Data Lake and analytical data warehouses. This role is highly multi-functional and gives the opportunity to work...

  • Principal Data Engineer

    2 weeks ago

    new york city, United States Randstad Digital Full time

    Job DescriptionWe are seeking Data Engineers in a contract capacity to join our talented Data Onboarding Engineering team. In this role, you'll contribute to building robust data pipelines that ingest over 30TB of data each day.You will take on the following responsibilities:Work closely with business partners across org to understand their data needsWork...

  • Principal Data Engineer

    3 weeks ago

    new york city, United States Randstad Digital Full time

    Job DescriptionWe are seeking Data Engineers in a contract capacity to join our talented Data Onboarding Engineering team. In this role, you'll contribute to building robust data pipelines that ingest over 30TB of data each day.You will take on the following responsibilities:Work closely with business partners across org to understand their data needsWork...

  • Python Engineer

    3 weeks ago

    New York, United States Planet Technology Full time

    INTERGRATIONS ENGINEER Hours: 40 hours per weekLocation: Hybrid, 3 days onsite (T, W, TH), 2 remote****Vaccination: full vaccination and most updated (2023-2024) boosters are a MUST; you have 30 days upon first day of employment to receive this if you don’t have itBackstory: As a team they have software engineers and they are moving toward full stack...

  • Senior PySpark/Python Engineer

    2 weeks ago

    New York, New York, United States Tech Tammina Full time

    Job SummaryWe are seeking a highly skilled Senior PySpark/Python Engineer to join our team at Tech Tammina. The ideal candidate will have a strong background in PySpark, Python, and data engineering, with experience in improving performance and user experience of new applications.Key ResponsibilitiesImprove performance and user experience of new...