Sr Python Data Engineer WellsFargo

3 days ago

Princeton, NJ, United States Damco Solutions Full time
Job Description:

Title - Sr Python Data Engineer

Location - Charlotte, NC / Iselin, NJ (Hybrid)

Duration- Contract to Hire

Responsibilities & Requirements:
We are seeking an experienced Python Data Engineer to join our team for a critical platform migration project. The ideal candidate will be responsible for developing, testing, and optimizing Python applications to ensure smooth migration and integration with the platform. This role requires strong expertise in Python, microservices, and integration with various data storage solutions.
Key Responsibilities:
  • Develop and maintain Python applications and microservices for platform migration.
  • Design and develop robust Data processes using Python and PySpark to extract, transform, and load data from various sources.
  • Implement best practices for data management, including data governance and security.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Rewire existing Python microservices to connect with the cluster and S3 storage.
  • Collaborate with cross-functional teams to assess and implement compatibility with the environment.
  • Update and optimize Python code to ensure compatibility with new data formats and cloud computer environments.
  • Implement and support CI/CD pipelines, including automated testing and deployment processes.
  • Troubleshoot and resolve issues related to Python applications and their integration with the platform.
  • Monitor and troubleshoot ETL processes, ensuring timely data delivery and addressing any data quality issues.
  • Contribute to document, including code comments and technical guides, to support future development and maintenance.
Qualifications:
  • Proven experience as a Python Developer, with a strong portfolio of relevant projects.
  • knowledge of Python programming, including frameworks such as Django or Flask.
  • Experience with microservices architecture and API development.
  • Familiarity with data storage solutions like S3 and databases such as Oracle and Postgres.
  • Understanding of CI/CD pipelines and automated testing tools.
  • Strong problem-solving skills and the ability to work collaboratively in a team environment.
  • Excellent communication skills and attention to detail.
Preferred Skills:
  • Lead complex technology initiatives
  • Design, code, test, debug, and document for projects and programs
  • Software Development experience
  • Experience in Python along with SQL proficiency
  • Experience in building and deploying microservices and cross channel restful Application Programming Interface (API).
  • Experience with GCP services, BigQuery, DataProc, Apache Beam.
  • Experience with secure DevOps and deployment automation to cloud environments
  • Experience with Cloud technologies
  • Experience in ReactJS, Python Frameworks, UML, NoSQL, MongoDB, other relational database management system (RDBMS), Kafka pub/sub model, ETL.
  • Experience in Data analysis, Data Import and Data Feeds.

  • Python Data Analyst

    5 days ago

    Princeton, NJ, United States Diverse Lynx Full time

    Primary Skill : Python programming, including data manipulation libraries like Pandas and PySpark. Hands On.Experience with Python SDKs and API integration.Familiarity with REST APIs and OAuth 2.0 for authentication.Create and manage of complex data models, including objects, links, actions, and functions in Graph DB Ontology.Proficiency in using IDEs like...

  • Python Data Analyst

    2 weeks ago

    Princeton, NJ, United States Diverse Lynx Full time

    Primary Skill : Python programming, including data manipulation libraries like Pandas and PySpark. Hands On.Experience with Python SDKs and API integration.Familiarity with REST APIs and OAuth 2.0 for authentication.Create and manage of complex data models, including objects, links, actions, and functions in Graph DB Ontology.Proficiency in using IDEs like...

  • Sr Azure Data Engineer/Architect

    19 hours ago

    Princeton, NJ, United States ATYETI Full time

    Responsibilities Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Develop and maintain innovative Azure solutions Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing,...

  • Sr Azure Data Engineer/Architect

    2 weeks ago

    Princeton, NJ, United States ATYETI Full time

    Responsibilities Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Develop and maintain innovative Azure solutions Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing,...

  • Data Engineer

    3 days ago

    Princeton, NJ, United States Cynet Systems Full time

    Job Description: Pay Range: $55hr - $60hr The Data Engineer will design, build, and maintain scalable cloud-based data pipelines and systems. This role supports data ingestion, transformation, integration, and optimization across internal and external data sources, ensuring high data quality and availability. The engineer will collaborate closely...

  • Data Engineer

    16 hours ago

    Princeton, NJ, United States Cynet Systems Full time

    Job Description: Pay Range: $55hr - $60hr The Data Engineer will design, build, and maintain scalable cloud-based data pipelines and systems. This role supports data ingestion, transformation, integration, and optimization across internal and external data sources, ensuring high data quality and availability. The engineer will collaborate closely...

  • Sr. Data Analyst

    2 weeks ago

    Princeton, NJ, United States Dow Jones & Company, Inc. Full time

    Job Description: Senior Data Analyst About Our Organization: Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 130 years and today has one...

  • ML Engineer

    1 day ago

    Princeton, NJ, United States Cynet Systems Full time

    Job Description: Pay Range: $80hr - $85hr Responsibilities: Design and develop data ingestion pipelines from source systems using Azure Databricks and Azure Data Factory into the Azure Analytics Platform. Build and optimize ETL/ELT pipelines for structured and unstructured data. Develop and deploy LLM-powered applications, including RAG-based...

  • ML Engineer

    2 weeks ago

    Princeton, NJ, United States Cynet Systems Full time

    Job Description: Pay Range: $80hr - $85hr Responsibilities: Design and develop data ingestion pipelines from source systems using Azure Databricks and Azure Data Factory into the Azure Analytics Platform. Build and optimize ETL/ELT pipelines for structured and unstructured data. Develop and deploy LLM-powered applications, including RAG-based...

  • Sr. Data Analyst

    7 days ago

    Princeton, NJ, United States Dow Jones & Company, Inc. Full time

    Job Description: About the Team: The Dow Jones Customer Service (DJCS) mission is to provide great service for our customers and great experiences for our people. Our team has the privilege of delivering impactful experiences by helping our customers access the trusted news and business information published and produced by our marquee brands, including, The...