Python Pyspark Developer

2 days ago

Whippany, United States Capgemini Full time

Title - Python Pyspark Developer

Location - Whippany NJ (Hybrid)

Duration - Fulltime

Key Responsibilities

  • We are looking for a highly skilled Python/PySpark Developer with hands-on experience in Big Data technologies to join our dynamic data engineering team.
  • The ideal candidate will have a strong background in building scalable distributed data processing systems using PySpark and working on large datasets.
  • You will collaborate with data scientists engineers and other stakeholders to design and implement efficient data pipelines.
  • Develop optimize and maintain ETL pipelines using PySpark to process large-scale datasets across distributed environments.
  • Design and implement complex data transformation logic using PySpark and other Big Data tools.
  • Work with various Big Data technologies such as Hadoop Hive HBase Kafka and Spark to build robust scalable data systems.
  • Collaborate with data engineers and data scientists to integrate data from multiple sources and create unified datasets.

Required Skills

  • 6 - 8 years of exp in python, pyspark & AWS
  • Write efficient reusable and scalable Python code to handle both batch and real-time data processing tasks.
  • Ensure data quality consistency and reliability by implementing data validation monitoring and error handling.
  • Fine-tune and optimize PySpark jobs to improve performance in distributed environments.
  • Manage and maintain data flows in HDFS ensuring scalability and fault tolerance.
  • Perform data extraction aggregation and reporting using SQL and NoSQL databases.
  • Participate in system design discussions and provide recommendations for architecture and performance improvements

Note - In-person client interview would require for this position. Candidates based from NY/NJ/PA/CT/RI will be highly preferred. If your Interested, please share me your resume on sajid.k.shaikh@

Life At Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant

  • Senior Python Developer

    1 month ago

    Whippany, New Jersey, United States IPolarity Full time

    Job Title: Senior Python DeveloperLocation: RemoteDuration: Full-timeJob Description:We are seeking a highly skilled Senior Python Developer to join our team at IPolarity. As a Senior Python Developer, you will be responsible for designing, developing, and maintaining high-quality software using Python programming language.You will participate in the entire...

  • Python Developer

    6 days ago

    Whippany, United States NR Consulting Full time

    Job Title: Python Developer Location: Whippany, NJ (Hybrid) Type: Contract Duration: Long Term Description: Client is seeking a highly skilled Python Developer to join there team. The ideal candidate will have strong expertise in Python programming and problem-solving abilities, as. Proficient in Python development, with experience in designing,...

  • Senior Data Engineer

    3 weeks ago

    Whippany, New Jersey, United States DCM INFOTECH LIMITED Full time

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCM INFOTECH LIMITED. The ideal candidate will have a strong background in Python, PySpark, and Hadoop Big Data, with experience in building and optimizing PySpark applications.Key ResponsibilitiesDesign and implement high-performance PySpark applications for batch...

  • Senior Python Developer with Tableau

    6 days ago

    Whippany, United States NR Consulting Full time

    Title: Senior Python Developer with Tableau Location: Whippany, NJ (Hybrid) Type: Contract Duration: Long Term Technical Skills/Competencies: Experience of working in a financial organization or awareness of financial concepts. Strong experience with BI tools like Business Intelligence Technologies - Tableau Deriving data insights and maintain...

  • Senior Python Developer with Tableau Expert

    3 weeks ago

    Whippany, New Jersey, United States NR Consulting Full time

    Job Title: Senior Python Developer with Tableau ExpertLocation: HybridType: ContractDuration: Long TermKey Responsibilities:Develop and maintain dynamic Tableau dashboards, presentations, and reports demonstrating multiple dimensions.Design and implement web applications using Python framework like Streamlit.Collaborate with back-end developers to integrate...

  • Python Developer for Data Management and Scripting

    2 weeks ago

    Whippany, New Jersey, United States CapB InfoteK Full time

    Job Summary:We are seeking a highly skilled Python Developer to join our team at CapB InfoteK. The ideal candidate will have expertise in Python scripting, data management, and Salesforce development.Responsibilities: Design and implement data warehouses using Python and SQL Develop and maintain stored procedures, views, and SOQL queries in Salesforce Manage...

  • Senior Python Developer with Tableau Expert

    2 weeks ago

    Whippany, New Jersey, United States NR Consulting Full time

    Job Title: Senior Python Developer with Tableau ExpertJob Type: ContractLocation: HybridDuration: Long TermAbout the Role:We are seeking a highly skilled Senior Python Developer with expertise in Tableau to join our team at NR Consulting. As a Senior Python Developer, you will be responsible for deriving data insights and maintaining dynamic Tableau...

  • Senior AWS Big Data Engineer

    3 weeks ago

    Whippany, New Jersey, United States DCM INFOTECH LIMITED Full time

    Job Title: Senior AWS Big Data EngineerAt DCM INFOTECH LIMITED, we are seeking a highly skilled Senior AWS Big Data Engineer to join our team. The ideal candidate will have a strong background in developing data ingestion, processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.Key Responsibilities:Design...

  • AWS Big Data Engineer

    3 weeks ago

    Whippany, New Jersey, United States DCM INFOTECH LIMITED Full time

    Job Title: AWS Big Data Engineer - Data Ingestion and Processing ExpertJob Summary: We are seeking an experienced AWS Big Data Engineer to join our team at DCM INFOTECH LIMITED. The ideal candidate will have a strong background in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data...

  • Senior Python Software Engineer

    2 weeks ago

    Whippany, New Jersey, United States NR Consulting Full time

    Job Title: Python DeveloperLocation: NJ (Hybrid)Type: ContractDuration: Long TermDescription:NR Consulting is seeking a highly skilled Python Developer to join our team. The ideal candidate will have strong expertise in Python programming and problem-solving abilities, as well as proficiency in Python development, with experience in designing, writing, and...

  • Python scripting

    6 days ago

    Whippany, United States CapB InfoteK Full time

    We are looking for Python scripting & Salesforce Data Management Developer for our long-term multiyear projects out of Whippany, NJ. Responsibilities: Python scripting Data Warehouse SQL query stored procedure views Salesforce Object Query Language SOQL and SQL queries Salesforce data management How to push and pull data in Salesforce AWS Glue Kafka Apex...

  • Axiom Developer

    1 month ago

    Whippany, New Jersey, United States Softcom Systems Inc Full time

    Job OverviewSoftcom Systems Inc is seeking a highly skilled Axiom Developer to join our team. As an Axiom Developer, you will be responsible for designing, implementing, and maintaining Axiom solutions that meet the needs of our clients.Key ResponsibilitiesDesign and implement Axiom models, reports, and analytics capabilities.Develop and maintain Axiom...

  • Axiom Developer

    2 months ago

    Whippany, United States Softcom Systems Inc Full time

    Job DescriptionJob DescriptionQualifications:Bachelor’s degree in Computer Science, Information Technology, or a related field.10+ years of experience in Axiom development and implementation.Strong proficiency in Axiom’s modeling, reporting, and analytics capabilities.Experience with SQL, Python, and other relevant programming languages.Familiarity with...

  • Senior Full Stack Developer

    3 weeks ago

    Whippany, New Jersey, United States Omni Inclusive Full time

    Essential Skills:For this role at Omni Inclusive, we require a Bachelor's degree in Computer Science, Mathematics, or a Scientific discipline. The ideal candidate will have 8-12 years of hands-on experience in full-stack enterprise-level application development using object-oriented languages such as C# and Python. Additionally, they should have 8+ years of...

  • Senior Axiom Developer

    3 weeks ago

    Whippany, New Jersey, United States Softcom Systems Inc Full time

    Job OverviewSoftcom Systems Inc is seeking a highly skilled Axiom Developer to join our team. The ideal candidate will have a strong background in Axiom development and implementation, with a proven track record of delivering high-quality solutions.Key Responsibilities:Design and implement Axiom models and reportsDevelop and maintain Axiom's modeling,...

  • Senior SQL Developer

    2 weeks ago

    Whippany, New Jersey, United States Saxon Global Full time

    Job SummaryAs a Senior SQL Developer at Saxon Global, you will play a key role in designing and implementing database enhancements to deliver committed customer project objectives. You will work closely with full stack developers, business analysts, and QA analysts on features and watch them go from conception to deployment in weeks.Responsibilities...

  • Collibra Developer

    1 month ago

    Whippany, United States Net2Source Inc. Full time

    Net2Source Inc. is an award-winning total workforce solutions company recognized by Staffing Industry Analysts for our accelerated growth of 300% in the last 3 years with over 5500+ employees globally, with over 30+ locations in the US and global operations in 32 countries. We believe in providing staffing solutions to address the current talent gap - Right...

  • Data Architect

    3 weeks ago

    Whippany, New Jersey, United States Omni Inclusive Full time

    Job SummaryWe are seeking a highly skilled Data Architect to join our team at Omni Inclusive. The successful candidate will have a strong background in designing and implementing data management solutions on Amazon AWS.Key ResponsibilitiesDesign and implement data migration and processing solutions using AWS services such as VPC/SG, EC2, S3, AutoScaling,...

  • Data Architect

    5 months ago

    Whippany, United States eTeam Full time

    What you need Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS) Minimum of 10 years of experience in big data, database and data warehouse architecture and delivery Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, AutoScaling, CloudFormation,...

  • Axiom Consultant

    1 month ago

    Whippany, New Jersey, United States Softcom Systems Inc Full time

    Job DescriptionJob OverviewWe are seeking a highly skilled Axiom Controller View Ver 9/10 expert to join our team at Softcom Systems Inc. The ideal candidate will have a strong background in Oracle SQL, PLSQL, Unix Shell Scripting, Python, and DevOps.Key Responsibilities:Develop and maintain complex Oracle SQL and PLSQL scriptsDesign and implement efficient...