Python pyspark Developer

7 days ago


New York, United States Diverse Lynx Full time

Must Have Skills? Proficiency in containerization technologies such as Docker and Kubernetes.? Hands-on experience with front-end framework like React, Vue.js, Next.js or Angular.js? Experience in infrastructure as code (IaC) using Terraform, particularly with AWS provider? Strong Coding skills in Python, Java or Scala for data processing task.? Proficient in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols.? Solid Understanding of relational and NoSQL database, such as PostgreSQL, MySQL, DynamoDB or MongoDB.? Familiarity with data pipelines orchestration tools such as Airflow or Flask.? Proficiency in data transformation and ETL process, including tools like Apache Spark or Glue.? Strong experience with cloud platforms, especially AWS, including services like Lambda, S3, RDS and Glue? Familiarity with big data technologies, including Hadoop, Hive or Redshift? Experience with user authentication and authorization using AWS Cognito.? Expertise in API development, security and implementing best practices for scalable solutions.? Experience with monitoring and logging tools, such as Prometheus, Grafana or ELK Stack to ensure system reliability and application performance.? Strong understanding of DevOps principles, CI/CD pipelines and best practices.? Experience with core AWS technologies such as EC2, ELB, Auto Scaling, S3, EFS, Lambda, API Gateway, Step Functions, CloudWatch, VPC, Route 53, ACM.? Experience with BI tools like Tableau, AWS Quick Sight

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.



  • New York, United States Tech Tammina Full time

    Senior Fullstack Pyspark / Python Engineers Location: NYC, NY Duration: 1+ YearThe client is looking for Senior PySpark/Python Engineers who can: Improve performance and user experience of new applications. Work with data lakes, data warehouses, and ETL processes. Contribute to digital transformation projects. Utilize Agile software development frameworks....


  • New York, United States Diverse Lynx Full time

    • Minimum 4 years + working exp as Databricks Developer• Minimum 4 years + working exp on Python, PySpark and AWSNice to Have :• Preferable Software engineering background• Preferable AWS experience• Experience with Typescript Digital : Python, Digital : Databricks, Digital : PySpark Diverse Lynx LLC is an Equal Employment Opportunity employer....


  • New York, United States Mindlance Full time

    PySpark Developer with Kubernetes Experience Duration: 12 months plus (possible extension or conversion) Location: HYBRID W/ ONSITE REQUIREMENT - 3 days onsite New York City, NY 10013 Job Summary: We are looking for an experienced PySpark Developer with strong expertise in Kubernetes to join our dynamic team. The ideal candidate will be responsible for...


  • New York, United States Mindlance Full time

    PySpark Developer with Kubernetes Experience Duration: 12 months plus (possible extension or conversion) Location: HYBRID W/ ONSITE REQUIREMENT - 3 days onsite New York City, NY 10013 Job Summary: We are looking for an experienced PySpark Developer with strong expertise in Kubernetes to join our dynamic team. The ideal candidate will be responsible for...


  • New York, New York, United States Diverse Lynx Full time

    Job Title: Databricks and PySpark DeveloperWe are seeking a highly skilled Databricks and PySpark Developer to join our team at Diverse Lynx LLC. The ideal candidate will have experience in developing scalable and efficient data processing pipelines using Databricks and PySpark.Key Responsibilities:Design and implement data processing workflows using...

  • DB2 Python Developer

    1 month ago


    New York, United States Veracity Full time

    DB2 Python Developer New York City, New YorkMust have: Db2, Java, Sybase, Should have Python core backend development experience. Should have good Java. Strong analysis and problem-solving skills Should have experience in Panda, NumPy, PySpark libraries and DataBricks (Good to have) Database should be very good Strong DB skill (Sybase, DB2) A very strong...


  • New York, United States Diverse Lynx Full time

    Must Have Skills? Proficiency in containerization technologies such as Docker and Kubernetes.? Hands-on experience with front-end framework like React, Vue.js, Next.js or Angular.js? Experience in infrastructure as code (IaC) using Terraform, particularly with AWS provider? Strong Coding skills in Python, Java or Scala for data processing task.? Proficient...


  • New York, New York, United States Diverse Lynx Full time

    About the RoleDiverse Lynx LLC is seeking a highly skilled Senior Data Engineering Specialist to join our team as a Databricks/PySpark Developer. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and PySpark.Key ResponsibilitiesDesign and...


  • New York, United States Georgia IT Inc Full time

    Position: Senior Python Consultant Location: NYC Duration: Contract Rate: DOE Machine Learning : 1. Python Pyspark , PYTorch Machine learning modeling experience . 2. Python scripting expertise 3. MLOps experience 4. Banking experience is a plus Data Engineer 1. Data Engineer having 6-10 year experience in ETL, Data Ingestion and implementation...


  • New York, United States Diverse Lynx Full time

    •Primary Skills:o Pysparko AWS Cloudo Airflowo SQLo Databricks•Secondary Skills:o Snowflakeo GCP Cloud Digital : Databricks, Digital : PySpark 6-8 •Minimum 5 years + working exp as Databricks Developer•Minimum 3 years + working exp on PySpark and AWS •Minimum 5 years + working exp as Databricks Developer•Minimum 3 years + working exp on PySpark...


  • New York, United States Diverse Lynx Full time

    •Primary Skills:o Pysparko AWS Cloudo Airflowo SQLo Databricks•Secondary Skills:o Snowflakeo GCP Cloud Digital : Databricks, Digital : PySpark 6-8 •Minimum 5 years + working exp as Databricks Developer•Minimum 3 years + working exp on PySpark and AWS •Minimum 5 years + working exp as Databricks Developer•Minimum 3 years + working exp on PySpark...


  • New York, United States Diverse Lynx Full time

    • Primary Skills:o Pysparko AWS Cloudo Airflowo SQLo Databricks• Secondary Skills:o Snowflakeo GCP Cloud Digital : Databricks, Digital : PySpark 6-8 • Minimum 5 years + working exp as Databricks Developer• Minimum 3 years + working exp on PySpark and AWS • Minimum 5 years + working exp as Databricks Developer• Minimum 3 years + working exp on...


  • York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Software Engineer (Python, AWS, Pyspark )Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers,...


  • New York, New York, United States Diverse Lynx Full time

    Company OverviewDiverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company.SalaryThe estimated salary for this position is $120,000 - $180,000 per year, depending on experience.Job DescriptionWe are seeking a highly skilled Databricks / PySpark Developer to join our team. As a key...

  • Python developer

    1 month ago


    New York, United States Diverse Lynx Full time

    Role name: Developer Role Description: Python Developer Competencies: Digital : Python Experience (Years): 4-6 Essential Skills: Python Developer Desirable Skills: Python Developer Country: United States Branch | City | Location: NEW YORK 1, NY NEW YORK New York, NY Keywords: Python Developer Diverse Lynx LLC is an Equal Employment Opportunity employer. All...

  • Data Engineer

    6 days ago


    New York, New York, United States Diverse Lynx Full time

    Job Description:We are seeking a skilled Data Engineer with expertise in Databricks and PySpark to join our team at Diverse Lynx LLC.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using Databricks and PySpark.Collaborate with cross-functional teams to integrate data solutions into business operations.Analyze complex...

  • Python Developer

    1 month ago


    New York, United States TSG Risk Management Full time

    Python Developer responsibilities include: Writing effective, scalable code Developing back-end components to improve responsiveness and overall performance Integrating user-facing elements into applications Job brief We are looking for a Python Developer to join our engineering team and help us develop and maintain various software products. Python...

  • Python Developer

    7 days ago


    New York, United States The Dignify Solutions LLC Full time

    . Strong Python Programming Skills b. Python developer skills with . Work experience of IDE (any) PyCharm, visual source code b. Experience with Git (basically able to commit the code) c. Strong SQL knowledge d. Experience with Python Flask would be highly desired. e. Experience with Node.JS is preferred.

  • Python Developer

    11 hours ago


    New York, United States Georgia IT Inc Full time

    Sr. Mendix + Python Developer New York City-NY or Boston-MA (100% Onsite-Hybrid) Contract U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor currently. Job Description: Mendix, Python & SQL as primary sources of technology. Test-driven development, source code reviews, and change control...

  • Python Developer

    1 month ago


    New York, United States Open Systems Technologies Full time

    A major financial firm is looking for a Python Developer to join their team in New York, NY. Compensation: $150-200k/year Qualifications: A Bachelor's Degree in Computer Science, Engineering, or related field of study 5+ years of relevant hands-on technical experience Strong Python skills Strong understanding of relational databases and SQL Strong...