Spark Developer with Scala

4 weeks ago


San Francisco, United States Quantum World Technologies Inc. Full time

Role: Spark Developer with Scala

Location: SFO CA (100% Onsite from Day 1 – No flexibility)

Job Type: Full-Time/Contract


Note: The ask is for a 100% Hands on developer, who has strong understanding on Apache Spark and is good in preferably Scala (if not, then Python or Java).


Please find below JD:

  • Advanced level of Java/Scala/Python development experience.
  • Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).
  • Extensive experience with Spark Processing engine.
  • Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
  • Experience analyzing data to discover opportunities and address gaps.
  • Experience working with cloud or on-prem Big Data platform (i.e. Netezza, Teradata, AWS Redshift, Google Big Query, Azure Data Warehouse, or similar)


If you are interested, please send me your updated resume at Dheeresh@quantumworldit.com . Thank you so much



  • San Francisco, United States E-Solutions Full time

    Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...


  • San Francisco, United States E-Solutions Full time

    Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...


  • San Francisco, United States E-Solutions Full time

    Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...


  • San Francisco, United States E-Solutions Full time

    Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

  • Spark Developer

    6 hours ago


    San Francisco, United States Pacavo IT Consulting, Inc. Full time

    **Required skills/experience**: - Advanced level of **Java/Scala/Python development** experience. - Intermediate level of **SQL and NoSQL experience** (handling structured and unstructured data). - Extensive experience with **Spark Processing engine**. - Experience with **Big data tools / technologies/ Streaming** (Hive, Impala, OOZIE, Airflow, NIFI,...


  • San Antonio, United States Saxon Global Full time

    Job Description Strong working experience on Scala Programming ( Not sufficient to have limited scala knowledge with spark or Hadoop) Strong working experience on AWS Services ECS, EKS, AWS Batch, AWS Glue, Lambda, Cloudwatch, Athena & Quicksight Strong knowledge on containerization, Docker, ECR, Cloud deployment Good to have Python or Java knowledge...

  • Spark Engineer

    7 days ago


    San Jose, United States Omega Solutions Inc Full time

    Interview Process: 3 Rounds of Zoom Video • Need 8+Yrs experience and strong experience in Big Data Hadoop, Spark, PySpark • Hands on Programming - Java, Scala, Python • WS Cloud -S3, EFS, MSK, ECS, EMR, Lambdas • Containerized and Microservices • Distributed Computing constructs - Joins, MapReduce, Good at Memory management • RDBMS - MySQL,...


  • San Mateo, United States Diverse Lynx Full time

    Big data (Hadoop and Spark) skills. Programming language: Python, Scala •6 or more years of work experience with a Bachelor's degree, or over 3 years of work experience with an advanced degree (e.g., Masters, MBA, JD, MD). •Experience in creating data-driven business solutions and solving data issues using a wide range of technologies is required. This...

  • Big Data Developer

    7 days ago


    San Francisco, United States Infinite Computer Solutions Full time

    Job descriptionAzure databricks(creating notebooks, creating WF's), Azure Data Factory(buidling ETL pipelines) Knowledge on Azure devops for code integration and buidling CI/CD pipelines Intermediate knowledge on SQL server (no need to optimize or anything, but need basic SQL language to write queries based on use cases) Good knowledge on python/scala coding...


  • San Francisco, United States PeopleNTech Full time

    Role: Spark Developer with ScalaLocation: SFO CA (100% Onsite from Day 1 No flexibility) Please share candidate confirmation mail along with submission. Please share profiles local to Bay Area only.In Person Interview The ask is for a 100% Hands on developer, who has strong experience on Apache Spark and is good in preferably Scala (if not, then Python or...


  • San Francisco, United States Indotronix International Corporation Full time

    Pay Rate:- W2 Rate $ 61.75 Looking in PST time zone, preferred to be local to SF and willing to go into office occasionally, but okay with Remote (needs to hive high work ethic!) Lead DevOps/Site Reliability Enginee Looking for a resource more senior in the DevOps space, with a leaning toward site reliability engineering. Docker containers,...


  • San Francisco, United States Indotronix International Corporation Full time

    Pay Rate:- W2 Rate $ 61.75 Looking in PST time zone, preferred to be local to SF and willing to go into office occasionally, but okay with Remote (needs to hive high work ethic!) Lead DevOps/Site Reliability Enginee Looking for a resource more senior in the DevOps space, with a leaning toward site reliability engineering. Docker containers,...

  • Sr. Data Engineer

    1 day ago


    San Francisco, United States BayOne Solutions Full time

    Title: Sr. Data EngineerLocation: San Francisco, CA (Hybrid)Duration: 12 Month/ContractSkills Required:Big Data: Scala, Databricks, Spark SQL, Spark Streaming, Python, PysparkCloud: Azure, ADFSystem Design: API Design, Event driven architecture.Microservice: Core Java 8 or above, SpringBoot, Azure FunctionsFront end: JavaScripting, React

  • Principal Developer

    1 week ago


    San Jose, United States Western Digital Full time

    Job Description ESSENTIAL DUTIES AND RESPONSIBILITIES: Develop, test, and deploy data integration pipeline jobs using chosen cloud based native tool according to Western Digital design principles. Troubleshoot existing pipeline jobs based on BASH, Python, Java and modify jobs for performance improvements. Develop new pipelines using Java/Spark/Scala on...

  • Principal Developer

    4 weeks ago


    San Jose, California, United States Western Digital Full time

    Job Description ESSENTIAL DUTIES AND RESPONSIBILITIES: Develop, test, and deploy data integration pipeline jobs using chosen cloud based native tool according to Western Digital design principles. Troubleshoot existing pipeline jobs based on BASH, Python, Java and modify jobs for performance improvements. Develop new pipelines using Java/Spark/Scala on...


  • San Francisco, United States BayOne Solutions Full time

    Title: AI/ML Engineering ManagerLocation: San Francisco, CA (Hybrid 2 days onsite in a week)Duration: Fulltime HireWe are excited about you if you have:University or advanced degree in engineering, computer science, mathematics, or a related field3+ years experience developing and deploying machine learning systems into production.5+ years of experience in...


  • San Francisco, United States Wherobots Full time

    We are looking for passionate, skilled, and experienced software engineers to join Wherobots' dynamic team in building the distributed geospatial cloud database of the future. As a software engineer in our SedonaDB & geospatial analytics team, you will build new features, design and implement APIs to extend our geospatial query capabilities, and improve the...


  • San Francisco, United States Wherobots Full time

    We are looking for passionate, skilled, and experienced software engineers to join Wherobots' dynamic team in building the distributed geospatial cloud database of the future. As a software engineer in our SedonaDB & geospatial analytics team, you will build new features, design and implement APIs to extend our geospatial query capabilities, and improve the...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're committed to harnessing the power of data to drive insights and empower decision-making. Our mission is to develop scalable and efficient data pipeline solutions that enable organizations to streamline data processing and analysis....


  • San Francisco, United States Eka Finance Full time

    Requirements :- Advanced or basic degree (recent PhD from top university / MS with 5+ years experience) in a quantitative field such as CS, EE, Information sciences, Statistics, Mathematics, Economics, Operations Research, or related, with focus on Machine Learning , AI , NLP , deep learning, and/or / data-driven statistical analysis & modelling Strong,...