Spark/scala Developer

4 weeks ago


Sunnyvale, United States Q1 Technologies Full time

**Job description Below**

Customer is looking for resources with Software Engineering experience and **not Data Engineering**.
- Strong Software Engineering experience (**Application Development**) using Apache Spark, Scala and messaging systems as **Kafka for handling/processing large datasets.**
- **Experience showcasing Spark/Scala projects**.
- Strong in SQL
- Good programming experience in Scala - with Services, Jobs, Workflows, and other features like Libraries/Dataframes etc. with a primary focus on Scala and Apache Spark / good understanding and usage of REST API’s
- Spark performance tuning of complex calculations on large datasets
- Good understanding of Apache Spark architecture, components, and concepts.

Pay: $130,000.00 - $140,000.00 per year

**Benefits**:

- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Life insurance
- Paid time off
- Parental leave
- Tuition reimbursement
- Vision insurance

Compensation package:

- Bonus opportunities

Experience level:

- 9 years

Schedule:

- 8 hour shift

**Experience**:

- Scala: 6 years (required)
- Spark: 5 years (required)
- Kafka: 5 years (required)
- Application development: 8 years (required)

Ability to Commute:

- Sunnyvale, CA 94085 (required)

Ability to Relocate:

- Sunnyvale, CA 94085: Relocate before starting work (required)

Work Location: In person



  • Sunnyvale, United States Excelon Solutions Full time

    Job DescriptionJob DescriptionRequirements:Spark / ScalaJavaPythonDatawarehouseAWS good to haveGood communication skill Role and QualificationA minimum of ten years' experience in developing using Spark / Scala AND Java.A highly effective communicator, both orally and in writingProblem-solving and architecting skills in cases of unclear requirements.

  • Developer

    1 week ago


    Sunnyvale, United States Webologix Ltd INC Full time

    Job Title: Spark Developer with PythonLocations: Sunnyvale, CA / Austin, TX Type of hire: FulltimeJob Description: In the role of Spark Developer with Python, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture...


  • Sunnyvale, United States Tata Consultancy Services Full time

    #LI-AS3 Roles & Responsibilities: Java lead (w/ scala skillset) Key Qualifications: Minimum 7 years of experience in enterprise Java development Strong foundation in Computer Science fundamentals such as data structures and algorithms Experienced in delivering advanced solutions for a multi-tier, distributed web application Experienced in crafting and...

  • Data Engineer- W2

    6 days ago


    Sunnyvale, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsJava, Hadoop (Hive, Spark, Drill, Impala, HBase), Unix/Teradata and other Relational Databases, ScalaAdditional SkillsJob Description·& Designs, develops, and implements Hadoop eco-system based applications to support business requirements.·& Follows approved life cycle methodologies, creates design documents,...


  • Sunnyvale, United States E-Solutions, Inc. Full time

    Job Position- Google Cloud Platform Data Engineer Job Location Sunnyvale, CA (Onsite) Duration- Long Term Contract Must Have Skills Spark 8+ Yrs of Exp Scala 8+ Yrs of Exp Google Cloud Platform 5+ Yrs of Exp Hive 8+Yrs of Exp SQL - 8+ Yrs of Exp ETL Process / Data Pipeline - 8+ Years of experience Responsibilities: As a Senior Data Engineer, you...


  • Sunnyvale, United States E-Solutions, Inc. Full time

    Job Position- Google Cloud Platform Data Engineer Job Location Sunnyvale, CA (Onsite) Duration- Long Term Contract Must Have Skills Spark 8+ Yrs of Exp Scala 8+ Yrs of Exp Google Cloud Platform 5+ Yrs of Exp Hive 8+Yrs of Exp SQL - 8+ Yrs of Exp ETL Process / Data Pipeline - 8+ Years of experience Responsibilities: As a Senior Data Engineer, you...

  • Data Engineer

    4 days ago


    Sunnyvale, United States Talent Groups Full time

    Requirements:Spark / ScalaJavaPythonDatawarehouseAWS – good to haveGood communication skill

  • Data Engineer

    4 days ago


    Sunnyvale, United States Talent Groups Full time

    Requirements:Spark / ScalaJavaPythonDatawarehouseAWS – good to haveGood communication skill


  • Sunnyvale, United States Caspex Corporation Full time

    Prefer a candidate with more ML modeling experience. Qualifications•Solid background in machine learning, deep learning, statistical analysis, and software development•Proficient in data mining, machine learning, and deep learning packages in Python/Tensorflow/Keras•Experience working with large data sets and cloud computing (Hive, Spark, Google Cloud...

  • AEM Developer

    1 month ago


    Sunnyvale, California, United States Agiletal Inc Full time

    Need senior Hadoop developer with focus on BI on Hadoop. Should be able to demonstrate work experience in Hive/Impala and Spark. Strong Spark hands on skill a must. Working Knowledge of Python Shell Scripting and bash. Must have working experience in Hadoop as data warehouse/data lake implementations. Must have SQL Experience.


  • Sunnyvale, United States HUMAC INC. Full time

    Sr Data scientistDuration: 12 + MonthsLocation : Sunnyvale, CA QualificationsSolid background in machine learning, deep learning, statistical analysis, and software developmentProficient in data mining, machine learning, and deep learning packages in Python/Tensorflow/KerasExperience working with large data sets and cloud computing (Hive, Spark, Google Cloud...


  • Sunnyvale, United States Infosys Full time

    Infosys is seeking a highly experienced Technical BI Data analyst to join our team and perform Technical Product management/Data analyst tasks and own the development of a Tiered data architecture for our data platform. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data...


  • Sunnyvale, United States Infosys Full time

    Infosys is seeking a highly experienced Technical BI Data analyst to join our team and perform Technical Product management/Data analyst tasks and own the development of a Tiered data architecture for our data platform. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data...


  • Sunnyvale, United States Infosys Full time

    Infosys is seeking a highly experienced Technical BI Data analyst to join our team and perform Technical Product management/Data analyst tasks and own the development of a Tiered data architecture for our data platform. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data...

  • Back End Developer

    14 hours ago


    Sunnyvale, United States Cequence Security Full time

    **Cequence Security - India (Hybrid/Remote)**: If you are committed to global security, aspire to collaborate with a dedicated and driven team, and seek to contribute to the advancement of a thriving organization, we want to hear from you. **Overview**: As a Backend Developer at Cequence Security, you will be responsible for designing, developing, and...


  • Sunnyvale, United States eTeam Full time

    Job Description 5+ years of programming experience in back-end development Experience working with cloud technology such as Azure Experience writing scalable and efficient Java for an enterprise product Experience using message queues such as Kafka Experience using NoSQL databases such as Cosmos DB Experience using big data databases such as...

  • BIG Data Engineer

    1 month ago


    Sunnyvale, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS

  • BIG Data Engineer

    1 month ago


    Sunnyvale, California, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS

  • Technical Lead

    2 weeks ago


    Sunnyvale, United States Themesoft Inc. Full time

    Job Description:Technical Lead - Android DeveloperHybrid: Twice a week in Sunnyvale, CA. Long term Contractual. Needs:KotlinAndroidGraph RESTHas managed at least 2 engineers in the past.REALLY NICE TO HAVE:CHATBOTSRequisites:Last mile deliveryGlass app and Spark app.Interaction between the two, the customers chats with the driver and vice versa. Oracle...


  • Sunnyvale, United States 1 Point System Full time

    Role: Lead Android DeveloperLocation: Twice a week in Sunnyvale, CANeeds:KotlinAndroidGraph RESTHas managed at least 2 engineers in the pastREALLY NICE TO HAVE:CHATBOTSJob Description:LAst mile deliveryGlass app and Spark appInteraction between the two, the customers chats with the driver and vice versa. Oracle agentPayment and order, and invoke a chat...