Data Engineer with Spark

4 weeks ago


Sunnyvale, United States Lorven technologies Full time
Job DescriptionJob Description

Our client is looking Data Engineer with Spark & Scala for Full-Time project in Sunnyvale, CA / Austin, TX (Onsite) below is the detailed requirements.

Title: Data Engineer with Spark & Scala

Location: Sunnyvale, CA / Austin, TX (Onsite)

Duration: Full Time

Requirements:

  • Spark
  • Scala
  • Big data databases - like HBase etc
  • PySpark
  • Python
  • Knowledge of Airflow , Hive etc.. would be good
  • Data warehouse
  • AWS good to have
  • Good communication skill

Qualifications:

  • Minimum of 10+ year of experience designing and implementing a full-scale data warehouse solution.
  • A minimum of Six years' experience in developing using Spark, Scala.
  • A highly effective communicator, both orally and in writing
  • Problem-solving and architecting skills in cases of unclear requirements.



  • Sunnyvale, United States SRI Tech Full time

    Role : Data Engineer with Spark/Scala and JAVA Mode Of Emp: Full-Time Requirements:Spark / ScalaJavaPythonDatawarehouseAWS – good to haveGood communication skill Role and QualificationA minimum of ten years’ experience in developing using Spark / Scala AND Java. A highly effective communicator, both orally and in writingProblem-solving and architecting...


  • Sunnyvale, CA, United States SRI Tech Full time

    Role : Data Engineer with Spark/Scala and JAVA Mode Of Emp: Full-Time Requirements:Spark / ScalaJavaPythonDatawarehouseAWS – good to haveGood communication skill Role and QualificationA minimum of ten years’ experience in developing using Spark / Scala AND Java. A highly effective communicator, both orally and in writingProblem-solving and architecting...

  • BIG Data Engineer

    3 months ago


    Sunnyvale, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS

  • BIG Data Engineer

    3 months ago


    Sunnyvale, California, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS

  • GCP Data Engineer

    1 week ago


    Sunnyvale, United States SunTechPros Inc. Full time

    Senior GCP Data Engineer Sunnyvale, CA (Hybrid 3 Days onsite ) Long Term Mandatory Areas Must Have Skills – Hadoop- 8+ Yrs of Exp Spark - 8+ Yrs of Exp- Scala - 8+ Yrs of Exp GCP - 5+ Yrs of Exp ETL Process / Data Pipeline experience –8+ Yrs of Exp – Must Have Skills – • 2+ years of recent GCP experience GCP Dataproc, GCS & BIGQuery experience...


  • Sunnyvale, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Senior Data EngineerLocation: Sunnyvale, CA -HybridTerm: Contract Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data...

  • GCP Data Engineer

    7 days ago


    Sunnyvale, United States Cymansys Solutions LLC Full time

    Job DescriptionJob DescriptionGCP Data EngineerSunnyvale, CA (Hybrid 3 Days onsite) Long TermSkills: GCP, Hadopp, Spark, Scala, ETL Process, Data Pipeline

  • Data Engineer

    2 months ago


    Sunnyvale, California, United States People Integra LLC Full time

    Additional Details:Candidates must have 5+ years of data experience, 2+ years of experience with Google Cloud platform, and hands on experience process large scale distributed dataDescription :Designs, develops, and implements Hadoop eco-system based applications to support business requirements. Follows approved life cycle methodologies, creates design...

  • Cloud Data Engineer

    5 days ago


    Sunnyvale, California, United States Cymansys Solutions LLC Full time

    About the RoleJob Title: GCP Data EngineerCompany: Cymansys Solutions LLCLocation: Remote/HybridJob Type: Full-timeDuration: Long-termAbout the Job:Design, develop, and maintain large-scale data pipelines using GCP, Hadoop, Spark, and Scala.Collaborate with cross-functional teams to identify business requirements and develop data-driven solutions.Ensure data...


  • Sunnyvale, California, United States Walmart Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Walmart Global Tech. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our advertising technology platform.Key ResponsibilitiesDesign and develop complex data systems that ingest,...


  • Sunnyvale, United States Fortinet Full time

    Responsibilities:Work on cloud-based Unified Cloud Application Protection projectsDesign, develop, and maintain scalable data pipelines and ETL processes to collect, process, and analyze large-scale datasets.Implement and deploy machine learning models into production environments, ensuring reliability, scalability, and performance.Collaborate with data...

  • Senior Data Analyst

    4 weeks ago


    Sunnyvale, United States Infosys Full time

    Required Qualifications:Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Candidate must be located within commuting distance of Sunnyvale, CA or be willing to relocate to the area. This position may require travel...

  • Senior Data Analyst

    1 month ago


    Sunnyvale, United States Infosys Full time

    Required Qualifications:Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Candidate must be located within commuting distance of Sunnyvale, CA or be willing to relocate to the area. This position may require travel...

  • Data Engineer- W2

    2 months ago


    Sunnyvale, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionTRequired Skills1. 5 years experience in computer programming, software development or related 2. 3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase 3. Hands on experience with Unix, Teradata and other relational...


  • Sunnyvale, United States E-Solutions INC Full time

    Job DescriptionJob DescriptionData Engineer with Snowflake Exposure to ML/LLM ProjectsLocation : Sunnyvale/CA Type OnsiteMust Skills : Python , ETL , Snowflake , NoSQL Databases , Data Engineering and ML Exposure Must Experience as data engineer and snowflake developer along with ML exposureProficiency in programming languages (Python, Java, or...

  • Data Engineer- W2

    3 months ago


    Sunnyvale, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsJava, Hadoop (Hive, Spark, Drill, Impala, HBase), Unix/Teradata and other Relational Databases, ScalaAdditional SkillsJob Description·& Designs, develops, and implements Hadoop eco-system based applications to support business requirements.·& Follows approved life cycle methodologies, creates design documents,...


  • Sunnyvale, California, United States DoorDash Full time

    About the RoleDoorDash is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will play a critical role in designing, developing, and implementing large-scale data models and pipelines to support our business growth.Key ResponsibilitiesCollaborate with cross-functional teams to understand data...


  • Sunnyvale, United States Walmart Full time

    Hello,We have 5 urgent positions for a “Senior/Lead STAFF Data Engineer" in Sunnyvale, CA OR Seattle, WA (Hybrid 1-2 Days Onsite)ONLY LOOKING FOR W2/1099 CANDIDATES. STRICTLY NO C2C CANDIDATES. NO THIRD-PARTY VENDORS ALLOWEDQuick Interview – Urgent RequirementClient: WalmartLocation: Sunnyvale, CA OR Seattle, WA (Hybrid 1-2 Days Onsite)Duration: 12+...


  • Sunnyvale, United States Walmart Full time

    Hello,We have 5 urgent positions for a “Senior/Lead STAFF Data Engineer" in Sunnyvale, CA OR Seattle, WA (Hybrid 1-2 Days Onsite)ONLY LOOKING FOR W2/1099 CANDIDATES. STRICTLY NO C2C CANDIDATES. NO THIRD-PARTY VENDORS ALLOWEDQuick Interview – Urgent RequirementClient: WalmartLocation: Sunnyvale, CA OR Seattle, WA (Hybrid 1-2 Days Onsite)Duration: 12+...


  • Sunnyvale, California, United States Two95 International Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Two95 International Inc. as a Business Insights Specialist. This is a 2-month contract position that will involve leveraging internal tools and systems, databases, and industry data to provide business insights.Key ResponsibilitiesDocument requirements, data lineage, and...