Spark Engineer

Interview Process: 3 Rounds of Zoom Video • Need 8+Yrs experience and strong experience in Big Data Hadoop, Spark, PySpark • Hands on Programming - Java, Scala, Python • WS Cloud -S3, EFS, MSK, ECS, EMR, Lambdas • Containerized and Microservices • Distributed Computing constructs - Joins, MapReduce, Good at Memory management • RDBMS - MySQL,...

Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

Position: Spark Developer with ScalaLocation: SFO CA Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

**Required skills/experience**: - Advanced level of **Java/Scala/Python development** experience. - Intermediate level of **SQL and NoSQL experience** (handling structured and unstructured data). - Extensive experience with **Spark Processing engine**. - Experience with **Big data tools / technologies/ Streaming** (Hive, Impala, OOZIE, Airflow, NIFI,...

Skills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)

Skills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)

Job DescriptionJob DescriptionHadoop Platform EngineerSan Jose, CA4-12 MonthsPosition summaryThe Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including...

Responsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to...

Responsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance...

Job DescriptionJob DescriptionTitle: Data EngineerLocation: San Jose, CA (Onsite)Duration: Long TermContract RoleSkill Set:Python, Spark, AWS.

Job DescriptionJob DescriptionJob Title: Data Engineer Location: San Jose, CADuration: 4 months plusPay Range: $70/hr- $80/hr Depending on Exp Duties: Leverage Databricks for tasks such as writing complex SQL queries, applying business logic, and utilizing big data best practices and can significantly enhance the efficiency and scalability of identifying and...

Wanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC...

Wanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC Parquet...

This role also open for junior (3+ yoe) candidates, and SRE lead (7+ yoe).Site Reliability Engineering(SRE) team combines software and systems engineering to build and run large-scale, massively distributed, and fault-tolerant systems. In our team, you ll have the opportunity to manage the complex challenges of scale, while using expertise in coding,...

Robert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role...

Robert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role...

Robert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role...

Who is AiDash? AiDash is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, and water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon...