Spark Engineer
4 weeks ago
• Need 8+Yrs experience and strong experience in Big Data Hadoop, Spark, PySpark
• Hands on Programming - Java, Scala, Python
• WS Cloud -S3, EFS, MSK, ECS, EMR, Lambdas
• Containerized and Microservices
• Distributed Computing constructs - Joins, MapReduce, Good at Memory management
• RDBMS - MySQL, Aurora and No-SQL
• Kafka Streaming
• Data Storage Architecture
• Solid in Scala programming
• Familiar with data transfer
• WS experience is needed
-
Spark Developer
2 weeks ago
San Francisco, United States Pacavo IT Consulting, Inc. Full time**Required skills/experience**: - Advanced level of **Java/Scala/Python development** experience. - Intermediate level of **SQL and NoSQL experience** (handling structured and unstructured data). - Extensive experience with **Spark Processing engine**. - Experience with **Big data tools / technologies/ Streaming** (Hive, Impala, OOZIE, Airflow, NIFI,...
-
GCP Data Engineer
2 months ago
San Jose, United States QData Full timeSkills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)
-
GCP Data Engineer
2 months ago
San Jose, California, United States QData Full timeSkills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)
-
Hadoop Platform Engineer
1 month ago
San Jose, United States RAMPS International Inc. Full timeJob DescriptionJob DescriptionHadoop Platform EngineerSan Jose, CA4-12 MonthsPosition summaryThe Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including...
-
GCP Data Engineer
2 months ago
San Jose, United States QData Full timeResponsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to...
-
GCP Data Engineer
3 weeks ago
San Jose, California, United States QData Full timeResponsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance...
-
Data Engineer
2 weeks ago
San Jose, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionTitle: Data EngineerLocation: San Jose, CA (Onsite)Duration: Long TermContract RoleSkill Set:Python, Spark, AWS.
-
Engineering Manager, Spark/Microservices
1 day ago
San Francisco, United States BHO Tech Full timeAre you a strong technical leader with proven success in building distributed microservices and data pipelines? Do you enjoy delivering business value by developing best in class software? Can you build and motivate high performance teams? This is a highly technical position, with both management and hands on aspects. You will be facilitating your...
-
Data Engineering Internship
2 hours ago
San Jose, United States VECTRA Full timeVectra® is the leader in AI-driven threat detection and response for hybrid and multi-cloud enterprises. The Vectra AI Platform delivers integrated signal across public cloud, SaaS, identity, and data center networks in a single platform. Powered by patented Attack Signal Intelligence, it empowers security teams to rapidly prioritize, investigate and...
-
Tech Lead Manager, Data Engine
1 month ago
San Jose, United States TikTok Full timeResponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help imaginations thrive....
-
Machine Learning Engineer
1 week ago
San Jose, United States BHO Tech Full timeJob Description: Machine Learning Engineer San Francisco, CA, US Description About Us We are the world’s first Experimentation Platform that empowers executives, marketing teams, product teams, and development teams to make better business decisions and deliver better customer experiences by optimizing digital experiences on any channel and any...
-
Site Reliability Engineer
2 weeks ago
San Jose, United States Myriad Consulting Inc Full timeThis role also open for junior (3+ yoe) candidates, and SRE lead (7+ yoe).Site Reliability Engineering(SRE) team combines software and systems engineering to build and run large-scale, massively distributed, and fault-tolerant systems. In our team, you ll have the opportunity to manage the complex challenges of scale, while using expertise in coding,...
-
Hadoop Engineer
1 month ago
San Jose, United States OrgSpire Full timeWanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC...
-
Sr. Data Engineer
3 weeks ago
San Jose, United States Robert Half Full timeRobert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role...
-
Sr. Data Engineer
3 weeks ago
San Jose, United States Robert Half Full timeRobert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role...
-
Hadoop Engineer
1 month ago
San Jose, California, United States OrgSpire Full timeWanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC Parquet...
-
Principal / Lead Software Engineer
7 days ago
San Jose, United States PeerNova Inc Full timeAre you passionate about solving complex business problems and real world challenges? Do you thrive in a dynamic startup work environment that constantly pushes you to be the best you can be? Are you ready to work with motivated colleagues and veteran entrepreneurs who strive for excellence in everything they do? PeerNova's main product philosophy is to...
-
Senior Data Platform Engineer
2 weeks ago
San Jose, United States Mendel.ai Full timeAbout Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the...
-
Senior Data Platform Engineer
2 weeks ago
San Jose, United States Mendel.ai Full timeAbout Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the...
-
Senior Data Platform Engineer
2 weeks ago
San Jose, United States Mendel.ai Full timeAbout Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the...