Data Engineer
6 days ago
looking for a highly energetic and collaborative Data Engineer Responsibilities: As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source technologies. • Desired working in offshore model and Managed outcome • Develop logical and physical data models for big data platforms. • Automate workflows using Apache Airflow. • Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support. • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team. • Mentor junior engineers on the team • Lead daily standups and design reviews • Groom and prioritize backlog using JIRA • Act as the point of contact for your assigned business domain Requirements: GCP Experience • 3+ years of recent GCP experience • Experience building data pipelines in GCP • GCP Dataproc, GCS & BIGQuery experience • 5+ years of hands-on experience with developing data warehouse solutions and data products. • 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required • 4+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. • Experience with programming languages: Python, Java, Scala, etc. • Experience with scripting languages: Perl, Shell, etc. • Practice working with, processing, and managing large data sets (multi TB/PB scale). • Exposure to test driven development and automated testing frameworks. • Background in Scrum/Agile development methodologies. • Capable of delivering on multiple competing priorities with little supervision. • Excellent verbal and written communication skills. • Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following: • Gitflow • Atlassian products - BitBucket, JIRA, Confluence etc. • Continuous Integration tools such as Bamboo, Jenkins, or TFS Location: This position will be based in Sunnyvale, CA
-
Data Engineer
6 days ago
Sunnyvale, CA, United States Institute of Foundation Models Full timeAbout the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you'll have the opportunity to work on the...
-
Data Engineer
2 weeks ago
Sunnyvale, CA, United States Institute of Foundation Models Full timeAbout the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you'll have the opportunity to work on the...
-
Data Engineer
6 days ago
Sunnyvale, CA, United States Institute of Foundation Models Full timeAbout the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you'll have the opportunity to work on the...
-
Data Engineer
1 week ago
Sunnyvale, CA, United States Metasys Technologies Full timeData Engineer Duration: 12 Months Sunnyvale, CA Qualifications: • 10-15 years of experience in data engineering or data analytics roles. • Proficiency in Python and SQL for building financial and operational data models. • Experience with Snowflake, Redis, and cloud-based data environments (AWS or GCP). • Understanding of data warehousing and...
-
Data Engineer
6 days ago
Sunnyvale, CA, United States Metasys Technologies Full timeData Engineer Duration: 12 Months Sunnyvale, CA Qualifications: • 10-15 years of experience in data engineering or data analytics roles. • Proficiency in Python and SQL for building financial and operational data models. • Experience with Snowflake, Redis, and cloud-based data environments (AWS or GCP). • Understanding of data warehousing and...
-
Data Engineer
2 weeks ago
Sunnyvale, CA, United States Syntricate Technologies Full timeData Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities: Design, implement, optimize, and maintain...
-
Data Engineer
1 week ago
Sunnyvale, CA, United States Syntricate Technologies Full timeData Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities: Design, implement, optimize, and maintain...
-
Data Engineer
6 days ago
Sunnyvale, CA, United States Syntricate Technologies Full timeData Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities: Design, implement, optimize, and maintain...
-
Data Engineer
3 days ago
Sunnyvale, CA, United States Purple Drive Full time****Preferred location is Sunnyvale, CA although will accept candidates from Bentonville, AR. Job Description: We are seeking a skilled Data Engineer with strong expertise in Big Data, Cloud platforms, and distributed data systems. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines, API integrations, and...
-
Data Engineer
6 days ago
Sunnyvale, CA, United States Purple Drive Full time****Preferred location is Sunnyvale, CA although will accept candidates from Bentonville, AR. Job Description: We are seeking a skilled Data Engineer with strong expertise in Big Data, Cloud platforms, and distributed data systems. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines, API integrations, and...
