GCP Data Engineer
3 weeks ago
Note :
Very strong and deep knowledge
of GCP with Airflow, Dataflow, Composer, Big Query .
Required Past Experience:
Looking for a GCP Data Engineer for its Cloud and Big Data projects in the Data Warehousing, Data Analytics domain.
Develop data-driven solutions with Cloud based technologies to meet evolving business needs. Deliver impactful, scalable, and highly performant Data solution to our customers based in US, UK, Canada and India based customers
Provide technical design and develop Extract/Transform/Load (ETL) applications that interface with customer applications.
Lead and implement data driven solutions and collaborate with larger development teams
Lead and Develop Test Strategy, Test Plan, Test Cases to test the cloud based solutions
Core Responsibilities
Drive Analysis to understand and meet all technical specifications and business requirements according to the established designs.?
Work extensively to develop Test Strategy, Test Plan, Test Cases to test the cloud based solutions
Analyze Issues identified during Testing phase, propose solutions to fix the issues.
Provide senior-level technical consulting to peer data engineers during design, development and testing for highly complex and critical data projects.
Work extensively within the Cloud ecosystem and migrate data from Teradata/Netezza/ similar on-Premise Big Data platforms to Cloud based platforms like Big Query, SQL
Requirements
Bachelor's degree in computer science, or related field?
Approx 10+ years of experience with a proven experience in data platform and big data engineering
Hands-on Experience in SQL is mandatory. Quickly learning skills to adapt GCP cloud native SQL (Bigquery).
Hands-on experience in Python is mandatory. Experience in using a Jupyter notebook is a plus.
Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Cloud Composer, GCS etc.).
Willingness to continuously learn & share learnings with others?
Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for
Ability to work in a fast-paced, rapidly changing environment
Ability to work with business stakeholders and IT team to understand the requirements and quickly translate them into workable solutions using Python and SQL (Bigquery)
Experience working in an agile and collaborative team environment?
Excellent written and verbal communication, presentation and professional speaking skills
Proven problem-solving skills and attention to detail with a commitment to excellence and high standards
#J-18808-Ljbffr
-
GCP Data Engineer
3 weeks ago
California, United States Newonlab Full timeAbout the role:As a Data Engineer, you will build a variety of big data analytics solutions, including big data lakes. More specifically, you will: Design and build scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data Execute high-performance data processing for structured and unstructured data and data harmonization...
-
GCP Network Engineer
22 hours ago
Pleasanton, California, United States Data Piper Full timeJob Description Role Description: Refine and update primary network design and implementation of production/non-production hybrid shared vpc host project. This includes: Multi-regional implementation of VLAN attachments to GCP network Validation of routing between GCP and Customer’s On-Prem Network Containing private Google regional traffic to adhere...
-
ML Infrastructure Engineer with GCP
3 weeks ago
Mountain View, California, United States iSoftTek Solutions Inc Full timeJob Title: ML Infrastructure Engineer with GCP Location: Mountain View, CA [Needs to be onsite for 1 week once in a quarter on your own expenses] Job Type: W2 Duration: Long Term Note: Only PST and MST candidates are required. Must have: · Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning...
-
Data Architect
4 weeks ago
California, United States theloops Full timeWe fundamentally believe that today's product needs to be designed with minimal support in mind. We are seed stage startup bringing product context to support reps to eliminate escalations and drive efficiency. The Co-founders are technology leaders with decades of experience solving the most pressing problems facing enterprises. At TheLoops we:We lead with...
-
Data Engineer
1 week ago
California, United States Open Systems Technologies Full timeA financial firm is looking for a Data Engineer to join their team in New York, NY. Pay: $70-100/hr • Work on migrating applications from an on-premises location to the cloud service providers. • Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation. • Develop, modify,...
-
Data Architect
3 weeks ago
California, United States Kinship Inc Full timeThis is an opportunity to create the industry-defining pet parent mobile experience and architecture Kinship is unlocking a new world for you and your pet. Because, if you’re like us, your pet is your world. Our family of brands is continuously working to challenge preconceived notions, evolve our environments, and (re)build a universe that supports and...
-
Data Engineer
3 weeks ago
California, United States e-Primary Full timeTitle: Data Engineer Location: Orange, CA (Remote. Full time schedule but must work 9:00 a.m. to 2:00 p.m. PT. and can flex start/end times around this). Duration: 6 months + w/potential temp to perm Description: We are seeking qualified candidates to join us in an enterprise-wide analytics initiative to help drive incremental business value from our broad...
-
Sr. Data Engineer
3 weeks ago
California, United States Tekstad Full timeSeeking a Sr. Data Engineers for my client in SFO CA. Duration: Long Term #Contract ----------------------------------------------------------------- Ideal Candidates must have below skills. •Responsible for scaling up data processing flow to meet rapid data growth. •Evolve data model and data schema based on business and engineering needs. •Implement...
-
Data Engineer II
3 weeks ago
California, United States Redica Systems, Inc. Full timeRedica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Embracing a hybrid model, our workforce is distributed globally, with headquarters in Pleasanton, CA. Redica's data analytics platform empowers companies to improve product quality and navigate evolving...
-
Data Scientist with Generative AI Expertise
3 weeks ago
Irvine, California, United States TEKRRA1 Full timeRole & Responsibilities: Design, develop, and implement advanced AI solutions to solve complex business problems across various domains. Collaborate with engineers, researchers, and product managers to understand business needs and translate them into technical specifications for AI models. Gather, clean, and prepare data for training and evaluating...
-
Software Developer Engineer in Test
3 weeks ago
California, United States Gilder Search Group Full timeWe are looking for a Software Developer Engineer in Test based in Latin America to work on a long-term project for one of our clients, a video game holding company based in Santa Monica, California. Our client creates the most epic interactive gaming and entertainment experiences on earth immersing players in new, unimagined worlds. Their products help build...
-
Data Engineer
4 weeks ago
California City, United States iTvorks Inc Full timeRequired Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD
-
Senior Software Engineer
3 weeks ago
California, United States Zscaler Full timeJob Summary: We are seeking a highly skilled and experienced Backend Engineer to join our team. The ideal candidate will be responsible for developing and maintaining the analytics pipeline that drives insights and decision-making across our organization. This role demands a strong background in databases, SQL, analytics, and optimization to ensure efficient...
-
Data Scientist
1 week ago
San Francisco, California, United States hackajob Full timeExciting Opportunity Alert! Join our Team as a Data Scientist! hackajob has partnered with a cutting-edge company seeking a talented Data Scientist with expertise in Predictive Modeling and Python to join our innovative team! Role: Data Scientist Location: Remote Salary: $100K - $180K depending on experience + benefits package Required Skills: *...
-
Senior Data Engineer
3 weeks ago
Sunnyvale, California, United States Two95 International Inc. Full timeTitle: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from...
-
Principal DevOps Engineer
4 weeks ago
Santa Clara, California, United States Palo Alto Networks Full timeJob Description Your Career Palo Alto Networks runs a large infrastructure and is one of the largest GCP customers. As a Principal DevOps Engineer for the PanOS Cloud Components team, you will be part of a team supporting the services running on this infrastructure. This includes automation, architecture, performance, observability, troubleshooting,...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States UpRecruit Full timeJob Details: Title: Sr. Data Engineer Salary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...
-
Data Engineer, Allergan Aesthetics,
3 weeks ago
Irvine, California, United States Allergan Aesthetics Full timeJob Description Overview: We are seeking a Data Engineer with experience in ETL, Snowflake, ThoughtSpot, and/or Power BI datasets to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems that enable our internal stakeholders to make data-driven decisions. This Data Engineer will...
-
Senior Cloud Security Engineer
3 weeks ago
San Francisco, California, United States Avant Digital Inc Full timeJob Description- Location: Remote Contract type - Contract / C2C Contract duration - 12 months Juniper Networks Cyber Fusion is looking for a certified cybersecurity professional to join our highly collaborative and diverse team of talent. who will be responsible for ensuring the security and compliance of our cloud infrastructure and data. You will work...
-
Staff Data Engineer
6 days ago
Foster City, California, United States Visa Full timeJob Description This position will be part of VCA (Visa Consulting & Analytics) function in building and maintaining global data assets and engineering solutions. We are looking expertise in data warehousing and building large-scale data processing systems by using the latest database technologies. The Data Engineer takes responsibility for building and...