GCP Data Engineer
3 weeks ago
Urgent fill -
We need someone who is current hands-on with building end-to-end data pipeline using GCP services such as Dataflow, Spark+Python (DataProc), Composer, GCS, BQ, etc. This is a more hands-on developer role.
Would love someone in Chicago, would take someone remote.
10+ years experience.
Waiting on rate information
Client -
JOB TITLE: GCP Data Engineer
POSITION SUMMARY:
The GCP Data Engineer is responsible for Analysis, Design, Development, Testing and Deployment support for new framework, enhance existing framework that enables the data platform data pipelines. This position is required to perform independently in a highly dynamic and fast paced environment. The person will work alongside Architects, engineers, analysts and PMs to deliver scalable robust innovative technical solutions. This position plays a key role in building real-time and batch data ingestion, egress frameworks, streaming analytics framework and support AI platform. The person must have similar experience in a prior job.
RESPONSIBILITIES
- Build frameworks for large-scale data processing evaluating appropriate emerging technologies, and approaches that will power data-driven capabilities across the Enterprise.
- Develops data solutions on Google Cloud Platform leveraging Google Data Flow, Data Proc, Composer, Pub/Sub, BigQuery, GCS, Cloud function, define workflows, scheduled and event driven workloads to ingest data from internal/external partners, data distribution channels, etc.
- Build features using Python in Spark, leveraging GCP's Spark Engine (Dataproc), SQL/GSQL on Google BQ.
- Build and maintain scalable data pipelines to handle high-volume data (e.g., 150 million rows).
- Collaborate with cross-functional technologists across the organization to gather requirements, solve new problems and deliver quality results.
- Coordinate with offshore engineers to get projects/tasks completed.
- Develops and executes test plans to validate the implementation and performance of frameworks and recommend performance improvements.
- Supports the operations of the deployed solutions, investigates complex issues and assists with the resolution and implementation of preventive measures.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering, with a focus on GCP technologies.
- Proficiency in Google Cloud Platform leveraging Google Data Flow, Data Proc, Composer, Pub/Sub, BigQuery, GCS, Cloud function, define workflows, scheduled and event driven workloads processing.
- Hands-on experience and solid knowledge in building and maintaining end-to-end data pipelines using Python and Spark (GCP Dataproc) or any other GCP services
- Strong experience with BigQuery including SQL and Stored Procedures.
- Experience with high-volume data processing (GB-level).
- Previous experience working in a similar role with GCP Services is a must.
- Experience in data quality, continuous integrations build and deployment processes using GitHub, Jenkins and Unix/Linux shell scripts.
- Proactive and able to catch issues before failures.
- Possess a strong work ethic; takes pride in producing a quality product and a strong team player
- Work with production support and project consultants in an onshore / offshore model
- Support off-hours platform issues and code deployments as needed
-
GCP Data Engineer
3 weeks ago
Tampa, United States SysMind Tech Full time3-5+ years of experience of in the following • Direct experience managing, securing Compute Engine at an organizational level • Experience in implementing security best practices on GCP, including identity and access management (IAM), encryption, and threat detection .• Proficiency in designing and managing data pipelines on GCP, using services like...
-
GCP Data Engineer
3 weeks ago
Tampa, Florida, United States RIT Solutions, Inc. Full timeJob Summary:The GCP Data Engineer will be responsible for designing, developing, and deploying scalable data pipelines on Google Cloud Platform. This role requires expertise in GCP services such as Dataflow, Spark, and BigQuery.Key Responsibilities:Design and develop end-to-end data pipelines using GCP servicesCollaborate with cross-functional teams to...
-
GCP Data Engineer
3 weeks ago
Tampa, United States Syntricate Technologies Full timeRequired Skills: GCP Knowledge: In-depth knowledge and experience with Google Cloud Platform (GCP) services and tools, including GCP databases (PostgreSQL, MongoDB), Data Flow, and related services. GKE + Google Data flow PostgreSQL Administration: Strong knowledge and experience in administering PostgreSQL databases, including installation,...
-
GCP Consultant
3 weeks ago
Tampa, United States RIT Solutions, Inc. Full timeRole: GCP Consultant Duration: Contract Until EoY with high likelihood of extension Location: 100% Remote Interviews: 2 rounds Beauty industry Job Summary: As GCP Administrator /Developer, you will be responsible for a hybrid role, with a focus on both administrative and development tasks related to Google Cloud Platform. You will play a pivotal role in...
-
GCP Cloud Security Developer
1 month ago
Tampa, United States KellyMitchell Group Full timeJob Summary:Our client is seeking a GCP Cloud Security Developer to join their team! This position is located in Tampa, Florida.Duties:Plan, implement, manage, monitor, and upgrade security measures for the protection of the organization's data, systems, and networksDesign, test, and build security automation and tooling to promote security hygieneWork...
-
GCP Technical Specialist
4 weeks ago
Tampa, Florida, United States Omni Inclusive Full timeKey Responsibilities:As a GCP Admin L2 Support, you will be responsible for providing high-level technical support and expertise to our clients. This includes:Cloud Administration: Administering GCP services, including Pub/Sub, DataProc, and BigQuery, to ensure smooth operation and optimal performance.Cloud Infrastructure: Designing, implementing, and...
-
Cloud Operations Engineer
3 months ago
Tampa, United States Enterprise Recruiting Company Full timeJob DescriptionJob DescriptionA very fast-growing, leading innovator in AI-driven solutions and conversational technology is seeking an experienced Google Cloud Platform Operations Engineer to join their team.This position offers competitive compensation, great benefits (unlimited PTO, 401k w/ match, and more), and fully remote work, with 3 to 4 company-wide...
-
GCP Admin L2 Support
2 months ago
Tampa, United States Omni Inclusive Full timeMandatory Skills - Should have GCP L2 Admin Support experience , Pub Sub , DataProc and Big Query , experience in python and CI/CD ,Jenkin pipeline creation 4 + years of strong hands-on experience in GCP L2 Administration Experience in data service Administration of DataProc and Big Query (fixed module ,slot allocation , deploy ),GCP Service Enablement Good...
-
Sr Software Engineer- Big Data and Cloud
2 months ago
Tampa, United States Doran Jones Inc Full timeDoran Jones is looking for a Senior Software Engineer to leverage their engineering experience to create a solutions-focused Agile environment. This role requires hands-on participation in the development and optimization of processes, solutions, and code. When you join our team, you will have the opportunity to demonstrate your ability to work on solution...
-
Senior Big Data Engineer
5 days ago
Tampa, Florida, United States Citigroup Inc Full timeCitigroup Inc. is a leading global financial institution seeking an experienced professional to fill the role of Data Systems Architect in Tampa, Florida.Job Overview:This senior-level position involves leading the development and implementation of data-driven systems within Retail Risk Engineering, ensuring alignment with company goals and...
-
Data Engineering Specialist for Fraud Prevention
3 weeks ago
Tampa, Florida, United States Seven Seven Software Full timeAt Seven Seven Software, we're looking for a skilled Data Engineer to join our team and contribute to the development of cutting-edge data solutions. The ideal candidate will have experience in building data lakes, sourcing data, creating data pipelines, and serving data for production flow.Job OverviewThe successful candidate will be responsible for...
-
Cloud Database Engineer
3 weeks ago
Tampa, Florida, United States Syntricate Technologies Full timeJob Title: GCP Data EngineerJob Summary:GCP Data Engineer at Syntricate TechnologiesThe ideal candidate will have in-depth knowledge and experience with Google Cloud Platform services and tools, including databases, data flow, and related services. Strong skills in administering PostgreSQL and MongoDB databases, data flow, and database security are...
-
Tampa, Florida, United States CyberTec Full timeCyberTec is seeking a highly skilled Data Engineer to join our team in Tampa, FL. The ideal candidate will have extensive experience working with databases such as PostgreSQL and MySQL, proficiency in Python scripting, and expertise in designing and maintaining data lakes and data warehouses.About the Role:Design and develop data warehouse solutions tailored...
-
Systems Engineer
2 months ago
tampa, United States Imperium Data Full timeImperium Data Talent Solutions has a client located in the Tampa, Florida area looking to add a Systems Engineer to their team. The client is a growing company and offers very competitive compensation and benefits. This opportunity also offers a hybrid work schedule (3 days on-site) and working with cutting-edge technology (cloud, AI, etc.).For immediate...
-
Senior Java Spark Data Engineer
3 weeks ago
Tampa, Florida, United States Diverse Lynx Full timeCompany OverviewDiverse Lynx LLC is a forward-thinking company dedicated to fostering diversity and promoting equal opportunities for all. Our organization strives to provide an inclusive work environment that supports the growth and well-being of our employees.SalaryThe estimated annual salary range for this position is $120,000 - $180,000 based on industry...
-
Data Engineer
2 weeks ago
Tampa, United States General Dynamics Information Technology Full timeType of Requisition:RegularClearance Level Must Currently Possess:Top Secret/SCIClearance Level Must Be Able to Obtain:Top Secret/SCIPublic Trust/Other Required:NoneJob Family:Data ScienceJob Qualifications:Skills:Data Analysis, Data Lake, DatasetsCertifications:NoneExperience:3 + years of related experienceUS Citizenship Required:YesJob Description:About...
-
Tampa, United States Indotronix International Corporation Full timeRoles: Senior Data Engineer or Manager Data Engineering and Analytics Full Time Perm Role. Location: Onsite Hybrid in one of this two locations. St Petersburg, FL OR Denver, CO. The hybrid expectation will be 2-3 days in-office. Note: Have two roles: One for a Senior Data Engineer and 2nd for Manager Data Engineering and Analytics. Skills Oracle Focussed,...
-
Tampa, United States Indotronix International Corporation Full timeRoles: Senior Data Engineer or Manager Data Engineering and Analytics Full Time Perm Role. Location: Onsite Hybrid in one of this two locations. St Petersburg, FL OR Denver, CO. The hybrid expectation will be 2-3 days in-office. Note: Have two roles: One for a Senior Data Engineer and 2nd for Manager Data Engineering and Analytics. Skills Oracle Focussed,...
-
Data Engineer
14 hours ago
Tampa, United States Marathon TS Full timeMarathon TS is currently seeking a Data Engineer to join our team. The place of performance for this work is at MacDill AFB, near Tampa, FL, with the possibility of up to 10% travel. Primary Duties and Responsibilities for this position include: Perform data ingestion, modeling, and interpretation. Conduct analysis of datasets to extract meaningful...
-
Data Engineer
1 day ago
Tampa, United States Virtusa Full timeDescription Responsible for design and development of big data solutions. Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop Responsible for moving all legacy workloads to cloud platform Work with data scientist to build Client pipelines using heterogeneous sources and provide engineering...