Senior Data Engineer
5 days ago
Title : GCP Data Engineer
Location : Phoenix, AZ
Duration : Long Term
We are transforming data management and analytics to build cutting-edge solutions on the Google Cloud Platform (GCP). We are looking for an experienced and motivated GCP Data Engineer to join our growing team, who is passionate about migrating on-premise data systems to the cloud, and optimizing data pipelines. This role will work closely with data architects, analysts, and cloud engineers to build and migrate scalable data solutions on GCP.
Job Description:
We are seeking a GCP Data Engineer with expertise in data migration from on-premise systems to Google Cloud Platform (GCP), especially utilizing BigQuery, PySpark, and other modern cloud-based data technologies. The ideal candidate will have extensive experience in data engineering, cloud migration, and the ability to work on large-scale data transformations. Experience with Spring is a plus, as it will aid in building robust and scalable data applications.
Key Responsibilities:
- Lead data migration initiatives from on-premise data storage and systems to GCP, ensuring high performance, scalability, and minimal downtime.
- Develop and optimize data pipelines leveraging BigQuery for large-scale analytics and querying of structured and unstructured data.
- Work with PySpark to design and implement distributed data processing tasks and data transformations.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions on GCP.
- Implement best practices for data governance, security, and compliance during migration and in cloud environments.
- Develop custom solutions using Spring Framework to integrate cloud services and manage data flows.
- Troubleshoot, optimize, and monitor data pipelines, ensuring seamless integration and high performance in GCP.
- Provide ongoing support and maintenance for cloud-based data systems.
- Document architecture, processes, and code for team knowledge-sharing and compliance purposes.
Required Qualifications:
- Strong hands-on experience in migrating data from on-premise to cloud environments, particularly GCP.
- Proficiency with BigQuery for data analytics, including data modeling, query optimization, and performance tuning.
- Expertise in PySpark for building scalable data processing pipelines and working with large datasets.
- In-depth knowledge of cloud-based data architecture and engineering principles.
- Experience with cloud tools and services like Google Cloud Storage, Dataflow, Dataproc, Cloud Pub/Sub, etc.
- Strong programming skills in Python for data engineering tasks.
- Ability to design, develop, and optimize data pipelines for large datasets and high-volume workloads.
- Experience working with Spring or Spring Boot to develop backend applications is a plus.
- Excellent problem-solving skills, ability to debug complex data systems and optimize workflows.
- Strong communication skills and ability to collaborate with both technical and non-technical stakeholders.
Preferred Qualifications:
- Google Cloud certifications (e.g., Associate Cloud Engineer, Professional Data Engineer) are a plus.
- Familiarity with data orchestration tools such as Airflow or Composer.
- Experience with Docker, Kubernetes, or containerization technologies.
- Knowledge of SQL and working with relational databases.
- Exposure to DevOps practices for CI/CD pipelines and automation.
Why Join Us?
- Work in a collaborative, innovative, and dynamic environment.
- Opportunity to work with cutting-edge technologies on Google Cloud.
- Competitive salary and comprehensive benefits package.
- Career growth and development opportunities.
- Flexible work environment (remote and hybrid options available).
If you are passionate about GCP, cloud migration, data engineering, and building scalable solutions, we would love to hear from you
-
Data Center Engineering Internship Opportunity
2 weeks ago
Phoenix, Arizona, United States Vantage Data Centers Full timeData Center Project Coordination OpportunityWe are seeking a highly motivated Project Engineer Intern to join our Design, Engineering & Construction (DEC) team at Vantage Data Centers. As a member of our team, you will have the opportunity to work on a large, data center campus project, providing an overview of design development, engineering, contracting,...
-
Senior Data Engineer
2 weeks ago
Phoenix, Arizona, United States Oracle America, Inc. Full timeJob OverviewA highly skilled Senior Data Engineer is required to manage complex data pipelines, dashboards, and business intelligence initiatives that impact both product and business for Oracle Cloud Infrastructure. The ideal candidate will thrive in a fast-paced environment, driving data-driven initiatives to ensure a seamless customer experience while...
-
Senior Data Engineer Lead
3 weeks ago
Phoenix, Arizona, United States Glint Tech Solutions LLC Full timeAbout Glint Tech Solutions LLCWe are a leading technology company that provides innovative solutions to businesses around the world.As a Senior Data Engineer at Glint Tech Solutions LLC, you will have the opportunity to work with a talented team of engineers and collaborate with cross-functional teams to design and implement robust data solutions.Job...
-
Senior Data Engineer
3 weeks ago
Phoenix, Arizona, United States Saxon Global Full timeJob DescriptionWe are looking for a Senior Data Engineer who can design, define, and maintain databases. The ideal candidate will have hands-on experience in developing and deploying SSIS and SSRS in different environments.The successful candidate will also have expertise in data warehousing, including business intelligence tools such as SQL, SSIS, and SSRS....
-
Senior Data Engineer
2 weeks ago
Phoenix, United States Impresiv Health Full timeTitle: Senior Data Engineer Location: Remote (AK, AR, AZ, CA, *CO, FL, *HI, IA, ID, IL, KS, LA, MD, MN, MO, MT, NE, NV, NM, NC, ND, OK, OR, SC, SD, TN, TX, UT, VA/DC, *WA, WI & WY only) Description: The Senior Data Engineer will be responsible for the design and development of ETL. The role will cover full systems development life cycle (SDLC) phases...
-
Senior Java Software Engineer
1 month ago
Phoenix, Arizona, United States NTT DATA Full timeAbout the RoleWe are currently seeking a skilled Senior Java Software Engineer to join our team in Phoenix, Arizona (US-AZ), United States (US). This is a permanent, full-time, salaried position with benefits.Key Responsibilities:Develop and deploy APIs using Java/J2EE and Spring framework.Write tested, idiomatic, and documented code.Cooperate with front-end...
-
Senior Data Engineer
2 weeks ago
Phoenix, Arizona, United States RIT Solutions, Inc. Full timeRIT Solutions, Inc. is looking for a seasoned Senior Data Engineer - GCP Specialist to architect and implement data solutions that deliver insights, visualizations, or better predictions for our clients. This position offers an estimated salary of $190,000 per year. Key responsibilities include overseeing the entire technical lifecycle of a cloud data...
-
Senior Big Data Engineer
2 weeks ago
Phoenix, Arizona, United States Glint Tech Solutions LLC Full timeJob Title: Senior Big Data Engineer• Estimated Salary: $180,000 - $250,000 per yearAbout Us:Glint Tech Solutions LLC is a leading technology company that specializes in data engineering and analytics. We are seeking an experienced Senior Big Data Engineer to join our team.Job Description:We are looking for a highly skilled Senior Big Data Engineer to...
-
Senior Data Analyst
3 weeks ago
Phoenix, United States Disability Solutions Full timeJob Title:Senior Data AnalystLocation:Block 23What you'll do:The Senior Data Analyst is a catalyst for driving Enterprise Data & Analytics solutions. This person is accountable to ensure the alignment of data requirements between business and technology teams by working alongside business teams to understand business process and data flows. The Senior Data...
-
Senior Data Engineer
2 weeks ago
Phoenix, United States CoreAi Consulting Full timeRole DescriptionThis is a full-time on-site role for a Data Engineer at CoreAi Consulting. The Big Data Developer will be responsible for data engineering, ETL processes, big data management, data warehousing, and software development tasks.QualificationsMust have 5+ experience working in large scale application development using Big Data ecosystemStrong...
-
Phoenix, Arizona, United States Jobot Full timeJobot is a trusted partner for mechanical design and build services, serving clients in the data center and semiconductor industries.Compensation Package:The estimated annual salary for this position is between $120,000 and $180,000, depending on experience.Job Summary:As a Senior Mechanical Engineer for Data Centers and Semiconductors, you will play a...
-
Data Engineer
1 month ago
Phoenix, United States Inficare Full timeRole : Data Engineer Location : Phoenix, AZ -(onsite) Duration :long term Contract Job Description : Certified in GCP Client is looking for someone who is good at: 1. Strong in GCP and Python 2. Knowledge on migration projects 3. experience on building re-usable idempotent pipelines 4. emphasize on data engineering principles on pipelines being built 5....
-
Senior Data Center MEP Project Engineer
1 month ago
Phoenix, Arizona, United States Jobot Full timeAbout the RoleWe are seeking an experienced Senior Data Center MEP Project Engineer to join our dynamic team. As a key member of our construction team, you will play a critical role in the development of state-of-the-art data centers.Job ResponsibilitiesOversee all aspects of the MEP design and construction for data center projects, from conception to...
-
Data Engineer for Advanced Analytics
2 weeks ago
Phoenix, Arizona, United States Centraprise Full timePosition: Senior Data EngineerWe are looking for a skilled Data Engineer to join our team at Centraprise in Phoenix, AZ. As a Senior Data Engineer, you will be responsible for designing and implementing data systems that drive business growth. Your expertise in data models, data mining, and segmentation techniques will help us uncover new insights and...
-
Senior Azure Data Engineer
3 weeks ago
Phoenix, Arizona, United States Georgia IT Inc Full timeAt Georgia IT Inc, we are seeking a talented Data Engineering Director to lead our data engineering team. This role involves leading the development of Azure data services, including Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage.This director-level position requires strong leadership skills, excellent communication, and a deep...
-
Data Engineer
1 month ago
Phoenix, United States Glint Tech Solutions LLC Full timeAbout the job Data Engineer (Contractor) Position Overview: We are seeking an experienced Senior Data Engineer with a strong background in building, deploying, and supporting data ingestion and batch applications on Google Cloud. The ideal candidate will have extensive experience with BigQuery, Cloud Storage, Dataproc, and Cloud Composer/Airflow, along...
-
Phoenix, Arizona, United States Damco Solutions Full timeAbout the Role: Damco Solutions is seeking a Senior Data Engineer with QA experience to join our team. As a key member of our team, you will design, develop, and maintain large-scale data systems using Snowflake, Python, DBT (SQL), and Data Warehouse technologies. You will also be responsible for regression testing and matching data. The ideal candidate will...
-
Data Engineer/ Data Modeler
1 month ago
Phoenix, United States Futran Tech Solutions Pvt. Ltd. Full timePhoenix, AZ onsite Contractor Visa Type No restriction Job description In this role you will oversee all technical aspects of our databases that power our global work application This role requires a deep understanding of database architectures and handson experience with database technologies The successful candidate will ensure optimal database performance...
-
Azure Data Engineering Lead
2 weeks ago
Phoenix, Arizona, United States Georgia IT Inc Full timeGeorgia IT Inc is seeking a highly skilled Data Engineering Lead to lead the development of Azure data services, including Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. This senior-level position requires 3+ years of experience with Azure data services, strong leadership skills, excellent communication, and a deep understanding of...
-
Senior Data Platform Developer
2 weeks ago
Phoenix, Arizona, United States Citizens Full timeKey ResponsibilitiesThe Senior Data Platform Developer will be responsible for collaborating with business leaders to determine project requirements and ensuring that databases meet the bank's technical feasibility standards. They will design and develop scalable, cloud-based data solutions using best practices and apply data engineering techniques to build...