Data Engineer

3 months ago

Atlanta, United States GSquared Group Full time

Title: Data Engineer / GCP

Terms: Contract to hire

Location: Atlanta area

HYBRID ROLE

MUST LIVE IN ATLANTA, GEORGIA

No 3rd party agencies at this time


Are you looking for a career opportunity that allows you to grow your career? If so, this opportunity will genuinely excite you Our client is transforming how their organization services their customers while aligning best in breed technology solutions. We are looking for a Data Engineer / GCP who will help build out & develop best in class work and work on innovative projects for the business.


Role Details:


Job Description: Data Engineer / GCP

Overview:

A Data Engineer with GCP (Google Cloud Platform) experience is responsible for designing, developing, and maintaining data pipelines and infrastructure on GCP. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for various analytics and business intelligence applications.

Key Responsibilities:

  1. Data Pipeline Development:
  • Design, develop, and maintain scalable data pipelines using GCP tools and services such as Dataflow, Dataproc, and Pub/Sub.
  • Implement ETL (Extract, Transform, Load) processes to ingest and transform data from various sources into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.
  1. Data Infrastructure Management:
  • Architect and manage data infrastructure on GCP to ensure high availability, scalability, and security.
  • Configure and optimize data storage solutions, ensuring efficient data retrieval and query performance.
  • Set up and manage data lake and data warehouse solutions on GCP.
  1. Data Quality and Governance:
  • Ensure data quality and integrity through robust validation and cleansing processes.
  • Implement data governance practices to maintain data security, privacy, and compliance with relevant regulations.
  • Develop and maintain documentation for data pipelines, infrastructure, and processes.
  1. Collaboration and Support:
  • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs.
  • Provide technical support and troubleshooting for data-related issues.
  • Collaborate with cross-functional teams to integrate data solutions with other systems and applications.
  1. Monitoring and Optimization:
  • Monitor data pipelines and infrastructure to ensure optimal performance and reliability.
  • Implement and maintain monitoring tools and dashboards to track data flow and system health.
  • Continuously optimize data processes and infrastructure for cost efficiency and performance.
  1. Continuous Learning and Improvement:
  • Stay updated with the latest GCP services, tools, and best practices.
  • Participate in training and professional development to enhance technical skills and knowledge.
  • Identify and implement improvements to data engineering practices and workflows.

Qualifications:

  • Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Experience: 3-5 years of experience in data engineering, with at least 2 years of experience working with GCP.
  • Certifications: Google Cloud Professional Data Engineer certification is preferred.

Skills and Competencies:

  • Proficient in GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Cloud SQL.
  • Strong understanding of data engineering principles and best practices, including ETL processes, data modeling, and data warehousing.
  • Experience with programming languages such as Python, Java, or Scala.
  • Proficient in SQL and database management.
  • Familiarity with data governance, data security, and compliance standards.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and collaboration abilities.
  • Ability to manage multiple projects and priorities effectively.


About GSquared Group:

Shouldn’t your recruiting partner put as much effort and value into your career as you do? With GSquared Group, we take the time to understand where you would like to take your career and what is important to you.


GSquared Group is a woman-owned boutique technology services company in the Atlanta area. Founded in 2010, we are a premier provider of IT talent search, management consulting, and software development services. We support a diverse client base that spans all industries and includes Fortune 100 to mid-market companies. We offer direct hire placement, contract, and contract-to-hire positions. We are proud to be known by our community for putting relationships at the core of everything we do.


GSquared Benefits:

Competitive & Comprehensive Healthcare Package (available only for W2 hourly consultants)

Simple IRA with company match (available only for W2 hourly consultants)

Professional development & networking opportunities

A family-friendly environment

Nice bonuses for referrals

A culture that supports you and your career


Hear what others are saying on Glassdoor:

  • Data Engineer

    5 months ago

    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    5 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Center Engineering Operations Technician

    3 months ago

    Atlanta, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be Earth's most Customer-centric Company and Earth's Best Employer. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build and expand The Cloud, this is your chance to make history.Amazon Data Services Inc. is currently hiring for a Engineering Operations Tech (EOT) to support our...

  • Systems Engineer

    3 days ago

    Atlanta, United States NTT DATA Full time

    Company Overview: Req ID: 24-02313 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineer to join our team in Atlanta, Georgia (US-GA), United States (US). Job...

  • Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States iVoyant Full time

    About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team.The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design.They will ensure the availability and validity of the data to ensure that it fits with the...

  • Data Engineer

    1 day ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    3 days ago

    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    2 weeks ago

    Atlanta, United States Motion Recruitment Full time

    Every year, nearly 200 million travelers trust our client to get them where they're going. Take your career to new heights by working for this longstanding leader in air travel that services more worldwide destinations than any other airline. We are looking for a Data Engineer to join our team for a 12 month contract in Atlanta, GA (hybrid). Contract...

  • Data Engineer

    3 weeks ago

    Atlanta, United States Wise Skulls llc Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Atlanta, GA; Dallas, TX (On-site) Duration: 6+ Months Implementation Partner: Infosys End Client: To be disclosedJD:4 to 5 years of experience in Snowflake with DatabricksExperience working with large, heterogeneous data sets in building and optimizing data pipelines and solutions on the...

  • Data Engineer

    3 months ago

    Atlanta, United States Scalene Works People Solution LLP Full time

    Requisition/Position Title Senior Azure Data Engineer Employment (Regular/Consultant) Regular Position Type (New/Replacement) New Experience Level (Min-Max) >6 Years Mandatory Skillset (Maximum 5) Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake Detailed Job Description Job Responsibilities: · Design, develop, and implement robust...

  • Data Engineer

    2 months ago

    Atlanta, United States Agile Full time

    Data Engineer Our client is a thriving company fostering a collaborative and engaging work environmentThey empower individuals to make a real difference through their contributions. The Data Engineer plays a pivotal role in driving data-centric decision makingYou'll collaborate with various business units to translate needs into actionable data...

  • Data Engineer

    3 months ago

    Atlanta, United States Marathon TS Full time

    Job DescriptionJob DescriptionData Engineer is responsible for supporting our enterprise data warehouse for our Supply Chain Operations. As a Data Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production...

  • Data Engineer

    1 month ago

    Atlanta, United States VetsEZ Full time

    VetsEZ is seeking a highly skilled Data Engineer to join our team. The successful candidate will work remotely and will be responsible for managing and optimizing large-scale data systems, supporting data integration and transformation, and ensuring data quality and accessibility. This role requires strong technical expertise in database management, data...

  • Senior Data Engineer

    1 week ago

    Atlanta, United States Optomi Full time

    Senior Data EngineerOptomi, in partnership with a leading distributor of wine and spirits, is seeking a Senior Data Engineer for their Atlanta, GA location. Candidates must be able to combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support...

  • Senior Data Engineer

    1 week ago

    Atlanta, United States Optomi Full time

    Senior Data EngineerOptomi, in partnership with a leading distributor of wine and spirits, is seeking a Senior Data Engineer for their Atlanta, GA location. Candidates must be able to combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support...

  • Data Engineer

    7 days ago

    Atlanta, United States Hirewell Full time

    Your RoleAs a Technology Data Engineer, you'll be instrumental in managing the flow, ingestion, and accessibility of data to support the growth of our brand. We are looking for a proactive team player who takes ownership of their work and responsibilities. You’ll ensure the seamless integration and security of data within our data warehouse, focusing on...

  • Data Engineer

    6 days ago

    Atlanta, United States Hirewell Full time

    Your RoleAs a Technology Data Engineer, you'll be instrumental in managing the flow, ingestion, and accessibility of data to support the growth of our brand. We are looking for a proactive team player who takes ownership of their work and responsibilities. You’ll ensure the seamless integration and security of data within our data warehouse, focusing on...

  • Data Engineer

    1 week ago

    Atlanta, United States Stellar Consulting Solutions, LLC Full time

    Job Description:The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions. Qualifications:Five or more...

  • Data Engineer

    1 week ago

    Atlanta, United States Stellar Consulting Solutions, LLC Full time

    Job Description:The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions. Qualifications:Five or more...

  • Data Engineer

    2 days ago

    atlanta, United States Northern Rock Full time

    Data Engineer at Northern RockOverview: Northern Rock is seeking a skilled Data Engineer to play a pivotal role in evolving and enhancing our data infrastructure. We are looking for a candidate who is not only experienced in building and optimizing data pipelines but is also passionate about creating data systems from the ground up.Key Responsibilities:Data...