Current jobs related to GCP Data Engineer - Blue Ash, Ohio - Tata Consultancy Services


  • Blue Ash, Ohio, United States beBee Careers Full time

    Transforming Data AssetsWe are seeking a talented Senior Data Engineer to join our team and help us transform our data assets. In this role, you will design and develop complex data solutions that meet the needs of our customers.You will have a strong background in computer science, software engineering, or a related field, with experience in data...


  • Blue Ash, Ohio, United States Compunnel Full time

    Job Summary: The Data Engineer is responsible for contributing to the successful delivery of the Customer Platform Analytics system, with a focus on migration and development in Databricks. The role involves leading technical design processes, developing scalable data engineering solutions, and collaborating across teams to ensure high-quality deliverables...


  • Blue Ash, Ohio, United States Compunnel Full time

    Job Summary: We are looking for a Senior Azure Data Engineer to join our dynamic and forward-thinking data team. The ideal candidate will be responsible for designing, developing, and maintaining robust, scalable, and high-performance data pipelines and architectures using Microsoft Azure technologies. This role requires a deep understanding of cloud-based...


  • Blue Ash, Ohio, United States Kroger Tech & Digital Full time

    Data Engineering for Mfg and MAKE program - taking legacy systems/data and building up environments/set up/data modeling/repositories to shift to new ERP solution M3 (Infor Product).Data needs, with procurement, flows, etc. Accountable for developing and delivering technological responses to targeted business outcomes.Analyze, design and develop...


  • Blue Ash, Ohio, United States LeadStack Inc. Full time

    LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world. Job...


  • Blue Ash, Ohio, United States Aditi Consulting Full time

    Payrate: $70.00- $75.00/hr. Summary: The Data Integration Team is seeking a Data Engineer with ETL experience. We are looking for highly technical and progressive Data Engineers to support both the operations of The Co. and its forward-thinking Data Strategy organization. The Data Engineer position entails building strong relationships with business partners...


  • Blue Ash, Ohio, United States beBee Careers Full time

    Job Title: Cloud FinOps EngineerDescription:Optimizing cloud usage and spending requires a specialized approach. As a Cloud FinOps Engineer, you will be responsible for managing budget and spend forecasts, identifying variances, and collaborating with product teams to optimize costs.Responsibilities:Develop and maintain cost forecasts for cloud platforms,...


  • Blue Ash, Ohio, United States Golden Technology Full time

    Job Description Join a leading-edge company that partners with Fortune 50 clients to deliver transformative retail and ecommerce solutions. We are at the forefront of innovation, helping global brands navigate the rapidly evolving digital landscape. Our team is composed of industry experts who are passionate about driving business success through strategic...


  • Blue Ash, Ohio, United States beBee Careers Full time

    Job Summary:The Senior Data Engineer will lead the development and implementation of large-scale data systems and solutions. This includes designing and building complex data pipelines, collaborating with cross-functional teams, and ensuring data quality, integrity, and security. The ideal candidate will have strong technical skills, excellent communication...


  • Blue Ash, Ohio, United States Apidel Technologies Full time

    Job Description Job Description Job DescriptionProvide advanced and/or cross-technology engineering through all phases of the Technology / Project Life Cycle. The Technology Engineer is responsible for the overall systems infrastructure including engineering, implementation and integration, and technical services and support. The Technology Engineer designs,...

GCP Data Engineer

4 weeks ago


Blue Ash, Ohio, United States Tata Consultancy Services Full time

Job Description

Job Type: Fulltime

Location: Blue Ash, Ohio, United States (Onsite)

Experience: 10+years

As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will involve collaboration with cross-functional teams, leveraging cutting-edge technologies, and ensuring scalable, efficient, and secure data engineering practices. A strong emphasis will be placed on expertise in GCP, Vertex AI, and advanced feature engineering techniques.

  • 4+ years of professional Data Development experience.
  • 4+ years of experience with SQL and NoSQL technologies.
  • 3+ years of experience building and maintaining data pipelines and workflows.
  • 5+ years of experience developing with Java.
  • 2+ years of experience developing with Python.
  • 3+ years of experience developing Kafka solutions.
  • 2+ years of experience in feature engineering for machine learning pipelines.
  • Experience with GCP services such as BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow.
  • Experience with CI/CD pipelines and processes.
  • Experience with automated unit, integration, and performance testing.
  • Experience with version control software such as Git.
  • Full understanding of ETL and Data Warehousing concepts.
  • Strong understanding of Agile principles (Scrum).
  • Additional Qualifications
  • Knowledge of Structured Streaming (Spark, Kafka, EventHub, or similar technologies).
  • Experience with GitHub SaaS/GitHub Actions.
  • Experience understanding Databricks concepts.
  • Experience with PySpark and Spark development.

Roles & Responsibilities:

  • Provide Technical Leadership: Offer technical leadership to ensure clarity between ongoing projects and facilitate collaboration across teams to solve complex data engineering challenges.
  • Build and Maintain Data Pipelines: Design, build, and maintain scalable, efficient, and reliable data pipelines to support data ingestion, transformation, and integration across diverse sources and destinations, using tools such as Kafka, Databricks, and similar toolsets.
  • Drive Digital Innovation: Leverage innovative technologies and approaches to modernize and extend core data assets, including SQL-based, NoSQL-based, cloud-based, and real-time streaming data platforms.
  • Implement Feature Engineering: Develop and manage feature engineering pipelines for machine learning workflows, utilizing tools like Vertex AI, BigQuery ML, and custom Python libraries.
  • Implement Automated Testing: Design and implement automated unit, integration, and performance testing frameworks to ensure data quality, reliability, and compliance with organizational standards.
  • Optimize Data Workflows: Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
  • Mentor Team Members: Mentor team members in data principles, patterns, processes, and practices to promote best practices and improve team capabilities.
  • Draft and Review Documentation: Draft and review architectural diagrams, interface specifications, and other design documents to ensure clear communication of data solutions and technical requirements.
  • Cost/Benefit Analysis: Present opportunities with cost/benefit analysis to leadership, guiding sound architectural decisions for scalable and efficient data solutions
  • Support flows for an ML platform in GCP and needs to be able to work with data science and understand the ML concepts in terms of requirements to be met by the data.

#LI-RJ2

Salary Range - $93,700-$135,000 a year