GCP Data Engineer

2 months ago

Southfield, United States Stefanini North America and APAC Full time

We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics platforms on Google Cloud Platform or other cloud environments is a must. We are looking for candidates who have a broad set of technical skills across these areas.


Key Responsibilities

  • Work in collaborative environment that leverages paired programming.
  • Work on a small agile team to deliver curated data products.
  • Work effectively with fellow data engineers, product owners, data champions and other technical experts.
  • Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
  • Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
  • Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies


Skills Required

  • Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment.
  • Implement methods for automation of all parts of the pipeline to minimize labor in development and production
  • Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products
  • Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption
  • Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management


Experience Required

  • 5+ years of SQL development experience
  • 5+ years of analytics/data product development experience required
  • 3+ years of Google cloud experience with solutions designed and implemented at production scale
  • Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
  • Experience migrating Teradata to GCP - Experience working with Airflow for scheduling and orchestration of data pipelines
  • Experience working with Terraform to provision Infrastructure as Code
  • 2 + years professional development experience in Java or Python


Skills Preferred

  • Strong drive for results and ability to multi-task and work independently
  • Self-starter with proven innovation skills
  • Ability to communicate and work with cross-functional teams and all levels of management
  • Demonstrated commitment to quality and project timing
  • Demonstrated ability to document complex systems


Experience Preferred

  • Experience converting Microsoft SSRS, SSAS and SSIS to BQ
  • Experience converting Mainframe JCL, COBOL and CA7
  • Experience converting SAS code to BQ
  • Experience converting Web Focus reports into Qlik Sense
  • In-depth understanding of Google's product technology (or other cloud platform) and underlying architectures
  • Experience in working with DBT/Dataform
  • Experience with DataPlex or other data catalogs is preferred
  • Experience with development eco-system such as Tekton, Git, Jenkins for CI/CD pipelines
  • Exceptional problem solving and communication skills
  • Experience in working with Agile and Lean methodologies
  • Team player and attention to detail
  • Experience with performance tuning SQL queries


Education Required

  • Bachelor's degree in computer science or related scientific field


Education Preferred

  • GCP Professional Data Engineer Certified
  • Master's degree in computer science or related field
  • 2+ years mentoring engineers
  • In-depth software engineering knowledge

  • GCP Data Engineer

    1 month ago

    Southfield, United States Stefanini North America and APAC Full time

    We're seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics...

  • GCP Java Full Stack Developer

    2 months ago

    Southfield, United States Stefanini North America and APAC Full time

    This role will be part of our Ingest Pattern team which owns end-to-end responsibility to design, build and support ingestion solutions that allow ingesting teams to quickly build pipelines to ingest data into the Data Platform. These ingestion solutions provide a framework and code templates that provide no/low code solutions for developers and operators to...

  • GCP Java Full Stack Developer

    2 months ago

    Southfield, United States Stefanini North America and APAC Full time

    This role will be part of our Ingest Pattern team which owns end-to-end responsibility to design, build and support ingestion solutions that allow ingesting teams to quickly build pipelines to ingest data into the Data Platform. These ingestion solutions provide a framework and code templates that provide no/low code solutions for developers and operators to...

  • GCP Front End Developer

    2 months ago

    Southfield, United States Stefanini North America and APAC Full time

    Develops software and services in support of design, infrastructure, and technology platforms, including applications, utilities, databases, cloud-based and Internet-related tools. Build reusable code and libraries. Ensure the technical feasibility of UI/UX designs. Optimize applications for maximum speed and scalability, supports responsive web and mobile...

  • DevOps Architect

    2 weeks ago

    Southfield, United States Stefanini North America and APAC Full time

    We are seeking an experienced and highly skilled Senior DevOps Engineer/Lead. The ideal candidate will have a strong background in data warehousing and significant experience working with Google Cloud Platform (GCP). As a Senior DevOps Engineer, you will play a critical role in designing, implementing, and maintaining the infrastructure and tools that enable...

  • DevOps Architect

    3 weeks ago

    Southfield, United States Stefanini North America and APAC Full time

    We are seeking an experienced and highly skilled Senior DevOps Engineer/Lead. The ideal candidate will have a strong background in data warehousing and significant experience working with Google Cloud Platform (GCP). As a Senior DevOps Engineer, you will play a critical role in designing, implementing, and maintaining the infrastructure and tools that enable...

  • Software Engineer

    2 weeks ago

    Southfield, United States Stefanini North America and APAC Full time

    Position Description: As a Software Engineering Supervisor, you will be responsible for leading and mentoring a team of software engineers, ensuring the successful delivery of high-quality software projects, and contributing to the overall growth and development of the engineering team. You will play a key role in fostering a collaborative and innovative...

  • DevOps Architect

    1 day ago

    Southfield, Michigan, United States Stefanini North America and APAC Full time

    Job DescriptionWe are seeking an experienced and highly skilled Senior DevOps Engineer/Lead to join our team at Stefanini North America and APAC. The ideal candidate will have a strong background in data warehousing and significant experience working with Google Cloud Platform (GCP).Key ResponsibilitiesInfrastructure as Code: Design, build, and maintain...

  • Solution Engineer AWS Cloud

    3 months ago

    Southfield, United States Global Information Technology Full time

    Job DescriptionJob DescriptionJob Title: Solution Engineer AWS CloudJob Location: RemoteJob Type: Full TimeJob Description:Bachelor's degree or higher in software engineering or a relevant quantitative disciplineAWS Certified Developer with 5+ years' experience working with core AWS servicesExperience with AWS Glue, AWS Batch, SageMaker,...

  • Software Engineer

    3 weeks ago

    Southfield, United States Stefanini North America and APAC Full time

    Position Description:As a Software Engineering Supervisor, you will be responsible for leading and mentoring a team of software engineers, ensuring the successful delivery of high-quality software projects, and contributing to the overall growth and development of the engineering team. You will play a key role in fostering a collaborative and innovative work...

  • Software Engineer

    3 weeks ago

    Southfield, United States Stefanini North America and APAC Full time

    Position Description:As a Software Engineering Supervisor, you will be responsible for leading and mentoring a team of software engineers, ensuring the successful delivery of high-quality software projects, and contributing to the overall growth and development of the engineering team. You will play a key role in fostering a collaborative and innovative work...

  • Big Data Engineer

    3 months ago

    Southfield, United States Global Information Technology Full time

    Job DescriptionJob DescriptionJob Title: Big Data EngineerJob Location: RemoteJob Type: Full TimeJob Requirements:5-7 years of experience and Bachelor's Degree.Experience with Product Development including designing products, developing product roadmaps, translating design requirements, prototyping, etc.Working on integration of data into readily...

  • DevOps Engineer

    2 months ago

    Southfield, United States Stefanini North America and APAC Full time

    We believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we have a wide variety of opportunities for you to accelerate your career potential as you help us define tomorrow's transportation. we create lifetime value for our...

  • DevOps Engineer

    2 months ago

    Southfield, United States Stefanini North America and APAC Full time

    We believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we have a wide variety of opportunities for you to accelerate your career potential as you help us define tomorrow's transportation. we create lifetime value for our...

  • Site Reliability Engineer

    1 week ago

    Southfield, Michigan, United States Stefanini North America and APAC Full time

    At Stefanini North America and APAC, we recognize that the freedom to innovate propels human advancement. We are committed to empowering you to shape and achieve your aspirations. With our ambitious vision for the future of mobility, we offer a diverse range of opportunities for you to enhance your career trajectory as you contribute to the evolution of...

  • Site Reliability Engineer

    1 week ago

    Southfield, Michigan, United States Stefanini North America and APAC Full time

    At Stefanini North America and APAC, we recognize that the ability to move freely is essential for human advancement. We are committed to offering you the autonomy to shape and achieve your aspirations. With our ambitious vision for the future of mobility, we present a diverse range of opportunities for you to enhance your career trajectory as you contribute...

  • Site Reliability Engineer

    1 week ago

    Southfield, Michigan, United States Stefanini North America and APAC Full time

    At Stefanini North America and APAC, we recognize that the ability to move freely is essential for progress. We are committed to empowering you to achieve your aspirations. With our ambitious vision for the future of mobility, we offer a diverse range of opportunities to enhance your career as you contribute to shaping the future of transportation. Our goal...

  • Quality Assurance Engineer

    2 weeks ago

    Southfield, Michigan, United States PHOENIX DATA SYSTEMS INC Full time

    Quality Assurance EngineerJob Title: Quality Assurance EngineerLocation: Remote or Southfield, MIPosition Type: Full-time, SalariedPosition OverviewWe are seeking a dedicated QA Engineer to join our team, focusing on our premier AIMS 3 product, a sophisticated Computerized Maintenance Management System tailored for clinical and facility engineering. Our...

  • UX/UI Engineer

    2 months ago

    Southfield, United States Global Information Technology Full time

    Job DescriptionJob DescriptionJob Title: UX/UI EngineerJob Location: RemoteJob Type: Full TimeJob Description:Design and implement security platform front-end UX/UI solutions in ReactJSCreate well documented and clearly articulated code, process and services documentation.Assess, evaluate and challenge existing Cyber Counter Threat Automation (CTA) UX/UI...

  • Site Reliability Engineer

    1 week ago

    Southfield, Michigan, United States Stefanini North America and APAC Full time

    Overview:At Stefanini North America and APAC, we are committed to enhancing human progress through innovative mobility solutions. We offer a dynamic environment where you can shape your career while contributing to the future of transportation. Our mission is to deliver exceptional value to our clients by creating a software development ecosystem that is...