Cloud Data Engineer

2 weeks ago

Detroit, United States OneMagnify Full time

OneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company's core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify partners with clients to design, implement and manage marketing and brand strategies using analytical and predictive data models that provide valuable customer insights to drive higher levels of sales conversion.

OneMagnify's commitment to employee growth and development extends far beyond typical approaches. We take great pride in fostering an environment where each of our 700+ colleagues can thrive and achieve their personal best. OneMagnify has been recognized as a Top Workplace, Best Workplace and Cool Workplace in the United States for 10 consecutive years and recently was recognized as a Top Workplace in India.

About You:

You are an experienced cloud engineer with sophisticated technical skills and great attention to detail. You enjoy turning data into business solutions. You are a troubleshooter and passionate about what you do. You enjoy building relationships with data product owners and developing a complete understanding of data infrastructure. Does this sound like you? Apply today

  • Resourceful: independently capable of seeking information, corralling resources, data wrangling (query, join, manipulate, automate), and delivering results in challenging situations
  • Collaboration and Teamwork: works with others to deliver results, contributing to the team and prioritizing group needs over individual needs
  • Problem Solving: uses an organized and logical approach to find solutions to complex problems. Looks beyond the obvious to uncover the root cause of problems
  • Open Communication: clearly conveys thoughts, both written and verbally, listening attentively and asking questions for clarification and understanding
  • Comfortable in the Spotlight: able to interact with clients regularly and effectively.
What you'll do:
  • Leverage Google Cloud Platform tools such as BigQuery, Cloud Dataflow, Cloud Dataprep, and Cloud Pub/Sub to deliver top-tier services to our clients' customers and to advance the Data & Analytics Road Map.
  • Perform end-to-end big data ETLs and analytics using SQL, Python and GCP tools to meet critical business needs and craft fault-tolerant, scalable code ready for production.
  • Create and evaluate comprehensive data models, including entity-relationship diagrams and dimensional data models. Utilize GCP's data services to implement ETL processes, business rules, data management, governance, lineage, metadata, and reporting solutions to develop complete data product solutions.
  • Manipulate large data sets using SQL & Python (pySpark/Beam) to understand patterns in the data. Perform data profiling using various tools to learn the shape of the data to help inform data quality checks and/or curation rules that need to be developed.
  • Partner with clients and data scientists in interpreting data and remediating issues when required.
  • Work with data owners and stewards to enforce, maintain, and enhance data governance, quality, security, and privacy standards using GCP's robust security and compliance capabilities, including Cloud IAM and Data Catalog for metadata management.
  • Prepare technical specifications for data ingestion and transformation processes using services like Cloud Dataflow and Cloud Dataprep. Collaborate with data architects to construct efficient data models for data consumption, optimized for performance and cost in Google Cloud.
  • Advocate for the development and adherence to standards and best practices within the Data Engineering team, including the use of documentation templates, agile development methodologies, and GCP's best practices for security, data governance, and efficient cloud resource utilization.
What you'll need:
  • Bachelor's degree in computer science, Engineering, Mathematics, or another relevant discipline.
  • 2+ years of experience in architecting and scaling big data pipelines and analytical solutions on GCP or AWS, utilizing open-source libraries and frameworks such as Apache Spark, Apache Beam, and Apache Flink for data processing.
  • Proficiency in ETL (Extract, Transform, Load) processes across a variety of database technologies including RDBMS (e.g., MS SQL Server, Oracle, MySQL, PostgreSQL), MPP (e.g., Google BigQuery, AWS Redshift, Teradata, Snowflake), and NoSQL databases (e.g., MongoDB, AWS DynamoDB, Cassandra), demonstrating an in-depth understanding of data storage, retrieval, and management practices.
  • Advanced SQL skills for resource optimization and managing extensive datasets in Google BigQuery and Snowflake.
  • Highly skilled in Python (or Scala) for developing petabyte-scale data processing jobs on cloud services like AWS EMR, GCP Dataproc/Dataflow, or on-premise setups, incorporating technologies like Apache Spark and Apache Beam.
  • Experience in creating and managing data orchestration workflows with Apache Airflow to efficiently schedule, monitor, and optimize data processing tasks.
  • Advanced knowledge of data structures and algorithms, networking, operating systems, particularly Unix/Linux, and version control systems.
  • Demonstrated expertise in both batch and real-time data stream processing, proficient in employing technologies such as Apache Kafka for designing and implementing solutions that address real-time data processing requirements.
  • Solid grasp of data warehouse design principles and hands-on experience in deploying data warehousing solutions on GCP/AWS, focusing on performance optimization and scalability.


Benefits

We offer a comprehensive benefits package including medical, dental, 401(k), paid holidays, vacations, and more.

About us

Whether it's awareness, advocacy, engagement, or efficacy, we move brands forward with work that connects with audiences and delivers results. Through meaningful analytics, engaging communications and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.

We are an equal opportunity employer

We believe that Innovative ideas and solutions start with unique perspectives. That's why we're committed to providing every employee a workplace that's free of discrimination and intolerance. We're proud to be an equal opportunity employer and actively search for like-minded people to join our team.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform job functions, and to receive benefits and privileges of employment. Please contact us to request accommodation.

  • Lead Cloud Data Engineer

    2 weeks ago

    Detroit, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: Lead Cloud Data EngineerJob Location: Detroit, MI (Hybrid)Job Duration: Long-TermJob Description:Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.Develop and maintain scalable and efficient data pipelines and...

  • Lead Cloud Data Engineer

    6 days ago

    Detroit, United States ITC Infotech Full time

    ITC Infotech is looking for a Lead Cloud Data Engineer to join the US team. Location: Hybrid – Detroit, MI (Hybrid) Rate - $85000 per annum plus benefits. Your X-Factor Work ethic - You are a consummate professional. Aptitude - You have an innate capacity to transition from project to project without skipping a beat. Communication - You have excellent...

  • Lead Cloud Data Engineer

    6 days ago

    Detroit, United States ITC Infotech Full time

    ITC Infotech is looking for a Lead Cloud Data Engineer to join the US team. Location: Hybrid Detroit, MI (Hybrid) Rate - $85000 per annum plus benefits. Your X-Factor Work ethic - You are a consummate professional. Aptitude - You have an innate capacity to transition from project to project without skipping a beat. Communication - You have excellent written...

  • Lead Cloud Data Engineer

    6 days ago

    Detroit, United States ITC Infotech Full time

    ITC Infotech is looking for a Lead Cloud Data Engineer to join the US team.Location: Hybrid – Detroit, MI (Hybrid) Rate - $85000 per annum plus benefits.Your X-FactorWork ethic - You are a consummate professional.Aptitude - You have an innate capacity to transition from project to project without skipping a beat.Communication - You have excellent written...

  • Lead Cloud Data Engineer

    5 days ago

    Detroit, United States ITC Infotech Full time

    ITC Infotech is looking for a Lead Cloud Data Engineer to join the US team.Location: Hybrid – Detroit, MI (Hybrid) Rate - $85000 per annum plus benefits.Your X-FactorWork ethic - You are a consummate professional.Aptitude - You have an innate capacity to transition from project to project without skipping a beat.Communication - You have excellent written...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Detroit, United States Triunity Software Full time

    Cloud Infrastructure Engineer10+ Years18 MonthsDetroit, Michigan Cloud Engineer Position Responsibilities. Design, deploy, and monitor infrastructure in public clouds (AWS, Azure) using Infrastructure as Code (Terraform)Understanding of Infrastructure as a Service, Infrastructure as Code, and related concepts on public cloud.Experience in the management and...

  • Cloud Engineer

    2 weeks ago

    Detroit, United States A-Line Staffing Solutions Full time

    Title: Join Us as a Senior Cloud Platform Engineer Location: Charlotte, NC or Dwtroit, MI (Hybrid) Rate: 50-60/hr on W-2 (NO C2C) Are you passionate about shaping the future of cloud solutions? We're seeking a talented individual to join our team as a Senior Cloud Platform Engineer. If you're excited about leveraging your skills in Terraform, AWS, GitLab,...

  • Cloud Engineer

    2 weeks ago

    Detroit, United States A-Line Staffing Solutions Full time

    Title: Join Us as a Senior Cloud Platform Engineer! Location: Charlotte, NC or Dwtroit, MI (Hybrid) Rate: 50-60/hr on W-2 (NO C2C) Are you passionate about shaping the future of cloud solutions? We're seeking a talented individual to join our team as a Senior Cloud Platform Engineer. If you're excited about leveraging your skills in Terraform, AWS,...

  • Cloud Engineer

    2 weeks ago

    Detroit, United States A-Line Staffing Solutions Full time

    Title: Join Us as a Senior Cloud Platform Engineer! Location: Charlotte, NC or Dwtroit, MI (Hybrid) Rate: 50-60/hr on W-2 (NO C2C) Are you passionate about shaping the future of cloud solutions? We're seeking a talented individual to join our team as a Senior Cloud Platform Engineer. If you're excited about leveraging your skills in Terraform, AWS,...

  • Senior Data Engineer

    2 weeks ago

    Detroit, United States DCTek Inc. Full time

    Requirement DetailsPosition: Senior Data Engineer Location: Detroit, MI (Hybrid)Duration: Long-Term Description: Experience in developing data architectures including data ingestion, pipeline design, data mining and advanced data processing frameworks.Able to assess business rules, collaborate with stakeholders and perform source-to-target data...

  • Data Analytics Software Engineer

    3 weeks ago

    Detroit, United States Insight Global Full time

    Insight Global is looking for a Data Analytics Software Engineer for a large automotive client based in Metro Detroit, MI. This role demands a candidate adept in crafting complex analytic solutions, utilizing Python and PySpark within an Agile framework. Essential to this position is a solid track record in managing intricate data transformations and a...

  • Data Analytics Software Engineer

    6 days ago

    Detroit, United States Insight Global Full time

    Insight Global is looking for a Data Analytics Software Engineer for a large automotive client based in Metro Detroit, MI. This role demands a candidate adept in crafting complex analytic solutions, utilizing Python and PySpark within an Agile framework. Essential to this position is a solid track record in managing intricate data transformations and a...

  • Data Analytics Software Engineer

    3 weeks ago

    Detroit, United States Insight Global Full time

    Insight Global is looking for a Data Analytics Software Engineer for a large automotive client based in Metro Detroit, MI. This role demands a candidate adept in crafting complex analytic solutions, utilizing Python and PySpark within an Agile framework. Essential to this position is a solid track record in managing intricate data transformations and a...

  • Cloud Engineer

    2 weeks ago

    Detroit, MI, United States A-Line Staffing Solutions Full time

    Title: Join Us as a Senior Cloud Platform Engineer! Location: Charlotte, NC or Dwtroit, MI (Hybrid) Rate: 50-60/hr on W-2 (NO C2C) Are you passionate about shaping the future of cloud solutions? We're seeking a talented individual to join our team as a Senior Cloud Platform Engineer. If you're excited about leveraging your skills in Terraform, AWS,...

  • Cloud Infrastructure Engineer

    7 days ago

    Detroit, United States Excelon Solutions Full time

    Job DescriptionJob DescriptionJob Description: Design, deploy, and monitor infrastructure in public clouds (AWS, Azure) using Infrastructure as Code (Terraform) Understanding of Infrastructure as a Service, Infrastructure as Code, and related concepts on public cloud. Experience in the management and development of Terraform deploying infrastructure and...

  • Cloud Architect

    3 weeks ago

    Detroit, United States Saxon Global Full time

    This is a 18 month contract with Ford Pro. 100% remote. Only EST cadidates on someone closure on MI area. USC/GC. No H1B. Cloud architect will be responsible for helping data lake platform and all applications to migrate to Azure cloud. Good data architecture, data modeling, SQL knowledge is a must with Python programming background. The cloud architect...

  • Manager, Integrated Data Analytics – Data Engineering

    1 month ago

    Detroit, United States Matech Full time

    Manager, Integrated Data Analytics – Data EngineeringJob Summary The Manager, Integrated Data Analytics provides leadership, analysis and design related to the development of data solutions in support or independent of other BI solutions. They collaborate with the agile product management team, project management and/or other leadership for one or more...

  • Manager, Integrated Data Analytics – Data Engineering

    2 months ago

    Detroit, United States Matech Full time

    Manager, Integrated Data Analytics – Data EngineeringJob Summary The Manager, Integrated Data Analytics provides leadership, analysis and design related to the development of data solutions in support or independent of other BI solutions. They collaborate with the agile product management team, project management and/or other leadership for one or more...

  • Manager, Integrated Data Analytics – Data Engineering

    1 month ago

    Detroit, United States Matech Full time

    Manager, Integrated Data Analytics – Data EngineeringJob Summary The Manager, Integrated Data Analytics provides leadership, analysis and design related to the development of data solutions in support or independent of other BI solutions. They collaborate with the agile product management team, project management and/or other leadership for one or more...

  • Cloud Performance Engineer

    3 weeks ago

    Detroit, MI, United States A-Line Staffing Solutions Full time

    Title: Join Us as a Senior Cloud Platform Engineer! Are you passionate about shaping the future of cloud solutions? We're seeking a talented individual to join our team as a Senior Cloud Platform Engineer. If you're excited about leveraging your skills in Terraform, AWS, GitLab, and Python to drive innovation, solve complex problems, and collaborate in a...