Senior Data Engineer
6 days ago
6 mo C2H
100% remote
Industry - digital marketing
The Senior Data Engineer is a technologist passionate about data in all forms - whether stored within a relational database, a data warehouse, a data lake, a Lakehouse or in-transit in ETL pipelines. They independently produce capable data structures and performant queries.
As a Senior Data Engineer, you will architect and implement data solutions from scratch to extract and land data from various sources that will deliver insights, visualizations, or better predictions for our clients. You will support our software development teams, data analysts, and data scientists using market-relevant products and services.
Responsibilities/Duties
- Using complex SQL knowledge and experience, will work with relational databases, Big Query, query authoring (SQL), and working familiarity with various databases.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other critical business performance metrics.
- Design and implement scalable and reliable data pipelines on GCP.
- Implement Change Data Capture (CDC) techniques and manage Delta Live Tables for real-time data integration and analytics, ensuring data consistency and enabling incremental data updates in cloud-based data platforms.
- Design, configure, and manage Data Lakes in GCP, utilizing services like Google Cloud Storage, BigQuery, and Dataproc, to support diverse data types and formats for scalable storage, processing, and analytics.
- API architecture design, including RESTful services and microservices, integrating Machine Learning models into production systems to enhance data-driven applications and services.
- Build the infrastructure, using IaC, required for extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL and GCP
- Migrate and create data pipelines and infrastructure from AWS or Azure to GCP.
- Write and maintain robust, efficient, scalable Python scripts for data processing and automation.
- Use a strong understanding of data pipeline design patterns, and determine the best for the use case.
- Work with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Manipulate, process, and extract value from large, disconnected datasets.
- Work with stakeholders, including the Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
- Assume responsibility for the stability of the data in transit and at rest
- Collaborate directly with the client to identify and implement data security and compliance requirements. Keep client data secure using best practices.
- Foster cross-functional collaboration as a technical liaison between engineering and other project disciplines (Design, Quality, Project Management, Strategy, Product, etc.)
Skills and Qualifications
- Bachelors in Computer Science or related field or equivalent experience required
- 6+ years of relevant experience
- In-depth knowledge of Google Cloud Platform (GCP) data services such as BigQuery, Dataflow, Dataproc, and Pub/Sub, with proven experience in designing and implementing data pipelines, data storage, and analytics solutions in GCP.
- Ability to take technical requirements and produce functional code
- Experience with Git and specified technologies.
- Proficiency in Python and SQL.
- Experience with migrating data pipelines and infrastructure to GCP from multiple infrastructure stacks.
- Deep understanding of data modeling, ETL processes, and data warehousing principles.
- Familiarity with data pipeline orchestration tools and practices, such as Pub/Sub, Streaming, and Cloud Functions.
- Excellent problem-solving and analytical skills.
- Ability to communicate with technical and non-technical client stakeholders
- Proactive collaborator works with colleagues to improve their technical aptitude
- Experience using and/or creating APIs
- Experience with any of the following additional database management systems: MS SQL Server, MongoDB, PostgreSQL, NoSQL (e.g. Cassandra), Sybase, IBM Db2, or Oracle Database
-
Senior Data Analyst
2 days ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Data Analyst - Meta RL Candidate must be located in NY and be able to be in the office (at 380 W 33rd St, New York, NY) at least one day/week. Duration 6-12 months, will extend About the Role (Meta-specific): We are seeking a highly motivated and experienced Senior Data/Business Analyst to join our Meta Reality Labs team. In this role, you will...
-
Senior Data Analyst
2 days ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Data Analyst - Meta RL Candidate must be located in NY and be able to be in the office (at 380 W 33rd St, New York, NY) at least one day/week. Duration 6-12 months, will extend About the Role (Meta-specific): We are seeking a highly motivated and experienced Senior Data/Business Analyst to join our Meta Reality Labs team. In this role, you will...
-
Senior Data Analyst
6 days ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Data Analyst - Meta RL Candidate must be located in NY and be able to be in the office (at 380 W 33rd St, New York, NY) at least one day/week. Duration 6-12 months, will extend About the Role (Meta-specific): We are seeking a highly motivated and experienced Senior Data/Business Analyst to join our Meta Reality Labs team. In this role, you will...
-
Senior Cloud Engineer
2 weeks ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Cloud Engineer (GCP) Location: 100% Remote 6-month contract to hire This Senior Cloud Engineer role is responsible for managing and implementing Google Cloud technology for our customers. This role will design, develop, and manage robust, secure, scalable, highly available, and dynamic cloud solutions to drive business objectives. This role will...
-
Senior Cloud Engineer
10 hours ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Cloud Engineer (GCP) Location: 100% Remote 6-month contract to hire This Senior Cloud Engineer role is responsible for managing and implementing Google Cloud technology for our customers. This role will design, develop, and manage robust, secure, scalable, highly available, and dynamic cloud solutions to drive business objectives. This role will...
-
Senior Cloud Engineer
7 days ago
Peoria, AZ, United States RIT Solutions, Inc. Full timeSenior Cloud Engineer (GCP) Location: 100% Remote 6-month contract to hire This Senior Cloud Engineer role is responsible for managing and implementing Google Cloud technology for our customers. This role will design, develop, and manage robust, secure, scalable, highly available, and dynamic cloud solutions to drive business objectives. This role will...
-
Peoria, AZ, United States Zurich Insurance Company Ltd Full timeZurich is currently looking for a Senior Risk Engineering Consultant with extensive experience in power plant operations to join the Global Energy - Power Generation team. This is a work from home role ideally within Western U.S. (Will consider any other locations within the U.S. as well) This role will include expected travel up to 50% to service accounts...
-
Peoria, AZ, United States Zurich Insurance Company Ltd Full timeZurich is currently looking for a Senior Risk Engineering Consultant with extensive experience in power plant operations to join the Global Energy - Power Generation team. This is a work from home role ideally within Western U.S. (Will consider any other locations within the U.S. as well) This role will include expected travel up to 50% to service accounts...
-
Peoria, AZ, United States Zurich Insurance Company Ltd Full timeZurich is currently looking for a Senior Risk Engineering Consultant with extensive experience in power plant operations to join the Global Energy - Power Generation team. This is a work from home role ideally within Western U.S. (Will consider any other locations within the U.S. as well) This role will include expected travel up to 50% to service accounts...
-
Peoria, AZ, United States Speechify Full timeSenior Software Engineer, Windows/Desktop Applications - Peoria, USA 2 days ago Be among the first 25 applicants Mission The mission of Speechify is to make sure that reading is never a barrier to learning. Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading PDFs, books, Google Docs, news articles, websites into...
