Senior Data Engineer
20 hours ago
Senior Data Engineer
Location:
Remote
Duration:12+ months
Term:
Full Time
Required Skills/Qualifications:
10-15 years of relevant experience
Bachelor's and/or master's degree in computer science or equivalent experience.
Strong communication, analytical and problem-solving skills with a high attention to detail.
Desired Experience:
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.
The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Architecture Design Experience for Cloud and Non-cloud platformsExpertise with various ETL technologies and familiar with ETL tools
Scrum Management experience with medium and large-scale projects
Experience to whiteboard enterprise level architectures
Must have extensive Range of knowledge of cloud/on premise tools and architectures
Experience to implement large scale hybrid cloud platform & applications
Knowledge of one or more scripting language
Experience with CI/CD
Ability to set and lead the technical vision while balancing business drivers
Ability to understand AWS EMR (Elastic MapReduce).
Execute Change Tasks including but not limited to security provisioning schema creation DB role creation DDL execution data restoration etc.
Review workload and provide recommendations for performance optimization and operational efficiencyProactively adjust capacity based on current utilization and upcoming usage guestimate projections
Document and advise developers and end-users about best practices and housekeeping
Work on incidents / onboarding issues related to Pivoting to Cloud from on-prem datastores.
Be able to identify performance bottlenecks Monitor Azure Synapse Analytics using Dynamic Management Views
Build performing data with Table Distribution and Index types Partition tables using partitioning strategy
Creating and optimizing star schema models in a Dedicated SQL Pool
Experience on Data Migration project from AWS EMR to Databricks.
Key Skills:
Azure, Databricks, Python, Data Engineer
We are seeking a Senior Data Engineer to join our team at VDart. The ideal candidate will have a strong background in cloud data engineering, with experience in designing and implementing scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.
The successful candidate will have a broad knowledge of cloud platforms, including cloud utilities and in-depth knowledge of more than one cloud platform. They will also have expertise in various ETL technologies and familiar with ETL tools, as well as experience with Scrum Management and medium and large-scale projects.
We are looking for a candidate who can set and lead the technical vision while balancing business drivers, and who has the ability to understand AWS EMR (Elastic MapReduce). The ideal candidate will also have experience with CI/CD, and the ability to identify performance bottlenecks and monitor Azure Synapse Analytics using Dynamic Management Views.
We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced data engineer looking for a new challenge, please apply today
-
Senior Data Engineer
7 days ago
Portland, Oregon, United States Acumenz Consulting Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Acumenz Consulting. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data architectures and systems to meet business...
-
Senior Data Center Engineer
14 hours ago
Portland, Oregon, United States Right Systems, Inc Full timeJob Title: Senior Data Center EngineerRight Systems, Inc. is seeking a highly skilled Senior Data Center Engineer to join our team. As a Senior Data Center Engineer, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments.Key Responsibilities:Build and maintain a deep technical understanding of...
-
Senior Data Engineer
4 days ago
Portland, Oregon, United States Acumenz Consulting Full timeJob Title: Sr Data EngineerAcumenz Consulting is seeking a highly skilled Sr Data Engineer to join our team.Key Responsibilities:Collect, organize, and analyze large datasets from various sources.Develop and implement data analyses, data collection systems, and strategies that optimize statistical efficiency and quality.Interpret data, analyze results using...
-
Senior Data Engineer
4 weeks ago
Portland, Oregon, United States IT Vision Group Full timeJob DescriptionWe are seeking a highly skilled Sr. Data Engineer to join our team at IT Vision Group.Key Responsibilities:Design and implement data processing pipelines using Apache Spark, Apache Hive, and Python.Create and schedule workflows using Apache Airflow or similar job orchestration tooling.Build utilities, functions, and frameworks to enable...
-
Data Center Commissioning Specialist
5 days ago
Portland, Oregon, United States T5 Data Centers Full timeJob Title: Data Center Commissioning EngineerT5 Data Centers is seeking a highly skilled Data Center Commissioning Engineer to join our team. As a Commissioning Engineer, you will be responsible for ensuring that our data centers are designed, built, and operated to the highest standards of quality and reliability.Responsibilities:Review and verify that all...
-
Senior Technical Project Manager
4 weeks ago
Portland, Oregon, United States Resource Data Full timeJob OverviewAs a Senior Technical Project Manager at Resource Data, you will play a key role in delivering custom software solutions that drive enterprise systems efficiency, performance, and value. You will work closely with our team of technical consultants to provide solutions to our clients' most challenging enterprise IT problems.Key...
-
Senior Technical Project Manager
3 weeks ago
Portland, Oregon, United States Resource Data Inc Full timeSenior Technical Project ManagerAs a Senior Technical Project Manager at Resource Data Inc, you will play a key role in delivering custom software solutions that elevate enterprise systems efficiency, performance, and value. You will work closely with our team of technical consultants to provide solutions to our clients' most challenging enterprise IT...
-
Senior Research Engineer
3 weeks ago
Portland, Oregon, United States Structural Integrity Associates, Inc. Full timeJob Title: Senior Research EngineerWe are seeking a highly skilled Senior Research Engineer to join our team at Structural Integrity Associates, Inc. in Portland, OR.About the RoleAs a Senior Research Engineer, you will be responsible for designing, developing, and implementing advanced control systems for various industries, including semiconductor...
-
Senior Principal Data and Analytics Leader
4 weeks ago
Portland, Oregon, United States Slalom Full timeAbout the RoleWe are seeking a seasoned professional to lead our data and analytics practice in Portland. As a senior principal, you will be responsible for developing and executing strategies to drive business growth and deliver value to our clients.Key ResponsibilitiesDevelop and lead proposals, presentations, and statements of work to identify...
-
Data Solutions Engineering Manager
3 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...
-
Data Solutions Engineering Manager
4 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...
-
Data Solutions Engineering Manager
4 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...
-
Senior Data Engineer, Data Quality Specialist
12 hours ago
Portland, Oregon, United States Eclypsium Full timeWe are seeking an experienced Database Architect to design, develop, and maintain the underlying database architecture that powers our cybersecurity SaaS platform.The ideal candidate will have a strong technical background in database technologies, data modeling, and performance optimization, as well as a passion for designing elegant and efficient solutions...
-
Senior Research Engineer
4 days ago
Portland, Oregon, United States Structural Integrity Associates Full timeJob Title: Senior Research EngineerSC Solutions, Inc. is seeking a highly skilled Senior Research Engineer to join our Control Engineering team in Portland, OR. As a member of our team, you will be responsible for designing and implementing advanced control systems for various industries, including semiconductor manufacturing, aerospace, and energy.Key...
-
Data Engineer
3 weeks ago
Portland, Oregon, United States Unum Group Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unum Group. As a Data Engineer, you will design, build, and maintain data systems and pipelines to enable data-driven decision making across the organization.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data from various...
-
Senior Research Engineer
4 weeks ago
Portland, Oregon, United States Structural Integrity Associates Full timeJob Title: Senior Research EngineerWe are seeking a highly skilled Senior Research Engineer to join our Control Engineering team at SC Solutions, Inc., an affiliate company of Structural Integrity Associates, Inc.As a Senior Research Engineer, you will be responsible for designing, developing, and implementing advanced control systems for various industries,...
-
Data Solutions Engineering Manager
3 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Data Solutions Engineering ManagerCanonical is seeking a highly skilled Data Solutions Engineering Manager to lead our team of engineers in building scalable data solutions for Kubernetes and cloud machines. As a key member of our data platform team, you will be responsible for leading a team of engineers in designing, developing, and deploying...
-
Data Solutions Engineering Manager
4 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers in building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...
-
Data Solutions Engineering Manager
3 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...
-
Data Solutions Engineering Manager
4 weeks ago
Portland, Oregon, United States Canonical - Jobs Full timeJob Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...