Senior Data Engineer
4 weeks ago
Senior Data Engineer
Location:
Remote
Duration:12+ months
Term:
Full Time
Required Skills/Qualifications:
10-15 years of relevant experience
Bachelor's and/or master's degree in computer science or equivalent experience.
Strong communication, analytical and problem-solving skills with a high attention to detail.
Desired Experience:
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.
The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Architecture Design Experience for Cloud and Non-cloud platformsExpertise with various ETL technologies and familiar with ETL tools
Scrum Management experience with medium and large-scale projects
Experience to whiteboard enterprise level architectures
Must have extensive Range of knowledge of cloud/on premise tools and architectures
Experience to implement large scale hybrid cloud platform & applications
Knowledge of one or more scripting language
Experience with CI/CD
Ability to set and lead the technical vision while balancing business drivers
Ability to understand AWS EMR (Elastic MapReduce).
Execute Change Tasks including but not limited to security provisioning schema creation DB role creation DDL execution data restoration etc.
Review workload and provide recommendations for performance optimization and operational efficiencyProactively adjust capacity based on current utilization and upcoming usage guestimate projections
Document and advise developers and end-users about best practices and housekeeping
Work on incidents / onboarding issues related to Pivoting to Cloud from on-prem datastores.
Be able to identify performance bottlenecks Monitor Azure Synapse Analytics using Dynamic Management Views
Build performing data with Table Distribution and Index types Partition tables using partitioning strategy
Creating and optimizing star schema models in a Dedicated SQL Pool
Experience on Data Migration project from AWS EMR to Databricks.
Key Skills:
Azure, Databricks, Python, Data Engineer
We are seeking a Senior Data Engineer to join our team at VDart. The ideal candidate will have a strong background in cloud data engineering, with experience in designing and implementing scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.
The successful candidate will have a broad knowledge of cloud platforms, including cloud utilities and in-depth knowledge of more than one cloud platform. They will also have expertise in various ETL technologies and familiar with ETL tools, as well as experience with Scrum Management and medium and large-scale projects.
We are looking for a candidate who can set and lead the technical vision while balancing business drivers, and who has the ability to understand AWS EMR (Elastic MapReduce). The ideal candidate will also have experience with CI/CD, and the ability to identify performance bottlenecks and monitor Azure Synapse Analytics using Dynamic Management Views.
We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced data engineer looking for a new challenge, please apply today
-
Data Engineer
3 weeks ago
Portland, Oregon, United States Acumenz Consulting Full timeJob Title: Data Engineer - SeniorJob Summary:We are seeking a highly skilled Data Engineer - Senior to join our team at Acumenz Consulting. The ideal candidate will have a strong background in data engineering, with experience in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines to collect,...
-
Senior Data Engineer
4 weeks ago
Portland, Oregon, United States IT Vision Group Full timeJob DescriptionAs a Senior Data Engineer at IT Vision Group, you will be responsible for designing and implementing distributed data processing pipelines using Apache Spark, Apache Hive, and Python. You will work with teams to resolve operational and performance issues, and ensure quality solutions are implemented and engineering best practices are defined...
-
Senior Data Center Engineer
4 weeks ago
Portland, Oregon, United States Right Systems, Inc Full timeJob Title: Senior Data Center EngineerRight Systems, Inc. is seeking a highly skilled Senior Data Center Engineer to join our team. As a Senior Data Center Engineer, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments.Key Responsibilities:Build and maintain a deep technical understanding of...
-
Senior Data Engineer
3 weeks ago
Portland, Oregon, United States VDart Full timeJob Title: Senior Data EngineerLocation: RemoteDuration:12+ monthsTerm: Full TimeRequired Skills/Qualifications:10-15 years of relevant experienceBachelor's and/or master's degree in computer science or equivalent experience.Strong communication, analytical and problem-solving skills with a high attention to detail.Desired Experience:Cloud Platforms (broad...
-
Senior Data Engineer for Cloud Platforms
3 weeks ago
Portland, Oregon, United States Equiliem Full timeJob DescriptionEquiliem seeks a highly skilled Senior Data Engineer to join our team and lead the development of cloud-based data engineering solutions. This role requires a strong background in data engineering, cloud platforms, and experience with data migration tools.Key ResponsibilitiesDesign, implement, and maintain large-scale data engineering...
-
Senior Data Engineer
4 weeks ago
Portland, Oregon, United States Acumenz Consulting Full timeJob Title: Sr Data EngineerAcumenz Consulting is seeking a highly skilled Sr Data Engineer to join our team.Key Responsibilities:Collect, organize, and analyze large datasets from various sources.Develop and implement data analyses, data collection systems, and strategies that optimize statistical efficiency and quality.Interpret data, analyze results using...
-
Senior Software Engineer
3 weeks ago
Portland, Oregon, United States Advance Local Full timeJob SummaryAdvance Local Media is seeking a highly skilled Senior Software Engineer - Data Solutions to join our team. As a key member of our software development team, you will be responsible for designing and developing full-stack application features using web, cloud computing, and data technologies primarily in the Microsoft stack.Key...
-
Data Engineer I
3 weeks ago
Portland, Oregon, United States Unum Group Full timeAbout the Role:This position for a Data Engineer will design, build and maintain data systems and pipelines to allow data to be accessed and utilized optimally for analytics or visualization/insight generation purposes.The role requires technical expertise in the fields of computer programming, database management and data architecture; and relies on...
-
Senior Data Scientist for Wildfire Mitigation
2 weeks ago
Portland, Oregon, United States PacifiCorp Full timeWildfire Mitigation ExpertisePacifiCorp is seeking a highly skilled data scientist to provide technical leadership on complex engineering projects related to wildfire mitigation. The successful candidate will facilitate internal training for engineers and technicians, act as the company subject matter expert, and develop presentations for senior...
-
Senior Data Engineer, Data Quality Specialist
4 weeks ago
Portland, Oregon, United States Eclypsium Full timeWe are seeking an experienced Database Architect to design, develop, and maintain the underlying database architecture that powers our cybersecurity SaaS platform.The ideal candidate will have a strong technical background in database technologies, data modeling, and performance optimization, as well as a passion for designing elegant and efficient solutions...
-
Senior Data Center Engineer
3 weeks ago
Portland, Oregon, United States Right Systems, Inc Full timeJob Title: Senior Data Center Engineer - Microsoft/Cloud SpecialistJob Summary:We are seeking a highly skilled Senior Data Center Engineer - Microsoft/Cloud Specialist to join our team at Right Systems, Inc. As a key member of our team, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments...
-
Senior Infrastructure Engineer
4 weeks ago
Portland, Oregon, United States Schrödinger Full timeSenior Infrastructure EngineerWe're seeking a highly skilled Senior Infrastructure Engineer to join our team at Schrödinger. As a key member of our Information Technology team, you'll play a pivotal role in designing, implementing, and optimizing our IT infrastructure.Key Responsibilities:Lead the design and implementation of scalable, high-availability...
-
Data Engineer
4 weeks ago
Portland, Oregon, United States Mainz Brady Group Full timeJob Title:Data EngineerLocation:Mainz Brady GroupJob Description:Mainz Brady Group is seeking a skilled Data Engineer with expertise in marketing data systems. The ideal candidate will have hands-on experience in cloud applications, preferably AWS, and be proficient in Python and SQL. You will be responsible for building and optimizing APIs for large-scale...
-
Portland, Oregon, United States PacifiCorp Full timeSenior Data Scientist, Wildfire Mitigation ExpertAt PacifiCorp, we are seeking a highly skilled Senior Data Scientist to lead our wildfire mitigation efforts. As a key member of our Transmission and Distribution Operations team, you will be responsible for developing and implementing data-driven solutions to reduce the risk of wildfires.Key Responsibilities...
-
Portland, Oregon, United States PacifiCorp Full timeJob SummaryPacifiCorp is seeking a highly skilled Senior Data Scientist to join our Transmission and Distribution Operations team. As a key member of our team, you will provide technical leadership on complex engineering projects related to wildfire mitigation. Your expertise will be essential in developing and implementing data science solutions to support...
-
Senior Cloud Engineer
4 weeks ago
Portland, Oregon, United States Providence Health & Service Full timeTransform Healthcare with UsProvidence Health & Services is seeking a skilled Senior Cloud Engineer to join our Service Integration Engineering team. As a key member of our team, you will play a crucial role in developing and standardizing new platforms, technologies, and services for our Epic Electronic Medical Record Infrastructure and Citrix Virtual...
-
Senior Remediation Engineer
3 weeks ago
Portland, Oregon, United States Kennedy Jenks Full timeAt Kennedy Jenks, we are seeking an experienced Senior Remediation Engineer to join our thriving Remediation and Compliance group. This role will support both our municipal and private sector clients in environmental investigation and remediation projects.In this position, you will work with a large environmental team consisting of scientists and engineers...
-
Senior Controls Engineer
3 weeks ago
Portland, Oregon, United States EVRAZ North America Full timeAt EVRAZ North America, we are seeking a highly skilled and motivated Senior Controls Engineer to join our dynamic team in Portland, Oregon.This role plays a key part in optimizing and automating our manufacturing processes, working closely with operations, quality, and engineering departments to improve safety, quality, and productivity.The successful...
-
Data Engineer
4 weeks ago
Portland, Oregon, United States CareOregon Full timeJob Title: IS Data EngineerCareOregon is seeking a highly skilled IS Data Engineer to play a pivotal role in operationalizing and advancing data and analytics for our business initiatives. As a key member of our Business Intelligence team, you will be responsible for building, managing, and optimizing data pipelines and moving them effectively into...
-
Senior Environmental Engineer
4 weeks ago
Portland, Oregon, United States Intelletec Energy Full timeJob Summary:We are seeking a highly skilled Senior Environmental Engineer to join our team at Intelletec Energy. As a key member of our engineering department, you will be responsible for leading complex projects from conception through completion, ensuring adherence to schedules and budgets.Key Responsibilities:Lead engineering projects, overseeing the...