Senior Data Engineer

4 weeks ago


Portland, Oregon, United States VDart Full time
Job Title:
Senior Data Engineer

Location:
Remote

Duration:12+ months

Term:
Full Time

Required Skills/Qualifications:
10-15 years of relevant experience
Bachelor's and/or master's degree in computer science or equivalent experience.
Strong communication, analytical and problem-solving skills with a high attention to detail.

Desired Experience:
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.

The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.

Architecture Design Experience for Cloud and Non-cloud platforms
Expertise with various ETL technologies and familiar with ETL tools
Scrum Management experience with medium and large-scale projects
Experience to whiteboard enterprise level architectures
Must have extensive Range of knowledge of cloud/on premise tools and architectures
Experience to implement large scale hybrid cloud platform & applications
Knowledge of one or more scripting language
Experience with CI/CD
Ability to set and lead the technical vision while balancing business drivers
Ability to understand AWS EMR (Elastic MapReduce).

Execute Change Tasks including but not limited to security provisioning schema creation DB role creation DDL execution data restoration etc.

Review workload and provide recommendations for performance optimization and operational efficiency
Proactively adjust capacity based on current utilization and upcoming usage guestimate projections
Document and advise developers and end-users about best practices and housekeeping
Work on incidents / onboarding issues related to Pivoting to Cloud from on-prem datastores.
Be able to identify performance bottlenecks Monitor Azure Synapse Analytics using Dynamic Management Views
Build performing data with Table Distribution and Index types Partition tables using partitioning strategy
Creating and optimizing star schema models in a Dedicated SQL Pool
Experience on Data Migration project from AWS EMR to Databricks.

Key Skills:
Azure, Databricks, Python, Data Engineer

We are seeking a Senior Data Engineer to join our team at VDart. The ideal candidate will have a strong background in cloud data engineering, with experience in designing and implementing scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.

The successful candidate will have a broad knowledge of cloud platforms, including cloud utilities and in-depth knowledge of more than one cloud platform. They will also have expertise in various ETL technologies and familiar with ETL tools, as well as experience with Scrum Management and medium and large-scale projects.

We are looking for a candidate who can set and lead the technical vision while balancing business drivers, and who has the ability to understand AWS EMR (Elastic MapReduce). The ideal candidate will also have experience with CI/CD, and the ability to identify performance bottlenecks and monitor Azure Synapse Analytics using Dynamic Management Views.

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced data engineer looking for a new challenge, please apply today


  • Data Engineer

    3 weeks ago


    Portland, Oregon, United States Acumenz Consulting Full time

    Job Title: Data Engineer - SeniorJob Summary:We are seeking a highly skilled Data Engineer - Senior to join our team at Acumenz Consulting. The ideal candidate will have a strong background in data engineering, with experience in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines to collect,...

  • Senior Data Engineer

    4 weeks ago


    Portland, Oregon, United States IT Vision Group Full time

    Job DescriptionAs a Senior Data Engineer at IT Vision Group, you will be responsible for designing and implementing distributed data processing pipelines using Apache Spark, Apache Hive, and Python. You will work with teams to resolve operational and performance issues, and ensure quality solutions are implemented and engineering best practices are defined...


  • Portland, Oregon, United States Right Systems, Inc Full time

    Job Title: Senior Data Center EngineerRight Systems, Inc. is seeking a highly skilled Senior Data Center Engineer to join our team. As a Senior Data Center Engineer, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments.Key Responsibilities:Build and maintain a deep technical understanding of...

  • Senior Data Engineer

    3 weeks ago


    Portland, Oregon, United States VDart Full time

    Job Title: Senior Data EngineerLocation: RemoteDuration:12+ monthsTerm: Full TimeRequired Skills/Qualifications:10-15 years of relevant experienceBachelor's and/or master's degree in computer science or equivalent experience.Strong communication, analytical and problem-solving skills with a high attention to detail.Desired Experience:Cloud Platforms (broad...


  • Portland, Oregon, United States Equiliem Full time

    Job DescriptionEquiliem seeks a highly skilled Senior Data Engineer to join our team and lead the development of cloud-based data engineering solutions. This role requires a strong background in data engineering, cloud platforms, and experience with data migration tools.Key ResponsibilitiesDesign, implement, and maintain large-scale data engineering...

  • Senior Data Engineer

    4 weeks ago


    Portland, Oregon, United States Acumenz Consulting Full time

    Job Title: Sr Data EngineerAcumenz Consulting is seeking a highly skilled Sr Data Engineer to join our team.Key Responsibilities:Collect, organize, and analyze large datasets from various sources.Develop and implement data analyses, data collection systems, and strategies that optimize statistical efficiency and quality.Interpret data, analyze results using...


  • Portland, Oregon, United States Advance Local Full time

    Job SummaryAdvance Local Media is seeking a highly skilled Senior Software Engineer - Data Solutions to join our team. As a key member of our software development team, you will be responsible for designing and developing full-stack application features using web, cloud computing, and data technologies primarily in the Microsoft stack.Key...

  • Data Engineer I

    3 weeks ago


    Portland, Oregon, United States Unum Group Full time

    About the Role:This position for a Data Engineer will design, build and maintain data systems and pipelines to allow data to be accessed and utilized optimally for analytics or visualization/insight generation purposes.The role requires technical expertise in the fields of computer programming, database management and data architecture; and relies on...


  • Portland, Oregon, United States PacifiCorp Full time

    Wildfire Mitigation ExpertisePacifiCorp is seeking a highly skilled data scientist to provide technical leadership on complex engineering projects related to wildfire mitigation. The successful candidate will facilitate internal training for engineers and technicians, act as the company subject matter expert, and develop presentations for senior...


  • Portland, Oregon, United States Eclypsium Full time

    We are seeking an experienced Database Architect to design, develop, and maintain the underlying database architecture that powers our cybersecurity SaaS platform.The ideal candidate will have a strong technical background in database technologies, data modeling, and performance optimization, as well as a passion for designing elegant and efficient solutions...


  • Portland, Oregon, United States Right Systems, Inc Full time

    Job Title: Senior Data Center Engineer - Microsoft/Cloud SpecialistJob Summary:We are seeking a highly skilled Senior Data Center Engineer - Microsoft/Cloud Specialist to join our team at Right Systems, Inc. As a key member of our team, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments...


  • Portland, Oregon, United States Schrödinger Full time

    Senior Infrastructure EngineerWe're seeking a highly skilled Senior Infrastructure Engineer to join our team at Schrödinger. As a key member of our Information Technology team, you'll play a pivotal role in designing, implementing, and optimizing our IT infrastructure.Key Responsibilities:Lead the design and implementation of scalable, high-availability...

  • Data Engineer

    4 weeks ago


    Portland, Oregon, United States Mainz Brady Group Full time

    Job Title:Data EngineerLocation:Mainz Brady GroupJob Description:Mainz Brady Group is seeking a skilled Data Engineer with expertise in marketing data systems. The ideal candidate will have hands-on experience in cloud applications, preferably AWS, and be proficient in Python and SQL. You will be responsible for building and optimizing APIs for large-scale...


  • Portland, Oregon, United States PacifiCorp Full time

    Senior Data Scientist, Wildfire Mitigation ExpertAt PacifiCorp, we are seeking a highly skilled Senior Data Scientist to lead our wildfire mitigation efforts. As a key member of our Transmission and Distribution Operations team, you will be responsible for developing and implementing data-driven solutions to reduce the risk of wildfires.Key Responsibilities...


  • Portland, Oregon, United States PacifiCorp Full time

    Job SummaryPacifiCorp is seeking a highly skilled Senior Data Scientist to join our Transmission and Distribution Operations team. As a key member of our team, you will provide technical leadership on complex engineering projects related to wildfire mitigation. Your expertise will be essential in developing and implementing data science solutions to support...

  • Senior Cloud Engineer

    4 weeks ago


    Portland, Oregon, United States Providence Health & Service Full time

    Transform Healthcare with UsProvidence Health & Services is seeking a skilled Senior Cloud Engineer to join our Service Integration Engineering team. As a key member of our team, you will play a crucial role in developing and standardizing new platforms, technologies, and services for our Epic Electronic Medical Record Infrastructure and Citrix Virtual...


  • Portland, Oregon, United States Kennedy Jenks Full time

    At Kennedy Jenks, we are seeking an experienced Senior Remediation Engineer to join our thriving Remediation and Compliance group. This role will support both our municipal and private sector clients in environmental investigation and remediation projects.In this position, you will work with a large environmental team consisting of scientists and engineers...


  • Portland, Oregon, United States EVRAZ North America Full time

    At EVRAZ North America, we are seeking a highly skilled and motivated Senior Controls Engineer to join our dynamic team in Portland, Oregon.This role plays a key part in optimizing and automating our manufacturing processes, working closely with operations, quality, and engineering departments to improve safety, quality, and productivity.The successful...

  • Data Engineer

    4 weeks ago


    Portland, Oregon, United States CareOregon Full time

    Job Title: IS Data EngineerCareOregon is seeking a highly skilled IS Data Engineer to play a pivotal role in operationalizing and advancing data and analytics for our business initiatives. As a key member of our Business Intelligence team, you will be responsible for building, managing, and optimizing data pipelines and moving them effectively into...


  • Portland, Oregon, United States Intelletec Energy Full time

    Job Summary:We are seeking a highly skilled Senior Environmental Engineer to join our team at Intelletec Energy. As a key member of our engineering department, you will be responsible for leading complex projects from conception through completion, ensuring adherence to schedules and budgets.Key Responsibilities:Lead engineering projects, overseeing the...