Senior Data Engineer

20 hours ago


Portland, Oregon, United States VDart Full time
Job Title:
Senior Data Engineer

Location:
Remote

Duration:12+ months

Term:
Full Time

Required Skills/Qualifications:
10-15 years of relevant experience
Bachelor's and/or master's degree in computer science or equivalent experience.
Strong communication, analytical and problem-solving skills with a high attention to detail.

Desired Experience:
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.

The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.

Architecture Design Experience for Cloud and Non-cloud platforms
Expertise with various ETL technologies and familiar with ETL tools
Scrum Management experience with medium and large-scale projects
Experience to whiteboard enterprise level architectures
Must have extensive Range of knowledge of cloud/on premise tools and architectures
Experience to implement large scale hybrid cloud platform & applications
Knowledge of one or more scripting language
Experience with CI/CD
Ability to set and lead the technical vision while balancing business drivers
Ability to understand AWS EMR (Elastic MapReduce).

Execute Change Tasks including but not limited to security provisioning schema creation DB role creation DDL execution data restoration etc.

Review workload and provide recommendations for performance optimization and operational efficiency
Proactively adjust capacity based on current utilization and upcoming usage guestimate projections
Document and advise developers and end-users about best practices and housekeeping
Work on incidents / onboarding issues related to Pivoting to Cloud from on-prem datastores.
Be able to identify performance bottlenecks Monitor Azure Synapse Analytics using Dynamic Management Views
Build performing data with Table Distribution and Index types Partition tables using partitioning strategy
Creating and optimizing star schema models in a Dedicated SQL Pool
Experience on Data Migration project from AWS EMR to Databricks.

Key Skills:
Azure, Databricks, Python, Data Engineer

We are seeking a Senior Data Engineer to join our team at VDart. The ideal candidate will have a strong background in cloud data engineering, with experience in designing and implementing scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python.

The successful candidate will have a broad knowledge of cloud platforms, including cloud utilities and in-depth knowledge of more than one cloud platform. They will also have expertise in various ETL technologies and familiar with ETL tools, as well as experience with Scrum Management and medium and large-scale projects.

We are looking for a candidate who can set and lead the technical vision while balancing business drivers, and who has the ability to understand AWS EMR (Elastic MapReduce). The ideal candidate will also have experience with CI/CD, and the ability to identify performance bottlenecks and monitor Azure Synapse Analytics using Dynamic Management Views.

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced data engineer looking for a new challenge, please apply today



  • Portland, Oregon, United States Acumenz Consulting Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Acumenz Consulting. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data architectures and systems to meet business...


  • Portland, Oregon, United States Right Systems, Inc Full time

    Job Title: Senior Data Center EngineerRight Systems, Inc. is seeking a highly skilled Senior Data Center Engineer to join our team. As a Senior Data Center Engineer, you will be responsible for ensuring the deployment, integration, and operational support of our customer environments.Key Responsibilities:Build and maintain a deep technical understanding of...


  • Portland, Oregon, United States Acumenz Consulting Full time

    Job Title: Sr Data EngineerAcumenz Consulting is seeking a highly skilled Sr Data Engineer to join our team.Key Responsibilities:Collect, organize, and analyze large datasets from various sources.Develop and implement data analyses, data collection systems, and strategies that optimize statistical efficiency and quality.Interpret data, analyze results using...

  • Senior Data Engineer

    4 weeks ago


    Portland, Oregon, United States IT Vision Group Full time

    Job DescriptionWe are seeking a highly skilled Sr. Data Engineer to join our team at IT Vision Group.Key Responsibilities:Design and implement data processing pipelines using Apache Spark, Apache Hive, and Python.Create and schedule workflows using Apache Airflow or similar job orchestration tooling.Build utilities, functions, and frameworks to enable...


  • Portland, Oregon, United States T5 Data Centers Full time

    Job Title: Data Center Commissioning EngineerT5 Data Centers is seeking a highly skilled Data Center Commissioning Engineer to join our team. As a Commissioning Engineer, you will be responsible for ensuring that our data centers are designed, built, and operated to the highest standards of quality and reliability.Responsibilities:Review and verify that all...


  • Portland, Oregon, United States Resource Data Full time

    Job OverviewAs a Senior Technical Project Manager at Resource Data, you will play a key role in delivering custom software solutions that drive enterprise systems efficiency, performance, and value. You will work closely with our team of technical consultants to provide solutions to our clients' most challenging enterprise IT problems.Key...


  • Portland, Oregon, United States Resource Data Inc Full time

    Senior Technical Project ManagerAs a Senior Technical Project Manager at Resource Data Inc, you will play a key role in delivering custom software solutions that elevate enterprise systems efficiency, performance, and value. You will work closely with our team of technical consultants to provide solutions to our clients' most challenging enterprise IT...


  • Portland, Oregon, United States Structural Integrity Associates, Inc. Full time

    Job Title: Senior Research EngineerWe are seeking a highly skilled Senior Research Engineer to join our team at Structural Integrity Associates, Inc. in Portland, OR.About the RoleAs a Senior Research Engineer, you will be responsible for designing, developing, and implementing advanced control systems for various industries, including semiconductor...


  • Portland, Oregon, United States Slalom Full time

    About the RoleWe are seeking a seasoned professional to lead our data and analytics practice in Portland. As a senior principal, you will be responsible for developing and executing strategies to drive business growth and deliver value to our clients.Key ResponsibilitiesDevelop and lead proposals, presentations, and statements of work to identify...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...


  • Portland, Oregon, United States Eclypsium Full time

    We are seeking an experienced Database Architect to design, develop, and maintain the underlying database architecture that powers our cybersecurity SaaS platform.The ideal candidate will have a strong technical background in database technologies, data modeling, and performance optimization, as well as a passion for designing elegant and efficient solutions...


  • Portland, Oregon, United States Structural Integrity Associates Full time

    Job Title: Senior Research EngineerSC Solutions, Inc. is seeking a highly skilled Senior Research Engineer to join our Control Engineering team in Portland, OR. As a member of our team, you will be responsible for designing and implementing advanced control systems for various industries, including semiconductor manufacturing, aerospace, and energy.Key...

  • Data Engineer

    3 weeks ago


    Portland, Oregon, United States Unum Group Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unum Group. As a Data Engineer, you will design, build, and maintain data systems and pipelines to enable data-driven decision making across the organization.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data from various...


  • Portland, Oregon, United States Structural Integrity Associates Full time

    Job Title: Senior Research EngineerWe are seeking a highly skilled Senior Research Engineer to join our Control Engineering team at SC Solutions, Inc., an affiliate company of Structural Integrity Associates, Inc.As a Senior Research Engineer, you will be responsible for designing, developing, and implementing advanced control systems for various industries,...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Data Solutions Engineering ManagerCanonical is seeking a highly skilled Data Solutions Engineering Manager to lead our team of engineers in building scalable data solutions for Kubernetes and cloud machines. As a key member of our data platform team, you will be responsible for leading a team of engineers in designing, developing, and deploying...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers in building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platforms team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...


  • Portland, Oregon, United States Canonical - Jobs Full time

    Job Title: Engineering Manager for Data PlatformsCanonical is seeking an experienced Engineering Manager to lead our data platform team. As a key member of our engineering leadership team, you will be responsible for leading a team of engineers focused on building scalable data solutions for Kubernetes and cloud machines.Key Responsibilities:Lead a team of...