Data Engineer 3

1 month ago

Portland, United States PacifiCorp Full time
General Purpose

Data engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data scientists and are largely in charge of architecting solutions for data scientists that enable them to do their jobs.

Data engineers generally have a bachelor's degree in computer science, information technology, or applied math, as well as a few data engineering certifications like Azure Certified Data Engineer. In addition, data engineers possess a plethora of technical skills and the ability to approach problems in a creative manner.

Working with significant independence and under general direction, position is responsible for the data management and design, implementation, maintenance and monitoring of database technologies and related software. Provides direct support to application and analytics teams. Conducts analysis, creates system specifications, develops, tests and implements engineering, scientific and business applications, operating systems, and file/database servers. Utilizes existing or new technology in the automation of processes. Evaluates software packages and provides recommendations to management. Provides actionable recommendations for improvements in application performance after analyzing underlying database-related infrastructure components. Write and maintain comprehensive documentation, including database dependencies, database inventory, basic database troubleshooting, and daily database operations documents. Recommends and implements improvements of client accessibility to corporate information.

Responsibilities of this position include the following:

  • Designs, codes, tests, documents, implements and maintains data lake utilities. 
  • Supports vendor-developed database implementation and periodic maintenance releases as required. 
  • Provides technical input to assist in development of project planning. 
  • Maintains data lake software at appropriate vendor-supported levels.
  • Supports data management, movement, security, and performance. 
  • Implements data pipelines within Azure Data Factory.
  • Participate in on-call rotation, including after hour and weekend support.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Python.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Experience building and optimizing big data' data pipelines, architectures and data sets.
  • Performs additional responsibilities as requested or assigned.

Requirements for this position include the following:

  • Bachelor's degree in computer science, information technology or related field; or equivalent work experience. (Typically four years of additional related, progressive work experience would be needed for candidates applying for this position who do not possess a bachelor's degree.)
  • 5+ years of experience in one of the following or any combination of: ADLS, Python, Hadoop, SQL, Databricks, Oracle Fusion Middleware, Azure DevOps, GitHub, ML Studio, Oracle Cloud Infrastructure
  • Demonstrated knowledge of backup and recovery, disaster recovery, high availability, security, infrastructure, performance tuning, lifecycle, data management and data movement.
  • Effective oral and written communication skills fostering an atmosphere of teamwork, high productivity and accuracy.
  • Consistently delivers requirements and meets timelines.
  • Advanced analytical and problem-solving skills.
  •  Ability to prioritize and handle multiple tasks and projects concurrently.

Additional Information

Req Id: 111946 

Read the full posting.

  • Data Engineer 3

    1 month ago

    Portland, Oregon, United States PacifiCorp Full time

    General PurposeData engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data scientists and are largely in charge of architecting solutions for data scientists that enable them to do their...

  • Data Engineer

    1 week ago

    Portland, United States VanderHouwen Full time

    JOB ID# 65072Data EngineerAs a Data Engineer, you will design, implement, and maintain data pipelines and infrastructure on the Azure cloud platform, utilizing Fabric technology. Your primary focus will be collecting, processing, and analyzing large datasets to support our data-driven decision-making processes.This position is onsite in Portlanld, OR. Data...

  • Data Engineer

    1 week ago

    Portland, United States VanderHouwen Full time

    JOB ID# 65072Data EngineerAs a Data Engineer, you will design, implement, and maintain data pipelines and infrastructure on the Azure cloud platform, utilizing Fabric technology. Your primary focus will be collecting, processing, and analyzing large datasets to support our data-driven decision-making processes.This position is onsite in Portlanld, OR. Data...

  • Data Engineer

    1 hour ago

    Portland, United States VanderHouwen Full time

    JOB ID# 65072 Data Engineer As a Data Engineer, you will design, implement, and maintain data pipelines and infrastructure on the Azure cloud platform, utilizing Fabric technology. Your primary focus will be collecting, processing, and analyzing large datasets to support our data-driven decision-making processes. This position is onsite in Portlanld, OR. ...

  • Data Engineer

    4 weeks ago

    Portland, United States NerdPine Full time

    Job DescriptionJob DescriptionNerdPine, a leading marketing and advertising company, is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow and accessibility of data for various marketing and advertising...

  • Cloud Data Engineer

    2 weeks ago

    Portland, United States Arkatechture Full time

    Cloud Data Engineer - HealthcareDepartment: Professional ServicesEmployment Type: Full TimeLocation: Portland, ME, USADescriptionWhy Work Here?At Arkatechture, we have a simple shared mission: to build a sustainable organization built upon three pillars: Do something meaningful, With a great team, Earning what you deserve.We started in 2012 with a passion...

  • Data Engineer

    4 weeks ago

    Portland, Oregon, United States NerdPine Full time

    NerdPine, a leading marketing and advertising company, is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow and accessibility of data for various marketing and advertising purposes. You will have the...

  • Sr. Data Engineer

    4 weeks ago

    Portland, United States IT Vision Group Full time

    Job DescriptionJob DescriptionTitle : Sr. Data EngineerLocation: OregonDuration: 12 Months+    Roles & ResponsibilitiesPerform data analysis according to business needsTranslate functional business requirements into high-level and low-level technical designsDesign and implement distributed data processing pipelines using Apache Spark, Apache Hive,...

  • Silicon Validation Engineer 3

    3 weeks ago

    Portland, United States Winmax Systems Full time

    Title:Silicon Validation Engineer 3Location: Portland, OR (onsite)Contract: 9+ MonthJob Description: Top 3 Hard Skills Required + Years of Experience 1. Minimum 3 years experience withComputer architecture knowledge 2. Minimum 3_ years experience with _ Silicon Validation/ verification/ testing 3. Minimum _3 years experience withBasic scripting knowledge,...

  • Silicon Validation Engineer 3

    4 weeks ago

    Portland, United States CareerBuilder Full time

    Title:Silicon Validation Engineer 3 Location: Portland, OR (onsite) Contract: 9+ Month Job Description: Top 3 Hard Skills Required + Years of Experience 1. Minimum 3 years experience withComputer architecture knowledge 2. Minimum 3_ years experience with _ Silicon Validation/ verification/ testing 3. Minimum _3 years experience withBasic scripting knowledge,...

  • Lead Data Engineer

    1 week ago

    Portland, United States AppLab Systems, Inc Full time

    Title – Lead Data EngineerLocation – Portland, OR (day 1 Onsite) Job Description – Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySparkExperience in writing code which is optimized for performanceAirflow workflow scheduling tool for creating data pipelinesGitHub source...

  • Lead Data Engineer

    1 week ago

    Portland, United States AppLab Systems, Inc Full time

    Title – Lead Data EngineerLocation – Portland, OR (day 1 Onsite) Job Description – Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySparkExperience in writing code which is optimized for performanceAirflow workflow scheduling tool for creating data pipelinesGitHub source...

  • Lead Data Engineer

    36 minutes ago

    Portland, United States AppLab Systems Inc Full time

    Title - Lead Data Engineer Location - Portland, OR (day 1 Onsite) Job Description - Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark Experience in writing code which is optimized for performance Airflow workflow scheduling tool for creating data pipelines GitHub source...

  • Research Engineer 3

    3 days ago

    Portland, United States Oregon Health & Science University Full time

    This is a temporary position with a project end date of: 09/15/2024. CEDAR is currently looking for a Research Engineer with experience and expertise in the areas of:Bio/polymer chemistry. Bio/conjugation chemistry. Proteomics/protein sequencing. As Research Engineer, Engineer, Research, Chemistry, Technology, Healthcare

  • Quality Assurance Engineer Level 2

    1 month ago

    Portland, United States WEX, Inc. Full time

    About the Team WEX is the global commerce platform that simplifies the business of running a business by offering seamlessly embedded, personalized solutions for our customers; automating highly manual processes and reconciliations; and connecting disjointed payments and data exchange through personalized technology solutions and resources. Our applications...

  • Data Manager

    6 days ago

    Portland, United States Powin Corporation Full time

    We're Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete...

  • Traffic Engineer

    7 days ago

    Portland, United States Career Collective Full time

    Qualifications Bachelors Degree in Engineering, or closely related discipline 3+ years of relevant post education experience in engineering and traffic design Engineer-in-Training (EIT) certification Proficient knowledge of traffic engineering principles, practices, process, and design/build related to traffic control equipment, capacity and operational...

  • Data Analyst

    1 month ago

    Portland, United States Wipro Limited Full time

    Responsibilities The Enterprise Technology Claims Knowledge Graph Team provides a graph technology based distributed web application. This tool helps our claims business partners in investigating potential frauds by showing connections between different entities of a claim. Candidates should be high performers able to work on multiple conflicting...

  • Data Analyst

    1 month ago

    Portland, Oregon, United States Wipro Limited Full time

    Responsibilities The Enterprise Technology Claims Knowledge Graph Team provides a graph technology based distributed web application. This tool helps our claims business partners in investigating potential frauds by showing connections between different entities of a claim. Candidates should be high performers able to work on multiple conflicting priorities...

  • 1632 CRM Data Architect

    3 weeks ago

    Portland, United States Harvest Technical Services, Inc. Full time

    Job DescriptionJob DescriptionJob ResponsibilitiesDesign, build, and maintain the data pipelines that support Public Policy with relevant, actionable, and up-to-date insights.This includes integrations between the companys data warehouse, 3rd party marketing and advocacy tools, and our Salesforce Sales Cloud (CRM).Contribute to the data and tooling strategy...