Sr. Data Engineer

1 day ago


Portland, United States IT Vision Group Full time
Job DescriptionJob Description

Title : Sr. Data Engineer

Location: Oregon

Duration: 12 Months+

 

 

 

 

Roles & Responsibilities

  • Perform data analysis according to business needs
  • Translate functional business requirements into high-level and low-level technical designs
  • Design and implement distributed data processing pipelines using Apache Spark, Apache Hive, Python, and other tools and languages prevalent in a modern analytics platform
  • Create and schedule workflows using Apache Airflow or similar job orchestration tooling
  • Build utilities, functions, and frameworks to better enable high-volume data processing
  • Define and build data acquisitions and consumption strategies
  • Build and incorporate automated unit tests, participate in integration testing efforts
  • Work with teams to resolve operational & performance issues
  • Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed.

Tech Stack

  1. Apache Spark
  2. Apache Spark Streaming using Apache Kafka
  3. Apache Hive
  4. Apache Airflow
  5. Python
  6. AWS EMR and S3
  7. Snowflake
  8. SQL
  9. Other Tools & Technologies :: PyCharm, Jenkin, Github.
  10. Apache Nifi (Optional)
  11. Scala (Optional)

  • Grid Program Lead

    2 weeks ago


    Portland, Oregon, United States PacifiCorp Full time

    PacifiCorp is seeking a Grid Program Lead - Sr. Engineer to oversee the development and implementation of grid modernization initiatives. This role requires advanced technical knowledge of utility system operation, distribution or transmission technologies, smart grid technologies, and project management skills. The successful candidate will establish...


  • Portland, United States OneSearch Partners Full time

    In this Senior Data Analyst role, you will use your analytical skills to form conclusions out of large sets of data (millions of rows). The Senior Data/Financial Analyst will be a subject matter expert in calculating commissions for the sales team. This role will have exposure to senior leaders in the organization and will have the opportunity to improve...


  • Portland, United States OneSearch Partners Full time

    In this Senior Data Analyst role, you will use your analytical skills to form conclusions out of large sets of data (millions of rows). The Senior Data/Financial Analyst will be a subject matter expert in calculating commissions for the sales team. This role will have exposure to senior leaders in the organization and will have the opportunity to improve...

  • Data Engineer

    24 hours ago


    Portland, United States Aquent Full time

    Overview Placement Type: Temporary Salary: $58.79 to $65.33 an hour Start Date: 12.30.2024 We are the Consumer Data Engineering team (CoDE), seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the scalability,...

  • Sr. Front End Engineer

    3 months ago


    Portland, United States ProFocus Full time

    TITLE: Sr. Front End Engineer LOCATION: 100% Remote with quarterly travel to Chicago PAY: Target pay for this role is between $140-180k ENGAGEMENT TYPE: Direct Hire WHAT YOU'LL BE DOING: An experienced Sr. Front-End Engineer with strong technical skills and leadership capabilities to guide our team of junior to mid-level engineers. The ideal...

  • Data Engineer

    15 hours ago


    Portland, United States Mainz Brady Group Full time

    Job Title: Data Engineer Location: San Francisco, CAJob Description: We are seeking a skilled Data Engineer with strong expertise in the marketing domain. The ideal candidate will have hands-on experience in cloud applications, preferably AWS, and be proficient in Python and SQL. You will be responsible for building and optimizing APIs for large-scale data...


  • portland, United States OneSearch Partners Full time

    In this Senior Data Analyst role, you will use your analytical skills to form conclusions out of large sets of data (millions of rows). The Senior Data/Financial Analyst will be a subject matter expert in calculating commissions for the sales team. This role will have exposure to senior leaders in the organization and will have the opportunity to improve...

  • Sr Civil Engineer

    7 days ago


    Portland, United States CyberCoders Full time

    Company OverviewOur team has been making it's mark in the Private and Public sectors throughout the Pacific Northwest for years. We are a national engineering services company serving several verticals; construction, civil, landscape, environmental, transportation, water, etc. As we continue to grow, we are looking to add a Sr Civil Engineer.Position...

  • Sr Civil Engineer

    1 week ago


    Portland, United States CyberCoders Full time

    Company OverviewOur team has been making it's mark in the Private and Public sectors throughout the Pacific Northwest for years. We are a national engineering services company serving several verticals; construction, civil, landscape, environmental, transportation, water, etc. As we continue to grow, we are looking to add a Sr Civil Engineer.Position...

  • Data Engineer

    20 hours ago


    Portland, United States Diverse Lynx Full time

    Data Engineer Contract Location - Portland, OR (Remote) Job Description: Mandatory Skills: AWS, Databricks, Spark, Python, Pyspark Good to have: AtScale, Airflow Skills / Qualifications: • 6+ years of experience with data engineering with emphasis on data analytics and reporting • Strong experience developing with PySpark, leveraging Databricks...

  • Data Engineer

    1 day ago


    Portland, United States RxAnte Inc Full time

    Job DescriptionJob DescriptionDescription:Data Engineer, Data ServicesCompany OverviewOver the next ten years, there will be at least 4.6 million hospitalizations from the misuse of prescription drugs in people 65 or older, resulting in $528 billion in annual avoidable costs. RxAnte is on a mission to improve people’s health by helping them get more from...


  • Portland, Oregon, United States StrongBox Data Solutions Full time

    About StrongBox Data SolutionsWe are a leading provider of software-defined data and storage solutions, seeking an experienced QA Automation Engineer to join our team. The ideal candidate will have a strong background in automated testing, with expertise in developing and executing comprehensive test suites.


  • Portland, United States Andes Technology Corporation Full time

    Sr. Engineering Manager/Site ManagerThis is a hybrid role with 2-3 days onsite required in Portland, OR.Corporate IntroductionAs a founding premier member of RISC-V International, Andes is the leading supplier and technological innovator in the RISC-V market with a wide range of processor products fulfilling performance/area/power requirements. Andes has...


  • Portland, United States Andes Technology Corporation Full time

    Sr. Engineering Manager/Site ManagerThis is a hybrid role with 2-3 days onsite required in Portland, OR.Corporate IntroductionAs a founding premier member of RISC-V International, Andes is the leading supplier and technological innovator in the RISC-V market with a wide range of processor products fulfilling performance/area/power requirements. Andes has...

  • Lead Data Engineer

    7 days ago


    Portland, United States Mainz Brady Group Full time

    Lead Data Engineer - Hybrid / Portland Oregon ONLY LOCAL CANDIDATES IN PORTLAND OREGON PLEASE OR A CONVINCING STORY AS TO WHY YOU WANT TO MOVE TO PNW Lead and be the Product Owner for the current 3 person data team 65% Player and 35% coach Eventually lead to people management (an interest in this is a plus) 5+ years of experience; 3+ years in a...

  • Lead Data Engineer

    1 month ago


    Portland, United States Hanna Andersson Full time

    We are the champions of childhoodHanna Andersson is a Portland, Oregon-based premier kids and baby clothing brand. Our clothes are made to play, made to last, and designed to let kids be kids. We have core commitments to design, quality, and sustainability, and we believe in helping families create meaningful everyday moments. These principles guide the...

  • Data Engineer Lead

    2 weeks ago


    Portland, Oregon, United States VDart Full time

    Job Title: Data Engineer LeadAbout the Job:VDart is seeking an experienced Data Engineer Lead to join our team in Pittsburgh, PA or Portland, OR. As a key member of our engineering team, you will be responsible for managing end-to-end delivery, investigating problem areas, and working cross-functionally with product managers and other stakeholders.Key...


  • Portland, United States CorVel Healthcare Corporation Full time

    Job DescriptionJob DescriptionAs our business growth continues we have established a need to hire several Sr. Software Engineers to continue the evolution of our proprietary software. An engineer who enjoys the challenge of resolving complex problems with innovative solutions who is a self-driver along with the ability to work across multiple facets of a...

  • Data Engineer-Digital

    20 hours ago


    Portland, United States TEPHRA Full time

    Description: As a Data Engineer focusing on Data Quality for Asia Pacific and Latin America, you will use your technical expertise to validate and ensure data accuracy across a variety of systems. You are a data engineer or data quality guru with software engineering chops. You are familiar with Spark, Python, Hadoop, Big Data and have excellent analytics...


  • portland, United States CyberCoders Full time

    Company OverviewOur team has been making it's mark in the Private and Public sectors throughout the Pacific Northwest for years. We are a national engineering services company serving several verticals; construction, civil, landscape, environmental, transportation, water, etc. As we continue to grow, we are looking to add a Sr Civil Engineer.Position...