Sr. Data Engineer
2 weeks ago
Title : Sr. Data Engineer
Location: Oregon
Duration: 12 Months+
Roles & Responsibilities
- Perform data analysis according to business needs
- Translate functional business requirements into high-level and low-level technical designs
- Design and implement distributed data processing pipelines using Apache Spark, Apache Hive, Python, and other tools and languages prevalent in a modern analytics platform
- Create and schedule workflows using Apache Airflow or similar job orchestration tooling
- Build utilities, functions, and frameworks to better enable high-volume data processing
- Define and build data acquisitions and consumption strategies
- Build and incorporate automated unit tests, participate in integration testing efforts
- Work with teams to resolve operational & performance issues
- Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed.
Tech Stack
- Apache Spark
- Apache Spark Streaming using Apache Kafka
- Apache Hive
- Apache Airflow
- Python
- AWS EMR and S3
- Snowflake
- SQL
- Other Tools & Technologies :: PyCharm, Jenkin, Github.
- Apache Nifi (Optional)
- Scala (Optional)
-
Data Engineer, Sr
4 days ago
Portland, United States Powin Corporation Full timeWe're Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete with...
-
Data Engineer, Sr
9 hours ago
Portland, United States Powin Corporation Full timeWe’re Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete...
-
Technical Lead
1 week ago
Portland, United States Saransh Inc Full timeJob DescriptionJob DescriptionSkills: Quality Assurance,ETL,SQL,Testing,QA Location: Portland OR Budget Max: $66/hr Sr. Data Engineer Mandatory Skills: Experience developing using Dbt (ETL tool), Data Engineering, SQL Relocation to Portland, OR/ Vancouver,WA is mandatory. Please submit candidate who have Hand-on experience onlyJob Description: the...
-
Technical Lead
2 days ago
Portland, United States Saranshinc Full timeSkills: Quality Assurance,ETL,SQL,Testing,QA Location: Portland OR Budget Max: $66/hr Sr. Data Engineer Mandatory Skills: Experience developing using Dbt (ETL tool), Data Engineering, SQL Relocation to Portland, OR/ Vancouver,WA is mandatory. Please submit candidate who have Hand-on experience only Job Description: The Day-to-day Stuff They Will Be Doing...
-
Data Analyst, Sr
1 week ago
Portland, United States Powin Corporation Full timeWe're Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete with...
-
Data Scientist, Sr
1 week ago
Portland, United States Powin Corporation Full timeWe're Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete with...
-
Data Scientist, Sr
8 hours ago
Portland, United States Powin Corporation Full timeWe’re Building the Future! Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? About Powin: Powin Energy is a leading producer of utility scale modular battery energy storage system (complete...
-
Data Engineer
2 weeks ago
Portland, United States NerdPine Full timeJob DescriptionJob DescriptionNerdPine, a leading marketing and advertising company, is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow and accessibility of data for various marketing and advertising...
-
Software Engineer, Backend/Server-Side
3 days ago
Portland, United States Catalytic Data Science Full time**Software Engineer, Backend/Server-Side** Engineering REMOTE, Connecticut Minimum Experience **Mid-level** Software Engineer, Backend/Server-side About Catalytic Data Science (CDS): is a groundbreaking cloud R&D platform designed to integrate the volumes of scientific resources, data, and analytic tools while providing the ability to network with colleagues...
-
Software Engineer, Backend/Server-Side
2 weeks ago
Portland, United States Catalytic Data Science Full time**Software Engineer, Backend/Server-Side** Engineering REMOTE, Connecticut Minimum Experience **Mid-level** Software Engineer, Backend/Server-side About Catalytic Data Science (CDS): is a groundbreaking cloud R&D platform designed to integrate the volumes of scientific resources, data, and analytic tools while providing the ability to network with...
-
Data Integration Engineer
2 days ago
Portland, United States Martins Point Health Care Full timeJoin Martin's Point Health Care - an innovative, not-for-profit health care organization offering care and coverage to the people of Maine and beyond. As a joined force of "people caring for people," Martin's Point employees are on a mission to transform our health care system while creating a healthier community. Martin's Point employees enjoy an...
-
Data Engineer 3
3 weeks ago
Portland, United States PacifiCorp Full timeGeneral Purpose Data engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data scientists and are largely in charge of architecting solutions for data scientists that enable them to do their...
-
Data Engineer 3
3 weeks ago
Portland, Oregon, United States PacifiCorp Full timeGeneral PurposeData engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data scientists and are largely in charge of architecting solutions for data scientists that enable them to do their...
-
Data Integration Engineer
2 weeks ago
Portland, United States CareerBuilder Full timeJoin Martin's Point Health Care - an innovative, not-for-profit health care organization offering care and coverage to the people of Maine and beyond. As a joined force of "people caring for people," Martin's Point employees are on a mission to transform our health care system while creating a healthier community. Martin's Point employees enjoy an...
-
Sr. Design Engineer
2 weeks ago
Portland, United States Weir Full timeSr. Design Engineer - Growth Program Weir ESCO Portland, OR Hybrid Purpose of Role: Weir ESCO is seekinginnovative engineers to develop products, processes and solutions to expand and enhance our world class product portfolio. These positions requirecreative technical contribution, leadership skills, working with minimum supervision,...
-
Data Warehouse Engineer
2 weeks ago
Portland, United States SkyPoint Cloud Inc. Full time**Data Warehouse Engineer** Portland, OR or Remote (US Only) / Engineering Data Engineer / Full-time Data is messy. It is pervasive, sensitive, and highly valuable when utilized at its maximum potential. For businesses across every industry, the explosion of customer data represents an opportunity, responsibility, and a massive challenge. At SkyPoint Cloud...
-
Data Engineer
2 weeks ago
Portland, Oregon, United States NerdPine Full timeNerdPine, a leading marketing and advertising company, is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow and accessibility of data for various marketing and advertising purposes. You will have the...
-
Data Engineer-Digital
8 hours ago
Portland, United States TEPHRA Full timeDescription: As a Data Engineer focusing on Data Quality for Asia Pacific and Latin America, you will use your technical expertise to validate and ensure data accuracy across a variety of systems. You are a data engineer or data quality guru with software engineering chops. You are familiar with Spark, Python, Hadoop, Big Data and have excellent analytics...
-
Data Engineer 3
2 weeks ago
Portland, United States BizTek People, Inc. | APA International Placement Consultants Full timeJob DescriptionJob DescriptionTitle: Data Engineer 3 - Data and AnalyticsDuration: 3 MonthsLocation: 100% RemoteJob DescriptionEstablishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan,...
-
Engineering Data Coordinator
2 weeks ago
Portland, United States Sulzer Full timeServices_AME-E516 Engineering Data Coordinator - Full Time - Portland (OR), United States Join our Services_AME team within Services division in United States as Engineering Data Coordinator to help us take our organization to the next level. Your main tasks and responsibilities: Provides engineering support for PPC and specifies...