Senior Data Engineer

3 weeks ago


Seattle, Washington, United States Pacific Northwest National Laboratory Full time

Senior Data Engineer - Seattle
Pacific Northwest National Laboratory - Seattle, WA
Overview:
Protecting U.S. residents and visitors is among our nation's highest priorities. As adversaries gain access to sophisticated technologies and materials, the threats grow more dynamic and complex—from cyber and nuclear to chemical and biological weapons of mass effect and other forms of terrorism. The PNNL national security mission employs our researchers, tools, and technologies to play a key role in advancing the ability to identify and secure nuclear materials, detect weapons of mass effect, manage nonproliferation treaties, secure our nation's borders, and protect critical infrastructures. PNNL's scientific discovery and capabilities—rooted in innovative theory, methods, algorithms, and tools—are enabling stronger, more resilient technologies and systems to safeguard national security. Coupled with decades of radiological and nuclear materials expertise, advanced computing and threat analysis capabilities, and a broad fundamental science base, we are identifying and countering emerging threats that have significant impact at home and around the globe.

Do you want a career that you can look back on and say to yourself 'I did something that mattered'? If you answered yes, come to PNNL. As a member of PNNL's Software Engineering and Architectures (SEA) team you will play a crucial role in developing cutting edge software, scalable data architecture & pipelines, and AI/ML solutions in support of some of the nation's biggest and most complex challenges.

National Interest Project Examples:
Detect and prevent smuggling of drugs and contraband at ports of entry [Link]
Develop large data pipelines to thwart funding for terrorists, nuclear proliferators, drug cartels, and rogue leaders [Link]
Applying big data solutions to national security problems [Link]
Applying image classification for nuclear forensics analysis [Link]
Detect and respond to advanced cyber threats with at-edge computing [Link]
Develop capabilities for scalable geospatial analytics [Link]
Use remotely sensed imagery to identify and monitor the progression of wildfires [Link]
Analyze the resiliency of the electric power grid to prevent large-scale outages [Link]
Optimize building efficiency using IOT and ICS data with automated demand-response markets [Link]
Model climate change and impacts to civilization [Link]
Hunt for the existence of dark matter to understand the nature of the universe [Link]
Technologies We Use:
Programming & Scripting – Python, C#/.Net, Bash, Powershell, javascript, typescript, [Java, C/C++]
Platforms – AWS, Azure, On-Prem, [IoT/ICS, GCP]
Development/Lifecycle – Agile/Scrum/Kanban/others, Gitlab/Atlassian, CI/CD & DevSecOps
Paradigms – Rapid prototypes with ad-hoc CSP managed services, well-architected solutions using Infrastructure as Code, compliant deployments in highly-regulated environments
Data & Storage – S3, Athena, PostgreSQL, Elasticsearch/OpenSearch, Dynamo, Redshift, MongoDB
Data Complexities:
Volume – large, terabytes and petabytes of data
Variety – Images, audio, text, IoT, RF, GPS, edge sensors
Velocity – Sub-second and lower frequency
How We Work:
Mission-Critical Development:
Design, develop, test, and deploy software applications that directly contribute to the nation's mission objectives.
Collaborate with Government and Industry partners to understand mission needs, requirements, and translate them into robust and scalable software solutions.
Innovative Problem Solving:
Tackle complex technical challenges with creativity and innovation.
Propose and implement solutions that go beyond conventional approaches, ensuring the software we deliver is both efficient and impactful.
End-to-End Ownership:
Take ownership of the entire software development lifecycle, from initial concept to deployment.
Ensure the reliability, security, and performance of mission-critical software systems.
Collaborative Teamwork:
Work in an agile environment with multidisciplinary teams, including software engineers, cloud engineers, machine learning engineers, data scientists/domain experts, UX/UI, front-end developers, scrums masters, product owners, and most importantly, USERS.
Participate in code reviews and knowledge-sharing sessions to enhance the overall team skill set.
Continuous Learning:
Stay up-to-date with industry trends and emerging technologies to bring innovative ideas to the table.
Actively participate in training and development opportunities to enhance your skills and contribute to the team's growth.
Have opportunities to attend conferences and engage in industry events.
If this sounds like you, come and join a team of 90+ mission driven software and data engineers who come to work everyday to do something that makes a difference.
Rockstar Rewards:
Employees and their families are offered medical insurance, dental insurance, vision insurance, health savings account, flexible spending accounts, basic life insurance, disability insurance*, employee assistance program, business travel insurance, tuition assistance, supplemental parental bonding leave**, surrogacy and adoption assistance, and fertility support. Employees are automatically enrolled in our company funded pension plan* and may enroll in our 401k savings plan. Employees may accrue up to 120 vacation hours per year and may receive ten paid holidays per year.
Research Associates excluded.
**Once eligibility requirements are met.

Click Here For Rockstar Rewards
Responsibilities:
Identify mission challenges and formulate engineering solutions methodically
Embrace software engineering excellence and delivering quality results at scale
Employ expertise with a high-level programming language such as Python
Apply good design and innovative problem-solving skills to solve challenging technical problems
Stay current about data management and database technology developments
Initiate personal direction and goals
Possess interest and/or experience mentoring junior scientists and engineers
Demonstrate outstanding verbal and written communication skills and the ability to work in a collaborative environment
Be passionate and self-motivated with good time management skills
Qualifications:
Minimum Qualifications:
BS/BA and 5+ years of relevant work experience -OR-
MS/MA and 3+ years of relevant work experience -OR-
PhD with 1+ year of relevant experience
Preferred Qualifications:
Degree in computer science, software engineering, or related field
5+ years of experience in designing or deploying large-scale and high-performance ETL pipelines and analytics
5+ years Python or other software development experience
Strong understanding of software engineering and data management best practices
Strong cloud architecture and implementation experience
Cloud and database certifications are a plus
Familiar with machine learning algorithms with hands-on experience in machine learning pipeline development is a plus
Active Federal Q Clearance and ability to maintain such clearance
Hazardous Working Conditions/Environment:
Not applicable.
Additional Information:
This position requires the ability to obtain and maintain a federal security clearance.

Requirements:
U.S. Citizenship
Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
Drug Testing: All Security Clearance positions are Testing Designated Positions, which means that the candidate selected is subject to pre-employment and random drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy until non-use of illegal drugs, including marijuana, for 12 months can be demonstrated.
Testing Designated Position (TDP):
This position is a Testing Designated Position (TDP). The candidate selected for this position will be subject to pre-employment and random drug testing for illegal drugs, including marijuana, consistent with the Controlled Substances Act and the PNNL Workplace Substance Abuse Program.
About PNNL:
Pacific Northwest National Laboratory (PNNL) is a world-class research institution powered by a highly educated, diverse workforce committed to the values of Integrity, Creativity, Collaboration, Impact, and Courage. Every year, scores of dynamic, driven people come to PNNL to work with renowned researchers on meaningful science, innovations and outcomes for the U.S. Department of Energy and other sponsors; here is your chance to be one of them

At PNNL, you will find an exciting research environment and excellent benefits including health insurance, flexible work schedules and telework options. PNNL is located in eastern Washington State—the dry side of Washington known for its stellar outdoor recreation and affordable cost of living. The Lab's campus is only a 45-minute flight (or ~3-hour drive) from Seattle or Portland, and is serviced by the convenient PSC airport, connected to 8 major hubs.
Commitment to Excellence, Diversity, Equity, Inclusion, and Equal Employment Opportunity:
Our laboratory is committed to a diverse and inclusive work environment dedicated to solving critical challenges in fundamental sciences, national security, and energy resiliency. We are proud to be an Equal Employment Opportunity and Affirmative Action employer. In support of this commitment, we encourage people of all racial/ethnic identities, women, veterans, and individuals with disabilities to apply for employment.

Pacific Northwest National Laboratory considers all applicants for employment without regard to race, religion, color, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, genetic information (including family medical history), protected veteran status, and any other status or characteristic protected by federal, state, and/or local laws.



  • Seattle, Washington, United States SoFi Full time

    About SoFiSoFi is a leading financial services company and national bank that is revolutionizing the way people think about and interact with personal finance. We are a next-generation financial services company that uses innovative, mobile-first technology to help our millions of members reach their financial goals.The RoleWe are seeking a highly motivated...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Enterprise Data Platform team at PitchBook Data. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines to support business analytics and decision-making.Key ResponsibilitiesDesign and implement data pipelines to ingest and...


  • Seattle, Washington, United States Hireio, Inc. Full time

    Job OverviewHireio, Inc. is seeking a highly skilled Senior/Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data solutions that empower our business with data-driven insights.Key ResponsibilitiesDesign and implement big data processing and...


  • Seattle, Washington, United States Hireio, Inc. Full time

    Job OverviewHireio, Inc. is seeking a highly skilled Senior/Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data solutions that empower our business with data-driven insights.Key ResponsibilitiesDesign and implement large-scale data processing...

  • Senior Data Engineer

    3 weeks ago


    Seattle, Washington, United States Swiftly Full time

    Swiftly is a leading provider of technology and solutions for retailers worldwide. Our best-in-class platform delivers innovative, turn-key solutions that empower retailers to grow sales and build loyalty, while enabling brands to reach more shoppers through retail media networks. Swiftly is the first vendor in the industry to connect the digital and...


  • Seattle, Washington, United States Amazon Data Services, Inc. Full time

    About the RoleAmazon Data Services, Inc. is seeking a highly skilled Data Center Civil Engineer to join its design team in a dynamic and innovative environment. As a Data Center Civil Engineer, you will play a critical role in the design and construction of Amazon's global infrastructure.Key ResponsibilitiesManage external civil design consultants through...


  • Seattle, Washington, United States GEICO Full time

    Job SummaryGEICO is seeking an experienced Senior Data Engineer to join our team as a Staff Engineer - Data Lakehouse Platform. As a key member of our engineering staff, you will play a critical role in driving our insurance business transformation by designing and building high-performance, low-maintenance, zero-downtime platforms and core data...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled and experienced Staff Software Development Engineer to join our Product and Engineering team at PitchBook Data. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.Key ResponsibilitiesArchitect, design, develop, and maintain...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled and experienced Staff Software Development Engineer to join our Product and Engineering team at PitchBook Data. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.Key ResponsibilitiesArchitect, design, develop, and maintain...


  • Seattle, Washington, United States Apple Full time

    Job SummaryWe are seeking a hands-on senior data engineer to join the App Store Analytics engineering team focused on Advertising solutions to help drive app discoverability.About the RoleIn this role, you will be part of an analytics team working with product, privacy, and multi-functional engineering teams to design and implement core privacy preserving...


  • Seattle, Washington, United States WaFd Bank Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineering Manager to join our team at WaFd Bank. As a key member of our Enterprise Data Department, you will play a pivotal role in shaping and implementing our data strategy, unlocking valuable insights that have a tangible impact on both the organization and our customers.Key...


  • Seattle, Washington, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Runtime team at Databricks. As a key member of our team, you will be responsible for building the next generation of distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.Key ResponsibilitiesDesign and...


  • Seattle, Washington, United States Apple Full time

    DescriptionThis role requires strong technical expertise in data management, deep understanding of regulatory requirements, and proven ability to collaborate with multi-functional teams to drive data governance initiatives forward.Strategy and Leadership: Define and execute Apple's data governance strategy, ensuring alignment with business objectives and...


  • Seattle, Washington, United States Brex Inc. Full time

    About the RoleBrex Inc. is a leading provider of AI-powered spend management solutions. We're seeking a highly skilled Senior Software Engineer to join our Data Storage team.Key ResponsibilitiesCollaborate with Product Engineering teams to design and implement scalable data storage solutions.Develop and maintain high-performance database systems using...


  • Seattle, Washington, United States Databricks Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Databricks Inc. as a key member of our Data Intelligence Platform development team. As a Full Stack Software Engineer, you will play a critical role in designing, developing, and deploying scalable and robust data and AI solutions for our customers.Key...


  • Seattle, Washington, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Runtime team at Databricks. As a key member of our team, you will be responsible for building the next generation of distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.Key ResponsibilitiesDesign and...


  • Seattle, Washington, United States QData Full time

    Mandatory Skills Need senior candidates. Data Visualization Engineer – Someone who can build dashboards reports interactive reports data access tools exec UI etc. Experience with Data Visualization libraries (High charts D3 Bokeh) Full stack development experience Experience with backend web development node JS Experience with frontend web development HTML...


  • Seattle, Washington, United States Databricks Inc. Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Product Manager to lead our Data Engineering product management efforts. As a key member of our product team, you will be responsible for defining and driving the vision, strategy, and roadmap for our Data Engineering product area.Key ResponsibilitiesDevelop and execute a comprehensive...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RolePitchBook Data is a leading provider of financial data and software solutions. We are seeking a highly skilled Senior Content Editor to join our team of writers and editors who produce high-quality content for our clients.Job SummaryThe Senior Content Editor will be responsible for editing, producing, and performing quality assurance on...


  • Seattle, Washington, United States QData Full time

    HiHope you are doing good...We have an urgent requirement below please go through Job description and send your updated profile and expected rate ASAP.Please reach me at .comJob Title Data Visualization EngineerJob Location Seattle WADuration 12 MonthsMandatory Skills HTML CSS Node Js Data VisualizationJob Description Need senior candidates. Data...