Sr. Data Engineer
2 weeks ago
[Full Time] Sr. Data Engineer at Protocol Labs (United States) | BEAMSTART Jobs
Sr. Data Engineer
Protocol Labs United States
Date Posted
27 Jun, 2022
Work Location
Palo Alto, United States
Salary Offered
Not Specified
Job Type
Full Time
Experience Required
No experience required
Remote Work
Yes
Stock Options
No
Vacancies
1 available
We seek a Sr. Data Engineer who will design and build data products to empower the organization to make better decisions across all business, development, and research activities.
Protocol Labs is an open-source research, development, and deployment laboratory. Our projects include IPFS, Filecoin, libp2p, and many more. We aim to make human existence orders of magnitude better through technology. We are a fully distributed company. Our team of more than 100 members works remotely and in the open to improve the internet — humanity's most important technology — as we explore new advances in computing and related fields.
As a Data Engineer for Protocol Labs you own a wide surface and be the “go to” for multiple layers in the data stack including infrastructure, DB administration, ETL, and data architectures.
Internally, you’ll be responsible for leading the design, development, implementation, and maintenance of data products to empower the organization to make data informed decisions and significantly improve productivity.
Externally, with the Filecoin blockchain, you’ll consume and produce public data, steering clear of “user tracking” and the corresponding privacy concerns.
As a Data Engineer, you will...
Partner with project and enablement leaders to understand data needs and translate these requirements into logical and physical data models that are easy to understand and use.
Set up, maintain, and scale our data infrastructure, including a data warehouse, pipelines, and visualization tools.
Build, maintain, and scale our data ingestion engine, gathering data from our networks, products, communities, systems, and other sources.
Create and support automated data pipelines that output usable and accurate datasets.
Build and enforce a pattern language across our data stack, ensuring that our definitions, taxonomy and tables are consistent, accurate, and well-understood.
Develop and maintain documentation to enable Labbers to understand our data and conduct analysis that drives actionable insights.
Be a resident subject matter expert for relational and non-relational data management systems, complex data access patterns, and performance optimization.
Champion Protocol Labs’ strategy for data governance, privacy, security, quality, and retention, ensuring compliance with legal and business requirements.
Optimize database systems for performance, security, reliability, and scalability. This includes owning database scripts, indexes, partitions, shards, monitors, backups, logs, and metrics.
You may be a fit for this role if you have...
Engineering background (e.g., CS, CE, or EE degree or equivalent experience).
Ability to dive deeply into technical details (e.g., key dependencies, design choices, operability, etc.) and drive a constructive technical discussion.
Expert knowledge in data design that meets the availability, scalability, and capacity demands of the business.
Have demonstrated experience with data warehousing, data modeling, and building ETL pipelines.
Fluency with SQL.
Familiarity with Golang. At the minimum, the willingness and ability to learn it for interoperability with other engineers at PL.
Experience in data processing using traditional and distributed systems (e.g., Hadoop, Spark, Airflow) or experience in data processing using AWS solutions (e.g., AWS Glue, AWS Lambda).
Strong interdisciplinary collaboration skills, with the ability to communicate effectively verbally and in writing.
Bonus Points if you have experience with…
Setting up, administering, supporting Redshift, Postgres, and TimescaleDB instances.
Visualization tools like Sisense and Observable.
Open Source software communities.
Building self-service reports/dashboards.
Building automated reporting like weekly business reports, operational metric reports.
Supporting day-to-day decision making with data pulls necessitated by the business and its various cycles.
What’s it like to work at Protocol Labs?
Protocol Labs mission is to improve humanity’s most important technology, the Internet. We build protocols, systems, and tools to improve how it works. Today, we are focused on how we store, locate, and move information. Our projects include IPFS, Filecoin, libp2p, and more.
As a distributed team, we hire anywhere in the world, and at various levels of experience (entry, senior, staff). We look for people with unique perspectives and diverse backgrounds.
We have a great benefits package, including parental leave, contributions to your retirement, competitive pay, and unlimited time off. For U.S.-based employees, we also provide platinum-level health, dental, and vision coverage for you and your family.
About Protocol Labs
Protocol Labs makes internet protocols: IPFS, Filecoin, and more.
Company Size:
51 - 250 People
Year Founded:
2014
Country:
United States
Company Status:
Actively Hiring
Looking for Partners
Looking for Clients
Raising Funds
Share This Job
More Full Time Jobs
Android Engineer
San Mateo, CA
Full Time
Full-Stack Engineer
San Francisco
Full Time
Solutions Engineer (Remote)
Palo Alto
Full Time
Sr Account Executive
Mountain View
Full Time
Quantitative Researcher
Toronto, Canada
Full Time
More Companies Hiring
Karate Labs
United States
NimbleRx
United States
Respaid
United States
Automat (formerly lasso)
United States
Spruce Systems
United States
BEAMSTART brings you the latest news, databases, and jobs from all around the world on startups, technology, and business. Stay updated with industry news, plug-in to exciting community events, and discover incredible career opportunities with the world's most innovative companies.
Discover
Jobs
Full Time
Part Time
Contract
Internship
Volunteer
Companies
Candidates
Post a Job
For Recruiters
Our
Company
News
Jobs
Database
About Us
Download App
More
© Copyright 2023 BEAMSTART . All Rights Reserved.
#J-18808-Ljbffr
-
Sr. DevOps Engineer
2 weeks ago
Palo Alto, United States Diverse Lynx Full timeSr. DevOps Engineer Onsite Day 1 - Palo Alto, CA Contract Top 3 skills required AWS Cloud, Jenkins, Terraform, Gradle, Dynatrace, Datadog, Grafana, Spinnaker DevOps Roles & Responsibilities: Be responsible for the planning, implementation, and growth of the AWS cloud infrastructure Build, release, and manage the configuration of all production systems...
-
Data Engineer Intern
2 weeks ago
Palo Alto, United States Tencent Full timeResponsibilities: Tencent Games was established in 2003. We are a leading global platform for game development, operations and publishing, and the largest online game community in China. Tencent Games has developed and operated over 140 games. We provide cross-platform interactive entertainment experience for more than 800 million users in over 200 countries...
-
IT Business System Analyst Sr Advisor
7 days ago
Palo Alto, United States Elevance Health Full timeIT Business System Analyst Sr Advisor [AID020] Location: This position will work a hybrid model (remote and office). Ideal candidates will live within 50 miles of the following PulsePoint location. 661 Bryant St., Palo Alto, CA 94301 Hours: Monday to Friday, 8:00 am to 5:00 pm The IT Business System Analyst Sr Advisor will collaborate with business and IT...
-
Sr. Machine Learning Engineer
7 days ago
Palo Alto, United States ShareThis Full timeShareThis, a Predactiv Company, is seeking a Senior Machine Learning Engineer to lead the development of our Intelligent Data Platform, a transformative initiative poised to redefine data interaction and analytics. Numerous companies, including publishers and brands, are eager to monetize their data but often lack the necessary in-house expertise to...
-
Java Software Engineer III
3 weeks ago
Palo Alto, United States Catalytic Data Science Full timeWho You Are REMOTE OPPORTUNITY You are passionate about continuously delivering quality software as well as the craft of software engineering and eager to join a team of life scientists and software engineers that believe the brightest minds in research should have the best tools to leverage critical information resources that are key to driving innovation....
-
Sr. IOS developer@Palo Alto
2 weeks ago
Palo Alto, United States Diverse Lynx Full timeJob Title: Sr. IOS developer Experience: 10 +yrs. Location: Palo Alto - CA ONSITE Required Qualifications : • BS/BA degree in computer science or software engineering • 10+ years of software development experience • Proven experience as an app developer. • Proficient in Swift, SwiftUI, Kotlin, Java. • Extensive experience with iOS Frameworks such...
-
Sr. Machine Learning Engineer
7 days ago
Palo Alto, United States ShareThis, Inc Full timeJob DescriptionJob DescriptionShareThis, a Predactiv Company, is seeking a Senior Machine Learning Engineer to lead the development of our Intelligent Data Platform, a transformative initiative poised to redefine data interaction and analytics. Numerous companies, including publishers and brands, are eager to monetize their data but often lack the necessary...
-
B2B Sr. Account Manager
5 days ago
Palo Alto, United States Sail Internet Full timePlay a key role in building the company that’s disrupting traditional internet service delivery. Sail Internet creates internet choice where the big names dominate and brings high-speed service where competitors won’t. With fiber at the core of everything we do, Sail bridges the gap from where the fiber ends to where people live and work using a new...
-
Sr/Staff Radar Algorithms Engineer
2 weeks ago
Palo Alto, United States ArrayLabs, LLC Full timeArray Labs is building a distributed radar imaging constellation to power the first accurate, real-time 3D map of the world. As a radar algorithms engineer on the image formation team, you will have the unique opportunity to develop innovative algorithms and processing techniques for the first orbital MIMO radar imaging system. In this critical role, you...
-
Sr/Staff Radar Algorithms Engineer
3 weeks ago
Palo Alto, United States ArrayLabs, LLC Full timeArray Labs is building a distributed radar imaging constellation to power the first accurate, real-time 3D map of the world. As a radar algorithms engineer on the image formation team, you will have the unique opportunity to develop innovative algorithms and processing techniques for the first orbital MIMO radar imaging system. In this critical role, you...
-
Business Change Advisor Sr
1 week ago
Palo Alto, California, United States Elevance Health Full timeBusiness Change Advisor Sr - Sales Incentive PlansLocation: This position will work a hybrid model (remote and office). The ideal candidate will live within 50 miles of one of our Elevance Health PulsePoint locations listed on the requisition.The Business Change Advisor Sr is responsible for assisting the senior leadership team within the Commercial Health...
-
Data Scientist
1 month ago
Palo Alto, United States Confluent Full timeThe mission of the Data Science team at Confluent is to serve as the central nervous system of all things data for the company we build analytics infrastructure insights models and tools to empower data-driven thinking and optimize every part of the business. There are limitless opportunities for an ambitious data scientist to make an immediate and...
-
Sr Production Technician
3 weeks ago
Palo Alto, United States ATR International Full timeJob Description: We are seeking a Sr Production Technician for a very important client Responsibilities:·Hand lay-up of pre-impregnated materials such as graphite, fiberglass, Kevlar or similar materials This involves the following: Tool set up, inspection, cleaning and mold releasing Placing and forming plies of material tightly against tool surface...
-
Data Scientist
1 month ago
Palo Alto, California, United States Confluent Full timeThe mission of the Data Science team at Confluent is to serve as the central nervous system of all things data for the company we build analytics infrastructure insights models and tools to empower data-driven thinking and optimize every part of the business. There are limitless opportunities for an ambitious data scientist to make an immediate and...
-
B2B Sr. Account Manager
1 week ago
Palo Alto, United States Sail Internet Full timePlay a key role in building the company that’s disrupting traditional internet service delivery. Sail Internet creates internet choice where the big names dominate and brings high-speed service where competitors won’t. With fiber at the core of everything we do, Sail bridges the gap from where the fiber ends to where people live and work using a new...
-
Sr / Staff Embedded Software Engineer
4 weeks ago
Palo Alto, California, United States Array Labs Inc Full timeThe core focus areas for the Satellite Software Team include mission software (radar data collection, storage, processing, and downlink), radio communications, satellite/flight control, telemetry, and embedded firmware.Work collaboratively with signal processing, hardware, and GNC engineers to build performant and reliable embedded software for our...
-
Sr Network Engineer
3 days ago
Palo Alto, United States Equifax Full timeJob Description What You’ll do Subject matter expert responsible for the co-design and build of all strategic network platforms within Equifax, which are expected to provide competitive advantage to our portfolio of businesses globally. -Work with network protocols (TCP/UDP, DHCP, DNS) and experience with IPv4 and IPv6. Work in a multi-vendor environment...
-
Sr. Infrastructure Engineer
2 weeks ago
Palo Alto, United States Tencent Full timeResponsibilities: Tencent Overseas IT has the mission to empower Tencent's rapid global growth with future-ready, global IT platforms, applications, and services. We are chartered to lead the Overseas IT strategy, architecture, roadmap, and execution. Satisfying our internal and external customers and becoming a world-class global IT team are our top...
-
Sr/Staff Communications Systems Engineer
3 days ago
Palo Alto, United States ArrayLabs, LLC Full timeArray Labs is building a distributed radar imaging constellation to power the first accurate, real-time 3D model of the world. As a communications systems engineer on the hardware engineering team, you will have the unique opportunity to shape the design of the first orbital MIMO radar imaging system. In this critical role, you will be collaborating with...
-
Sr/Staff Embedded Software Engineer
2 weeks ago
Palo Alto, United States ArrayLabs, LLC Full timeArray Labs is building a distributed radar imaging constellation to power the first accurate, real-time 3D map of the world. The Satellite Software Team is responsible for designing the software that powers all aspects of our mission. The core focus areas for the Satellite Software Team include mission software (radar data collection, storage, processing,...
