Staff Data Engineer
4 weeks ago
Material Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.
--
Material Bank is seeking a Data Engineer with deep expertise in engineering and data platform design to enable and enhance Material Bank's internal catalog systems, tailored specifically for eCommerce applications and supporting complex Bill of Materials (BOM) structures. As a Data Engineer at Material Bank, you will take a hands-on role as an individual contributor (IC), designing, architecting, and implementing scalable database systems that support a comprehensive material catalog, central to eCommerce operations, and the creation and management of BOMs.
Key Responsibilities:
- eCommerce Catalogs: Lead the design and development of robust, scalable database systems that underlie Material Bank's comprehensive material catalog. Focus on developing optimal schemas and attributes that ensure data integrity, efficient retrieval, and support the detailed specification of materials in BOMs across databases and PIM systems.
- Bill of Materials Integration: Develop and enhance data structures that support the creation, management, and retrieval of BOMs. This includes addressing the unique challenges of BOM management, such as ensuring data consistency across multiple components, handling complex hierarchical structures, and linking various materials, components, and attributes required for diverse construction and design projects.
- Decentralized Data Ownership and Architecture: Organize data management to ensure that product data remains independent for each business domain. Each domain will have control over its product data. You will create and maintain a platform that enables decentralized data ownership and architecture, ensuring that domain teams can operate independently while preserving data integrity and consistency across the organization.
- Self-Serve Data Infrastructure as a Platform: Develop and implement a self-serve data platform that enables domain teams to autonomously create and consume data products. This platform will provide the necessary infrastructure and tools to manage data without requiring specialized technical knowledge, reducing bottlenecks and empowering teams to work independently. You will be a key enabler in the creation and success of this platform.
- Hands-On Data Modeling and Development: Engage directly in the creation of detailed data models and the hands-on implementation of scalable, performant systems using tools like DBT, Airflow, and AWS data services such as AWS Glue. You will ensure the integration of data sources and support complex relationships inherent in BOMs.
- Ingestion Pipelines: Develop and maintain ingestion pipelines for catalog and BOM data from multiple sources, including third-party data providers, brand partners, and web scraping. Utilize tools such as DBT, Airbyte, Airflow, and AWS Glue to ensure timely and accurate data flow.
- Data Governance, Provenance, and Quality: Establish and enforce data governance policies that ensure data quality, integrity, and provenance across catalog and BOM-related data. Develop and implement a Data Quality Matrix to continuously monitor, assess, and improve the accuracy, completeness, and reliability of the data.
- Cross-functional Collaboration: Work closely with cross-functional teams, including product managers, engineers, designers, and other technical stakeholders, ensuring that technical specifications are met with high standards of precision and performance.
- Continuous Improvement: Drive continuous innovation by refining and optimizing database architectures, introducing new tools and methods, and applying best practices to keep Material Bank at the forefront of eCommerce and BOM management technology.
Success Metrics
- The success of an individual in this role will be measured by the quality and completeness of data, adherence to compliance standards, and the efficiency of data governance processes. Key metrics include data accuracy, consistency, and relevance, as well as the speed and cost-effectiveness of data product development. Success will also be evaluated based on the value generated from data products, user satisfaction, operational efficiency, and the trust and reliability of data systems, ensuring that data governance positively impacts business outcomes and decision-making.
What you'll bring:
- 10+ years of experience in data architecture and data platform design, with a strong focus on eCommerce and BOM applications.
- In-depth knowledge of product catalog design, including taxonomy, attribute management, BOM data integration, and data provenance.
- Proven ability to architect and optimize schemas for large-scale databases, particularly in supporting complex BOMs in an eCommerce environment.
- Extensive hands-on experience with AWS ecosystem data services, including tools like DBT, Airbyte, Airflow, and AWS Glue, for data modeling, pipeline development, performance optimization, and ensuring data provenance.
- Proficiency in programming languages commonly used in data engineering and architecture, such as Python, SQL, and Java, with the ability to write efficient, maintainable code that supports large-scale data operations and and Kafka for the processing of data streams.
- Experience in developing and implementing a Data Quality Matrix to continuously monitor and improve data quality across systems.
- Experience with decentralized data ownership and architecture, enabling domain teams to manage their own data while maintaining organizational data integrity.
- Proven track record in developing self-serve data platforms that empower domain teams to autonomously manage and utilize data products.
- Excellent collaboration and communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- Relevant certifications (e.g., AWS Certified Solutions Architect) are a plus.
What you'll get from us:
- Our people: If you thrive in an inclusive, innovative, and fast-paced organization, look no further You will get to work alongside some of the brightest minds - Join a genuinely fun and supportive workplace where we keep our employees consistently engaged through internal communication and corporate events
- Relaxation and Celebrations: Generous PTO, Sick Days, Paid National Holidays, and even more (ask us about this when we connect).
- Health Benefits: We contribute to your medical, dental, vision and short-term/long-term disability plans and have a strong employee assistance program.
- Plan for your Retirement: 401(k) eligible after your first 90 day's employed
- Giving Back: We sponsor multiple events throughout the year to help out our communities. You will receive time off to give back as well.
- Growth: We'll help you take your career to the next level. We want you to be creative and take initiative which will allow you to grow and create within the company. Most importantly, be the best at what matters
- Flexible Work Schedules: With business units and employees across the globe, Material Technologies has embraced a hybrid working model allowing department leaders to decide on the best approach for their respective teams, whether that be remote, in person, or a little of both.
About Material Bank
Material Bank is the world's largest material marketplace for the architecture and design industry, providing the fastest and most powerful way to search and sample materials. Material Bank connects design professionals to hundreds of manufacturers through facilitating brand discovery, rep engagement, and material sampling.
Material Bank has transformed the way an entire industry discovers and samples materials. By removing the friction that exists in the process, we drive business between architects and designers (members) and our Brand Partners (clients).
Our powerful material database and proprietary robotic distribution facility allow members to order samples until midnight (ET) to be delivered free of charge anywhere in the US, in one box, by 10:30 AM the next morning.
Connect with us and discover your career at Material Bank.
--Material Bank is proud to be an equal opportunity employer. We value diversity, and all applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, age, national origin, veteran or disability status or other status protected under any applicable federal, state or local law.-
Sr. Azure Data Engineer
5 months ago
New York, United States Hudson Data Full timeJob Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...
-
Cloud Data Engineer Expert
2 weeks ago
New York, New York, United States Hudson Data Full timeHudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...
-
Azure Data Engineering Lead
3 weeks ago
New York, New York, United States Hudson Data Full timeHudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...
-
Kdb+ Data Engineer
2 weeks ago
New York, New York, United States Data Intellect Full timeJob OverviewData Intellect is a data and technology consultancy firm that specializes in financial and capital markets technology solutions. We're seeking an experienced Kdb+ Developer to join our team.Salary:$80,000 - $110,000 per annum (dependent on experience)Key ResponsibilitiesWork with business users to define requirements for new application...
-
Staff Data Engineer
1 day ago
New York, United States A Place for Mom Full timeA Place for Mom is the leading online resource connecting families searching for senior care with a team of expert advisors providing insight-driven, personalized solutions. As the nation’s largest senior care advisory service, A Place for Mom helps hundreds of thousands of families every year navigate the complexities of finding the right senior care...
-
Staff Data Engineer
2 days ago
New York, United States Accrete.AI Full timeOffice Location: Lower Manhattan, NY - HybridUS Citizenship RequiredAccrete AI is a dynamic and innovative company focused on transforming the future of artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving real-world impact for businesses and government organizations. Our team...
-
Staff Data Engineer
3 days ago
New York, United States Garner Health Full timeJob DescriptionJob DescriptionGarner's mission is to transform the healthcare economy, delivering high quality and affordable care for all. By helping employers restructure their healthcare benefit to provide clear incentives and data-driven insights, we direct employees to higher quality and lower cost healthcare providers. The result is that patients...
-
Staff Data Engineer
3 days ago
New York, United States A Place For Mom Full timeJob DescriptionJob DescriptionCompany DescriptionA Place for Mom is the leading online resource connecting families searching for senior care with a team of expert advisors providing insight-driven, personalized solutions. As the nation’s largest senior care advisory service, A Place for Mom helps hundreds of thousands of families every year navigate the...
-
Staff Engineer, Data
2 months ago
New York, United States Applecart Full timeJob DescriptionJob DescriptionApplecart is the leading technology company creating a new category of "Decision Maker Marketing". The most important decisions are made by the hardest people to reach and influence. Historically, C-suite leaders have lacked the tools to reach the stakeholders that matter most to their business. The C-suites of hundreds of...
-
GCP Data Science Engineering Lead
3 weeks ago
New York, New York, United States The Data Sherpas Full timeJob Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...
-
Google Cloud Platform GCP Data Engineer
2 days ago
New York, United States The Data Sherpas Full timeJob Summary :As a GCP Data Engineer, you will lead technology innovation for our clients through robust delivery of world-class solutions. This includes integrating native GCP services and third-party technologies to architect scalable data warehouses, data lakes, and analytics platforms. You will be responsible for architecting transformation and...
-
Staff Level Data Engineer
1 week ago
New York, United States Next Ventures Full time***This is an in-office position (5 days per week) located in NYC's Flatiron neighborhood and offered on a full time permanent basis.***A Next Ventures client is seeking a Staff Level Data Engineer with infrastructure experience.As a leader on the Data & Infrastructure team, you will design, build, and maintain the scalable infrastructure that supports AI...
-
Staff Level Data Engineer
6 days ago
New York, United States Next Ventures Full time***This is an in-office position (5 days per week) located in NYC's Flatiron neighborhood and offered on a full time permanent basis.***A Next Ventures client is seeking a Staff Level Data Engineer with infrastructure experience.As a leader on the Data & Infrastructure team, you will design, build, and maintain the scalable infrastructure that supports AI...
-
Data Solutions Strategist
2 weeks ago
New York, New York, United States Simon Data Full timeAbout UsSIMON DATA is a forward-thinking customer experience orchestration platform designed to disrupt the marketing technology and marketing cloud category. Our unique approach empowers businesses to develop one-to-one relationships with their customers without building a bespoke in-house data infrastructure.At SIMON, we believe that business success...
-
Technical Account Manager
2 weeks ago
New York, New York, United States Simon Data Full timeAbout UsSIMON Data is an enterprise customer data platform empowering marketers to create personalized data-driven experiences for their customers. Founded in 2015 by a team of successful serial entrepreneurs, we're a scrappy problem-solving company that believes in tackling big challenges with disruptive thinking and giving our customers the support they...
-
Staff Data Scientist
2 days ago
New York, United States Datadog Full timeWe are looking for a staff data scientist to join our data science organization. Reporting directly to the director of engineering for data science, your scope and impact will span across the whole data science organization.As a staff data scientist, you will help design, implement and scale new and existing Datadog’s features. You will thrive to answer...
-
Member of Technical Staff
2 days ago
New York, United States Microsoft Corporation Full timeAs Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we...
-
Data Product Strategist
2 weeks ago
New York, New York, United States PitchBook Data Full timeOverviewPitchBook Data is a leading provider of data and analytics solutions. We're seeking an experienced Technical Product Lead to join our team.Job DescriptionWe're looking for a highly skilled Technical Product Lead to oversee the integration of AI/ML technologies into our data collection processes. The ideal candidate will have a strong background in...
-
Data Solutions Architect
3 weeks ago
New York, New York, United States Data Intellect Full timeAbout Data IntellectWe're dedicated to harnessing the power of human intellect and collaboration to drive innovative solutions for complex challenges.Our approach is guided by the principles of Humility, Can-do Attitude, and Togetherness, which form the foundation of our [DI] code.Compensation Package: $150,000 - $200,000 per annum, commensurate with...
-
Member of Technical Staff
4 weeks ago
New York, United States Microsoft Corporation Full timeOverviewAs Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad -to build systems that have true artificial intelligenceacross agents, applications, services, and infrastructure. It's also inclusive: we...