Principal Data Engineer

3 days ago


New York, United States Material Bank Full time
Job DescriptionJob Description

Material Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.

--

Material Bank is seeking a Principal Data Engineer/Architect with deep expertise in data architecture and data platform design to enable and enhance Material Bank's internal catalog systems, tailored specifically for eCommerce applications and supporting complex Bill of Materials (BOM) structures. As a Principal Data Architect at Material Bank, you will take a hands-on role as an individual contributor (IC), designing, architecting, and implementing scalable database systems that support a comprehensive material catalog, central to eCommerce operations, and the creation and management of BOMs.

Key Responsibilities:

  • Architect eCommerce Catalogs: Lead the design and development of robust, scalable database systems that underlie Material Bank's comprehensive material catalog. Focus on developing optimal schemas and attributes that ensure data integrity, efficient retrieval, and support the detailed specification of materials in BOMs across databases and PIM systems.
  • Bill of Materials Integration: Develop and enhance data structures that support the creation, management, and retrieval of BOMs. This includes addressing the unique challenges of BOM management, such as ensuring data consistency across multiple components, handling complex hierarchical structures, and linking various materials, components, and attributes required for diverse construction and design projects.
  • Decentralized Data Ownership and Architecture: Organize data management to ensure that product data remains independent for each business domain. Each domain will have control over its product data. You will create and maintain a platform that enables decentralized data ownership and architecture, ensuring that domain teams can operate independently while preserving data integrity and consistency across the organization.
  • Self-Serve Data Infrastructure as a Platform: Develop and implement a self-serve data platform that enables domain teams to autonomously create and consume data products. This platform will provide the necessary infrastructure and tools to manage data without requiring specialized technical knowledge, reducing bottlenecks and empowering teams to work independently. You will be a key enabler in the creation and success of this platform.
  • Hands-On Data Modeling and Development: Engage directly in the creation of detailed data models and the hands-on implementation of scalable, performant systems using tools like DBT, Airflow, and AWS data services such as AWS Glue. You will ensure the integration of data sources and support complex relationships inherent in BOMs.
  • Ingestion Pipelines: Develop and maintain ingestion pipelines for catalog and BOM data from multiple sources, including third-party data providers, brand partners, and web scraping. Utilize tools such as DBT, Airbyte, Airflow, and AWS Glue to ensure timely and accurate data flow.
  • Data Governance, Provenance, and Quality: Establish and enforce data governance policies that ensure data quality, integrity, and provenance across catalog and BOM-related data. Develop and implement a Data Quality Matrix to continuously monitor, assess, and improve the accuracy, completeness, and reliability of the data.
  • Cross-functional Collaboration: Work closely with cross-functional teams, including product managers, engineers, designers, and other technical stakeholders, ensuring that technical specifications are met with high standards of precision and performance.
  • Continuous Improvement: Drive continuous innovation by refining and optimizing database architectures, introducing new tools and methods, and applying best practices to keep Material Bank at the forefront of eCommerce and BOM management technology.

Success Metrics

  • The success of an individual in this role will be measured by the quality and completeness of data, adherence to compliance standards, and the efficiency of data governance processes. Key metrics include data accuracy, consistency, and relevance, as well as the speed and cost-effectiveness of data product development. Success will also be evaluated based on the value generated from data products, user satisfaction, operational efficiency, and the trust and reliability of data systems, ensuring that data governance positively impacts business outcomes and decision-making.

What you'll bring:

  • 10+ years of experience in data architecture and data platform design, with a strong focus on eCommerce and BOM applications.
  • In-depth knowledge of product catalog design, including taxonomy, attribute management, BOM data integration, and data provenance.
  • Proven ability to architect and optimize schemas for large-scale databases, particularly in supporting complex BOMs in an eCommerce environment.
  • Extensive hands-on experience with AWS ecosystem data services, including tools like DBT, Airbyte, Airflow, and AWS Glue, for data modeling, pipeline development, performance optimization, and ensuring data provenance.
  • Proficiency in programming languages commonly used in data engineering and architecture, such as Python, SQL, and Java, with the ability to write efficient, maintainable code that supports large-scale data operations and and Kafka for the processing of data streams.
  • Experience in developing and implementing a Data Quality Matrix to continuously monitor and improve data quality across systems.
  • Experience with decentralized data ownership and architecture, enabling domain teams to manage their own data while maintaining organizational data integrity.
  • Proven track record in developing self-serve data platforms that empower domain teams to autonomously manage and utilize data products.
  • Excellent collaboration and communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Relevant certifications (e.g., AWS Certified Solutions Architect) are a plus.

What you'll get from us:

  • Our people: If you thrive in an inclusive, innovative, and fast-paced organization, look no further You will get to work alongside some of the brightest minds - Join a genuinely fun and supportive workplace where we keep our employees consistently engaged through internal communication and corporate events
  • Relaxation and Celebrations: Generous PTO, Sick Days, Paid National Holidays, and even more (ask us about this when we connect).
  • Health Benefits: We contribute to your medical, dental, vision and short-term/long-term disability plans and have a strong employee assistance program.
  • Plan for your Retirement: 401(k) eligible after your first 90 day's employed
  • Giving Back: We sponsor multiple events throughout the year to help out our communities. You will receive time off to give back as well.
  • Growth: We'll help you take your career to the next level. We want you to be creative and take initiative which will allow you to grow and create within the company. Most importantly, be the best at what matters
  • Flexible Work Schedules: With business units and employees across the globe, Material Technologies has embraced a hybrid  working model allowing department leaders to decide on the best approach for their respective teams, whether that be remote, in person, or a little of both.

About Material Bank

Material Bank is the world's largest material marketplace for the architecture and design industry, providing the fastest and most powerful way to search and sample materials. Material Bank connects design professionals to hundreds of manufacturers through facilitating brand discovery, rep engagement, and material sampling.

Material Bank has transformed the way an entire industry discovers and samples materials. By removing the friction that exists in the process, we drive business between architects and designers (members) and our Brand Partners (clients).

Our powerful material database and proprietary robotic distribution facility allow members to order samples until midnight (ET) to be delivered free of charge anywhere in the US, in one box, by 10:30 AM the next morning.

Connect with us and discover your career at Material Bank.

--Material Bank is proud to be an equal opportunity employer. We value diversity, and all applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, age, national origin, veteran or disability status or other status protected under any applicable federal, state or local law.

  • New York, New York, United States Arcesium Full time

    Arcesium Seeks a Principal Software Engineer - Data PlatformArcesium is seeking an exceptional Principal Software Engineer - Data Platform to join our Technology team. The successful candidate will play a key role in architecting and implementing the next generation of Arcesium's data platform.Key ResponsibilitiesDesign and develop next-generation technology...


  • New York, New York, United States Arcesium Full time

    Arcesium Seeks a Principal Software Engineer - Data PlatformArcesium is seeking an exceptional Principal Software Engineer - Data Platform to join our Technology team. The successful candidate will play a key role in architecting and implementing the next generation of Arcesium's data platform.Key ResponsibilitiesDesign and develop next-generation technology...


  • New York, New York, United States Arcesium Full time

    Principal Software Engineer - Data PlatformArcesium is seeking an exceptional Principal Software Engineer to join our Technology team. The successful candidate will play a key role in architecting and implementing the next generation of our data platform, leveraging expertise in distributed systems, modern data lake technology, and infrastructure.Key...


  • New York, United States Ichor Strategies Full time

    Job SummaryIchor Strategies seeks a Principal Data Engineer to lead the data architecture of our nascent SaaS platform which connects companies to the communities they operate in so that they can understand different perspectives, build authentic relationships, and foster mutual success. The ideal candidate will have extensive experience in driving...


  • New York, United States Ichor Strategies Full time

    Job SummaryIchor Strategies seeks a Principal Data Engineer to lead the data architecture of our nascent SaaS platform which connects companies to the communities they operate in so that they can understand different perspectives, build authentic relationships, and foster mutual success. The ideal candidate will have extensive experience in driving...

  • Principal Consultant

    4 weeks ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization.You will be part of a highly collaborative...


  • New York, United States Harnham Full time

    Principal Data Engineer, AzureFully Remote3-Month Contract-to-Hire $80-$95/hr Are you a Azure Subject Matter Expert and looking to take on a new role with a team with a renowned company culture? We are looking for a highly experienced Data Architect to hit the ground running in a large team environment. Apply below! THE COMPANY This renowned software...


  • new york city, United States Ichor Strategies Full time

    Job SummaryIchor Strategies seeks a Principal Data Engineer to lead the data architecture of our nascent SaaS platform which connects companies to the communities they operate in so that they can understand different perspectives, build authentic relationships, and foster mutual success. The ideal candidate will have extensive experience in driving...


  • New York, New York, United States Hudson Data Full time

    Job Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...


  • New York, New York, United States The Data Sherpas Full time

    Who We Are:The Data Sherpas are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. We have expertise in cloud, data, and applications, and we're passionate about delivering innovative solutions that drive business value.What We're Looking For:We're seeking a self-motivated and data-driven engineer to...

  • Azure Data Engineer

    3 weeks ago


    New York, New York, United States Hudson Data Full time

    Job Title: Azure Data Engineer - Design and Implement Data SolutionsLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate will have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes,...


  • New York, New York, United States The Data Sherpas Full time

    Job Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...


  • New York, NY, United States Ichor Strategies Full time

    Job SummaryIchor Strategies seeks a Principal Data Engineer to lead the data architecture of our nascent SaaS platform which connects companies to the communities they operate in so that they can understand different perspectives, build authentic relationships, and foster mutual success. The ideal candidate will have extensive experience in driving...


  • New York, New York, United States Northrop Grumman Full time

    Job Title: Principal Electronics Engineer/Senior Principal Electronics EngineerNorthrop Grumman is seeking a highly motivated Principal Electronics Engineer/Senior Principal Electronics Engineer to join our team in Baltimore, MD.Job Summary:We are looking for a skilled electronics engineer to lead the development, integration, and testing of radar hardware....


  • New York, New York, United States MasterCard Full time

    We strive to create a connected and inclusive digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible.Using secure data and networks, partnerships, and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.We foster a...


  • New York, New York, United States Reorg Research Inc Full time

    Job Title: Principal Software EngineerAbout the Role:We are seeking a highly skilled Principal Software Engineer to join our Data Technology team at Reorg Research Inc. As a Principal Software Engineer, you will be responsible for designing, building, and supporting scalable data management applications and services.Key Responsibilities:* Demonstrate...


  • New York, New York, United States Yahoo Holdings Inc. Full time

    Job Title: Principal Technical Security EngineerAt Yahoo Holdings Inc., we are seeking a highly skilled Principal Technical Security Engineer to join our team. The successful candidate will be responsible for providing data engineering and data science services in support of our information security initiatives. Key responsibilities include meeting with...


  • New York, New York, United States Capital One Full time

    The role of the Principal Associate of Ontology and Data Modeling at Capital One is to develop, implement, and maintain enterprise ontologies in support of the company's Data Strategy.This position will be responsible for working collaboratively across Capital One Lines of Business and Functions to develop domain ontologies in support of enterprise...


  • New York, United States Hillmont Group Full time

    Overview: Our financial services partner is looking for an experienced Data Scientist to lead their advanced analytics initiatives. This role begins as an individual contributor, laying the groundwork for a future analytics team. This is the first and principal hire for this new function.The Data Scientist will focus on descriptive, predictive, and...