Data Platform Architect

4 weeks ago


Pleasanton, California, United States BlackLine Full time
Job Title: Principal Data Engineer

Job Summary:

We are seeking a highly skilled Principal Data Engineer to join our Data & BI Engineering team at BlackLine. As a key member of our team, you will be responsible for designing, developing, and maintaining our Enterprise Data Platform to enable data-driven decision-making across the organization.

Key Responsibilities:

  • Provide technical leadership in technology direction, road-mapping, architecture definition, design, development, and delivery of enterprise-class solutions.
  • Architect, design, develop, test, troubleshoot, debug, optimize, scale, perform capacity planning, deploy, maintain, and improve software applications.
  • Work collaboratively across the company to design, communicate, and further assist with adoption of best practices in architecture and implementation.
  • Deliver robust architectural solutions for complex design problems.
  • Implement, refine, and enforce data engineering best practices to ensure that delivered features meet performance, security, and maintainability expectations.
  • Research, test, benchmark, and evaluate new tools and technologies, and recommend ways to implement them in the data platform.
  • Actively participate in research, development, support, management, and other company initiatives designing solutions to optimally address current and future business requirements and infrastructure plans.
  • Inspire a forward-thinking team of developers, acting as an agent of change and evangelist for a quality-first culture within the organization.
  • Maintain a strong sense of business value and return on investment in planning, design, and communication.
  • Proactively identify issues, bottlenecks, gaps, or other areas of concern or opportunity and work to either directly affect change, or advocate for that change by working with peers and leadership to build consensus and act.

Requirements:

  • Bachelor's or master's degree in computer science, Data Science, or a related field.
  • 10+ years as a data engineer designing and architecting complex systems.
  • 10+ years of experience using RDBMS, SQL, Python, or other programming languages.
  • 5+ years working experience with SQL and familiarity with Snowflake data warehouse, strong working knowledge in stored procedures, CTEs, and UDFs, RBAC.
  • Deep understanding of Data warehouse concepts, star, snowflake and dimensional modeling and ETL/ELT best practices, scalability, complex process management, self-healing approaches, etc.
  • Strong working knowledge in at-least one of the big data architectures such as Lambda, Kappa and Hub and Spoke Architectures.
  • Excellent proficiency in Stream-processing systems like Storm, Spark-Streaming, kafka streaming and building real time data pipelines.
  • Proficiency in Container technologies: Docker, and Kubernetes.
  • Experience with at least one modern Data pipeline, Replication and processing tools such as Qlik, Fivetran, airflow, Astronomer etc
  • Understanding of data security and privacy regulations, with experience implementing data security best practices.
  • Ability to define and manage user roles and permissions in Snowflake to ensure data security and privacy.
  • Experience in working in a startup-type environment, good team player, and can work independently with minimal supervision.
  • Proficient in managing large volumes of data.
  • Strong analytical and interpersonal skills, comfortable presenting complex ideas in simple terms.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
  • Experience in providing technical support and troubleshooting for data-related issues.
  • Expertise with at least one cloud environment and building cloud native data services.
  • Prior experience driving data governance, quality, security initiatives.

Nice to Have:

  • 5+ years of building data intensive applications in Java
  • Experience with nosql systems such as mongodb, cockroachDb, apache cassandra etc.
  • Significant experience with open-source platforms and technologies.
  • Experience with data science and machine learning tools and technologies is a plus.

What We Offer:

At BlackLine, we offer a dynamic and collaborative work environment, competitive compensation and benefits package, and opportunities for professional growth and development.

How to Apply:

If you are a motivated and experienced data engineer looking for a new challenge, please submit your resume and cover letter to [insert contact information].


  • Senior Data Architect

    2 weeks ago


    Pleasanton, California, United States Data Piper LLC Full time

    Data Piper LLC is seeking a highly skilled Senior Data Architect - Databricks Expert to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on Databricks.Key Responsibilities:Design and implement data pipelines using DatabricksCollaborate with cross-functional teams...

  • Senior Data Architect

    22 hours ago


    Pleasanton, California, United States BlackLine Full time

    Job Title: Principal Data EngineerAbout the Role:We are seeking a highly skilled Principal Data Engineer to join our team at BlackLine. As a Principal Data Engineer, you will play a critical role in designing, developing, and maintaining our enterprise data platform.Responsibilities:Design and develop scalable data architectures to support business growth...

  • Senior Data Engineer

    2 weeks ago


    Pleasanton, California, United States Data Piper Full time

    Job TitleSenior Data Engineer - Azure and Databricks ExpertWe are seeking a highly skilled Solutions Architect/Sr Data Engineer with a strong background in the Azure and Databricks ecosystem, along with a solid understanding of data extraction from Microsoft D365 applications.Key Responsibilities:Design and implement scalable data architectures within the...

  • Principal Architect

    4 weeks ago


    Pleasanton, California, United States BayOne Solutions Full time

    Job Title: Principal ArchitectLocation: Pleasanton, CA or Plano, TX (Hybrid)Type: FulltimeOverview:The Principal Architect is a key member of our team, responsible for overseeing the architecture and design of our digital properties. This role requires a strong technical background and excellent leadership skills to drive the technology vision and strategic...


  • Pleasanton, California, United States Bayone Full time

    Job Title: Senior Solutions ArchitectJob Summary:Bayone is seeking a highly skilled Senior Solutions Architect to lead the design and development of our next-generation health and wellness platforms. The ideal candidate will have a strong background in healthcare technology and experience in architecting and implementing large-scale digital solutions.Key...


  • Pleasanton, California, United States GATE Insight, Inc. Full time

    Solutions ArchitectAbout the Role:This is a unique opportunity to join GATE Insight, Inc. as a Solutions Architect, where you will play a key role in shaping the company's IT strategy and architecture. As a seasoned professional with a strong background in enterprise-level architecture and integration, you will be responsible for developing and maintaining...


  • Pleasanton, California, United States CodeBase Inc Full time

    Job Title: Senior Enterprise Cloud ArchitectAt CodeBase Inc, we are seeking a highly skilled Senior Enterprise Cloud Architect to lead our cloud strategy and architecture initiatives. The ideal candidate will have a strong background in cloud computing, enterprise architecture, and leadership.Key Responsibilities:Develop and maintain the enterprise...


  • Pleasanton, California, United States Areti Group | B Corp™ Full time

    Senior Enterprise ArchitectAreti Group | B Corp™ is seeking a highly skilled Senior Enterprise Architect to join our team. As a key member of our IT leadership team, you will be responsible for developing and maintaining our enterprise architecture framework, aligning with our business strategy.Key Responsibilities:Architectural Strategy and...

  • Lead Data Architect

    2 weeks ago


    Pleasanton, California, United States Avathon Full time

    Job Title: Lead Data EngineerAvathon, Inc. is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing complex data pipelines and architectures that drive our AI and analytics platforms.Key Responsibilities:Lead the architecture, design, and...


  • Pleasanton, California, United States Inizio Partners Full time

    About the job Salesforce Multi Cloud Solution ArchitectInizio Partners is a top-rated executive hiring and IT placement firm serving clients globally. Our clients include fortune 500 companies, consulting firms, startups, private equity & venture capital firms etc.We are currently recruiting for a Salesforce Multi Cloud Solution Architect (Sales & Service)...


  • Pleasanton, California, United States Nisum Full time

    Nisum is a leading global digital commerce firm that empowers businesses to thrive in the digital age. As a Senior Frontend Architect, you will play a crucial role in shaping the user experience of our clients' web applications.Key Responsibilities:Design and implement highly usable and performant web applications using JavaScript, HTML, CSS, and...


  • Pleasanton, California, United States Inizio Partners Full time

    About the JobInizio Partners is a top-rated executive hiring and IT placement firm serving clients globally. Our clients include fortune 500 companies, consulting firms, startups, private equity & venture capital firms, and more.We are currently recruiting for multiple Salesforce Billing Solution Architects for one of our key clients, a leading Global...


  • Pleasanton, California, United States AbD Serotec Full time

    At AbD Serotec, we are seeking a highly skilled Software Architect to lead our Life Sciences Group in designing, developing, and deploying applications that connect and control Bio-Rad life science research platforms using web technology. As a Software Architect, you will mentor teams with talented developers and promote a culture of learning. Your work will...


  • Pleasanton, California, United States PTC Full time

    Transforming the Physical WorldAt PTC, we're pushing the boundaries of innovation and technology to create a better future. As a Staff Software Engineer, you'll play a key role in architecting and developing cutting-edge mobile applications using React-Native.Key Responsibilities:Lead Mobile Development: Drive the development of mobile applications, from...

  • Salesforce Architect

    2 weeks ago


    Pleasanton, California, United States Diverse Lynx Full time

    Job SummaryAs a Salesforce Architect at Diverse Lynx LLC, you will design and lead the build of complex process management using Salesforce. You will have high proficiency in process design and data modeling, as well as a good understanding of architecture principles for building and integrating cloud apps. You will demonstrate thought leadership,...


  • Pleasanton, California, United States HCLTech Full time

    HCLTech - Microservices Solutions Architect Job OpportunityHCL Technologies is a leading global technology company with a diverse workforce spread across multiple countries. We specialize in digital, engineering, and cloud solutions, offering a wide range of technology services and products to clients in various industries.We are seeking a highly experienced...


  • Pleasanton, California, United States 10X Genomics Full time

    About the Role10x Genomics is seeking a highly skilled Staff Integration Architect to join our Productivity Engineering team. As a key member of our team, you will play a crucial role in improving our existing integration landscape, process efficiency, and automations. Your expertise will be instrumental in developing new robust integration strategies across...

  • Software Architect

    2 weeks ago


    Pleasanton, California, United States Bio-Rad Laboratories Full time

    At Bio-Rad Laboratories, we're seeking a talented Software Architect to join our Life Sciences Group. As a key member of our team, you will lead the design, development, and deployment of applications that connect and control Bio-Rad life science research platforms using web technology.You will mentor teams with talented developers and promote a culture of...

  • Data Engineer

    2 weeks ago


    Pleasanton, California, United States Flexon Technologies, INC. Full time

    Job OverviewFlexon Technologies, INC. is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure.Key ResponsibilitiesDesign and develop efficient data pipelines to support analytics and...


  • Pleasanton, California, United States Akraya Full time

    Akraya is seeking a seasoned Staff Engineer to lead the implementation of Warehouse Management and Automation systems, ensuring modern, efficient, and scalable solutions.The successful candidate will be responsible for conducting high-level architecture and design during the discovery phase of major projects, overseeing and collaborating with...