Principal Data Engineer
3 weeks ago
Principal Data Engineer
As a Principal Software Engineer, you will play a crucial role in delivering high quality releases to our customers by defining application architecture, designing, developing, troubleshooting, maintaining, optimizing, and scaling BlackLine's data platform and driving innovation into our product suite.
In this role, you will work with management to identify strategic directions for system architecture.
You will research, test, benchmark and evaluate new technologies, propose scaling solutions, collaborate with other teams to define, and build new features, optimize existing features while writing elegant code, coaching, and mentoring less experienced data engineers and communicating with people at all levels.
In this position, every bit of your software design skill be drawn upon to drive towards and implement best of breed features in a rapid iterative environment. Your attention to detail, tenacity, and creative problem-solving and thinking ahead will directly impact the company's success, as well as the success of your peers across the organization.
If you have a passion for delivering products that make a difference, are driven to make things better in all that you do and are eager to work in a collaborative agile environment where Developers are dedicated to solving customer problems and innovating, you will be a great fit for the team.
Make Your Mark:
As a member of the Data & BI Engineering team you will primarily focus on advancing our Enterprise Data Platform to allow the organization to make data-driven decisions. The successful candidate will work closely with cross-functional teams to identify business requirements, design, and develop data models, data warehouses, and data visualization solutions that help support the organization's strategic goals.
The principal Data Engineer will work in a dynamic environment and will be required to stay current with the latest trends and technologies in the business intelligence field. The ideal candidate will be able to pick up business domain and internal process knowledge and leverage that knowledge to think strategically, communicate effectively, and manage multiple projects simultaneously.
The team is also responsible for administering tools and platforms around reporting, analytics, and data visualization while promoting best practices. The role requires a strong combination of technical expertise, leadership skills, and a deep understanding of data engineering principles and best practices. We are looking for a driven, detail-oriented, and passionate engineer to come to join our team.
Responsibilities:
- Provide technical expertise and leadership in technology direction, road-mapping, architecture definition, design, development, and delivery of enterprise-class solutions while adhering to timelines, coding standards, requirements, and quality.
- Architect, design, develop, test, troubleshoot, debug, optimize, scale, perform the capacity planning, deploy, maintain, and improve software applications, driving the delivery of high-quality value and features to Blackline's customers.
- Work collaboratively across the company to design, communicate and further assist with adoption of best practices in architecture and implementation.
- Deliver robust architectural solutions for complex design problems.
- Implement, refine, and enforce data engineering best practices to ensure that delivered features meet performance, security, and maintainability expectations.
- Research, test, benchmark, and evaluate new tools and technologies, and recommend ways to implement them in data platform. Identify and create solutions that are likely to contribute to the development of new company concepts while keeping in mind the business strategy, short- and long-term roadmap, and architectural considerations to support them in a highly scalable and easy extensible manner.
- Actively participate in research, development, support, management, and other company initiatives designing solutions to optimally address current and future business requirements and infrastructure plans.
- Inspire a forward-thinking team of developers, acting as an agent of change and evangelist for a quality-first culture within the organization. Mentor and coach key technical staff and guide them to solutions on complex design issues.
- Act as a conduit for questions and information flow when those outside of Engineering have ideas for new technology applications.
- Speak in terms relevant to audience, translating technical concepts into non-technical language and vice versa. Facilitate consensus building while striving for win/win scenarios and elicit value-add contributions from all team members in group settings.
- Maintain a strong sense of business value and return on investment in planning, design, and communication.
- Proactively identify issues, bottlenecks, gaps, or other areas of concern or opportunity and work to either directly affect change, or advocate for that change by working with peers and leadership to build consensus and act.
- Perform critical maintenance, deployment, and release support activities, including occasional off-hours support.
What You'll Bring:
- Bachelor's or master's degree in computer science, Data Science, or a related field.
- 10+ years as a data engineer designing and architecting complex systems.
- 10+ years of experience using RDBMS, SQL, Python, or other programming languages is a plus.
- 5+ years working experience with SQL and familiarity with Snowflake data warehouse, strong working knowledge in stored procedures, CTEs, and UDFs, RBAC.
- Deep understanding of Data warehouse concepts, star, snowflake and dimensional modeling and ETL/ELT best practices, scalability, complex process management, self-healing approaches, etc.
- Strong working knowledge in at-least one of the big data architectures such as Lambda, Kappa and Hub and Spoke Architectures.
- Excellent proficiency in Stream-processing systems like Storm, Spark-Streaming, kafka streaming and building real time data pipelines.
- Proficiency in Container technologies: Docker, and Kubernetes.
- Experience with at least one modern Data pipeline, Replication and processing tools such as Qlik, Fivetran, airflow, Astronomer etc
- Understanding of data security and privacy regulations, with experience implementing data security best practices.
- Ability to define and manage user roles and permissions in Snowflake to ensure data security and privacy.
- Experience in working in a startup-type environment, good team player, and can work independently with minimal supervision.
- Proficient in managing large volumes of data.
- Strong analytical and interpersonal skills, comfortable presenting complex ideas in simple terms.
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Experience in providing technical support and troubleshooting for data-related issues.
- Expertise with at least one cloud environment and building cloud native data services.
- Prior experience driving data governance, quality, security initiatives.
Nice to have:
- 5+ years of building data intensive applications in Java
- Experience with nosql systems such as mongodb, cockroachDb, apache cassandra etc.
- Significant experience with open-source platforms and technologies.
- Experience with data science and machine learning tools and technologies is a plus.
Thrive at BlackLine Because You Are Joining:
- A technology-based company with a sense of adventure and a vision for the future. Every door at BlackLine is open. Just bring your brains, your problem-solving skills, and be part of a winning team at the world's most trusted name in Finance Automation
- A culture that is kind, open, and accepting. It's a place where people can embrace what makes them unique, and the mix of cultural backgrounds and varying interests cultivates diverse thought and perspectives.
- A culture where BlackLiner's continued growth and learning is empowered. BlackLine offers a wide variety of professional development seminars and inclusive affinity groups to celebrate and support our diversity.
BlackLine is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity or expression, race, ethnicity, age, religious creed, national origin, physical or mental disability, ancestry, color, marital status, sexual orientation, military or veteran status, status as a victim of domestic violence, sexual assault or stalking, medical condition, genetic information, or any other protected class or category recognized by applicable equal employment opportunity or other similar laws.
BlackLine recognizes that the ways we work and the workplace itself has shifted. We innovate in a workplace that optimizes a combination of virtual and in-person interactions to maximize collaboration and nurture our culture. Candidates who live within a reasonable commute to one of our offices will work in the office at least 2 days a week.
Salary Range:
USD $201,000.00 - USD $269,000.00
Pay Transparency Statement:
Placement within this range depends upon several factors, including the applicant's prior relevant job experience, skill set, and geographic location. In addition to base pay, BlackLine also offers short-term and long-term incentive programs, based on eligibility, along with a robust offering of benefit and wellness plans.
BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.
-
Principal Data Engineer
1 month ago
Pleasanton, United States BlackLine Full timePrincipal Data EngineerAs a Principal Software Engineer, you will play a crucial role in delivering high quality releases to our customers by defining application architecture, designing, developing, troubleshooting, maintaining, optimizing, and scaling BlackLine’s data platform and driving innovation into our product suite.In this role, you will work with...
-
Principal Data Scientist
2 weeks ago
Pleasanton, United States Society of Exploration Geophysicists Full timeAbout the company Albertsons Companies is at the forefront of the revolution in retail. With a fixation on raising the bar with innovation and building belonging through our culture, our team is rallying our company around a unique purpose: to create joy around each table and inspire a healthier tomorrow for every community.Albertsons Companies is one of the...
-
Senior Data Architect
3 weeks ago
Pleasanton, California, United States BlackLine Full timeJob Title: Principal Data EngineerAbout the Role:We are seeking a highly skilled Principal Data Engineer to join our team at BlackLine. As a Principal Data Engineer, you will play a critical role in designing, developing, and maintaining our enterprise data platform.Responsibilities:Design and develop scalable data architectures to support business growth...
-
Senior Principal Engineer
1 month ago
Pleasanton, California, United States Oracle Full timeJob DescriptionAs part of the Data Services organization, we are chartered to build a net new fully managed OCI Cloud service.The new cloud service will bring together multiple data services under a single pane of glass with a highly evolved user experience, where users can easily implement their use cases.We're looking for a senior engineering leader with...
-
Senior Data Architect
1 month ago
Pleasanton, California, United States Data Piper LLC Full timeData Piper LLC is seeking a highly skilled Senior Data Architect - Databricks Expert to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on Databricks.Key Responsibilities:Design and implement data pipelines using DatabricksCollaborate with cross-functional teams...
-
Principal Data Scientist
4 weeks ago
Pleasanton, California, United States Albertsons Companies Full timeAbout Albertsons CompaniesWe are at the forefront of the retail revolution, with a focus on innovation and building a culture of belonging. Our team is rallying around a unique purpose: to create joy around each table and inspire a healthier tomorrow for every community.As a leading food and drug retailer in the United States, we operate over 2,200 stores in...
-
Data Engineer
3 months ago
Pleasanton, United States Usage AI Full timeNote:No Recruiters Please.Must be in office 5 days / week.Minimum 3+ years of experience.Must come onsite for interview.ResponsibilitiesDesign and develop aggregation data pipelines, data models etc.Write great quality, maintainable code following best practices.Apply analytical skills to solve complex finops problems.Develop efficient data model for storing...
-
Data Engineer
4 months ago
Pleasanton, United States Intelliswift Software Full timeTitle: Data EngineerLocation: Dublin, CA (Onsite role – 4 days/Week)Type: Fulltime with Intelliswift Software Inc.Detailed Job DescriptionWe are seeking a highly skilled Data Analyst with strong analytical skills and the ability to work independently. The ideal candidate will be a self-starter capable of piecing together data to answer complex questions....
-
Senior Principal Engineer
4 weeks ago
Pleasanton, California, United States Oracle Full timeJob SummaryWe are seeking a senior engineering leader with expertise and passion in solving difficult problems in the domain of Data Integration and Data Lake.This is a great opportunity to join a team that's building cloud-native big data services from scratch.Key ResponsibilitiesDrive the architecture, design and development of key features of the Data...
-
Senior Principal Engineer
2 weeks ago
Pleasanton, United States Oracle Full timeAs part of the Data Services organization, we are chartered to build a net new fully managed OCI Cloud service. Since many use cases that customers try to address need more than one data service to be used, today customers must bear the burden of (error prone) IAM policy setup among other things to have functioning applications. The new cloud service will...
-
Junior Data Engineer
1 month ago
Pleasanton, United States Flexon Technologies, INC. Full timeJob DescriptionJob DescriptionJob Description:As a Data Engineer, you will be crucial in designing, building, and maintaining data pipelines and infrastructure. You will work closely with data scientists and analysts to ensure data is accessible, reliable, and optimized for analysis.Key Responsibilities:- Design, develop, and maintain scalable data pipelines...
-
Lead Data Engineer
2 weeks ago
Pleasanton, United States Avathon Full timeJob DescriptionJob DescriptionWho are we and why this opportunity?Avathon, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We...
-
Senior Data Engineer
3 weeks ago
Pleasanton, Kansas, United States SysMind Tech Full timeSenior Data Engineer - Cloud ArchitectureAt SysMind Tech, we are seeking a seasoned Senior Data Engineer - Cloud Architecture to lead our data engineering initiatives. The ideal candidate will have expertise in designing, developing, and supporting complex data engineering projects in the cloud.Main ResponsibilitiesDesign and develop scalable cloud-based...
-
Data Science Architect
4 weeks ago
Pleasanton, Kansas, United States Albertsons Full timeAbout the RoleThe Principal Data Science Architect will be a key technical leader responsible for designing and implementing the data science architecture that underpins our AI and ML modeling capabilities and integration with applications and data pipelines. This person will scale multiple data science models to retail platforms.This role demands a...
-
Pleasanton, United States Workday Full timeYour work days are brighter here. At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our...
-
Pleasanton, California, United States 10X Genomics Full timeJob Title: Data Engineer, Operations Quality Assurance Specialist10x Genomics is seeking a highly skilled and motivated Data Engineer to join our Quality Assurance team within our Operations division. The ideal candidate will have a strong background in data engineering, a passion for life sciences, and the ability to design, develop, and maintain robust...
-
Sr. Software Engineer, Data
4 weeks ago
Pleasanton, United States Blackhawk Network Full timeOverview : We're looking for an experienced Data Engineer to focus on designing, developing, and maintaining key ETL tools . You will collaborate with cross-functional teams to implement & maintain efficient data ingestion, transformation and loading methods. You will raise the bar on technical excellence, show thought leadership, and communicate well...
-
Senior Data Modeling Engineer
2 weeks ago
Pleasanton, United States Ll Oefentherapie Full timeThis position is onsite/hybrid in our Pleasanton, CA office - remote option is not available for this role. Oracle Analytics is used by customers across the world to discover deep insights about their business, improve collaboration around a single view by securely including all relevant data, and increase agility by quickly spotting patterns and powering...
-
Senior Software Engineer
4 weeks ago
Pleasanton, Kansas, United States Oracle Full timeAbout the RoleWe are seeking an experienced Senior Software Engineer to join our team as a Principal Engineer - Cloud Native Development. This role will focus on enhancing and strengthening the story for the native SQL engine for our new converged product.The ideal candidate will have a strong background in software development, with a focus on distributed...
-
Lead Data Architect
1 month ago
Pleasanton, California, United States Avathon Full timeJob Title: Lead Data EngineerAvathon, Inc. is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing complex data pipelines and architectures that drive our AI and analytics platforms.Key Responsibilities:Lead the architecture, design, and...