Sr. Software Engineer

Today, through BHN’s single global platform, businesses of all kinds can tap into the world’s largest network of branded payment solutions. BHN helps businesses grow revenue, increase loyalty, motivate and reward their teams, disburse funds and engage consumers. Branded payment solutions include the issuance and distribution of gift cards, egifts, corporate payouts and rewards, along with the technology to deliver these products in seamless, integrated ways. BHN’s network spans the globe with more than 400,000 consumer touchpoints. Learn more at BHN.com.

We are seeking a highly motivated and experienced Senior Software Engineer to join our Platform Engineering team. This role is ideal for someone passionate about building scalable observability platforms, integrating real-time metrics pipelines, and working with time-series databases to drive system reliability and performance insights.As a key contributor, you will design and implement core observability infrastructure, collaborate across engineering teams, and help shape the future of our metrics and monitoring ecosystem. We’re looking for someone with a strong sense of ownership, a hunger to solve complex problems, and the ability to work both independently and collaboratively. 

• Architect, build, and maintain observability platforms using tools such as Prometheus, Grafana, OpenTelemetry, InfluxDB, and AWS CloudWatch.
• Design and implement real-time metrics pipelines and time-series data processing systems.
• Develop scalable APIs and services to expose observability data to internal teams.
• Integrate observability tooling into CI/CD pipelines and service deployment workflows.
• Collaborate with SRE, DevOps, and application teams to embed observability best practices across the SDLC.
• Define and implement SLIs/SLOs, alerting strategies, and performance dashboards.
• Troubleshoot complex distributed systems and contribute to reducing MTTD and MTTR.
• Stay current with emerging observability technologies and advocate for their adoption.

• Bachelor's degree in Information Technology, Computer Science, or related field; or equivalent experience.
• 6+ years of experience in software engineering, platform engineering, or SRE roles.
• Deep expertise in observability tools and practices (e.g., Prometheus, Grafana, OpenTelemetry, Splunk, Coralogix).
• Strong programming skills in Python or similar languages.
• Experience with real-time systems, metrics collection, and time-series databases (e.g., InfluxDB, AWS Timestream).
• Proficiency with AWS services, especially CloudWatch, Lambda, and related infrastructure.
• Familiarity with infrastructure as code (Terraform, CloudFormation) and container orchestration (Kubernetes).
• Solid understanding of distributed systems, microservices, and event-driven architectures.
• Excellent communication skills and a collaborative mindset.

• Familiarity with APM tools and distributed tracing.
• Contributions to open-source observability projects.

• Work on mission-critical systems that power global-scale platforms.
• Collaborate with a passionate and high-performing team.
• Influence the direction of observability and metrics strategy across the company.
• Enjoy flexibility with remote or hybrid work options.

If you're a builder at heart with a passion for observability and a drive to make systems more reliable and transparent, we’d love to hear from you.

We seek candidates who not only demonstrate curiosity and adaptability in emerging technologies but have also successfully implemented and utilized AI tools to enhance their work, improve processes, or deliver measurable results.  Our teams embrace continuous learning and the thoughtful integration of AI to create meaningful impact – for our employees and the future of work.

Pay is based on several factors including but not limited to education, work experience, certifications, etc. In addition to your salary, Blackhawk Network offers benefits including 401k with employer match, medical, dental, vision, 12 paid holidays throughout the year 2025, sick pay accrual according to state law, parental leave, life insurance, disability insurance, accident and illness insurance, health and dependent care flexible spending accounts, wellness benefits, and flexible time off for all full-time employees. 

Blackhawk Network provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.  Blackhawk Network believes that diversity leads to strength. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

Blackhawk Network encourages applicants with previous criminal records to apply to all positions and, pursuant to the San Francisco and Los Angeles Fair Chance Acts (and other “Fair Chance” laws), Blackhawk Network will consider for employment qualified applicants with arrest and conviction records. For Philadelphia applicants or jobs, please see a copy of Philadelphia’s ordinance on this topic by clicking this link: https://codelibrary.amlegal.com/codes/philadelphia/latest/philadelphia_pa/0-0-0-280104.