Senior Data Engineer, Platform Engineering

1 month ago

New York, United States Stack Overflow Full time
Job DescriptionJob Description

Every developer has a tab open on Stack Overflow.

We are one of the most popular websites in the world - a community-based space focused on increasing productivity, decreasing cycle times, accelerating time to market, and protecting institutional knowledge.

Innovation is at the heart of everything we do. We embrace collaboration, transparency, and believe in leading with empathy; creating an environment where every Stacker knows they belong. We embrace that the unique contributions and points of view of all Stackers contribute to our success.

We are a Best Company to Work For, in addition to being recognized for Best Company Leadership, Best Company Happiness, Best Company Perks and Benefits, Best Company Work-Life Balance, Best Company Compensation, and Best Company Outlook.

We are a remote-first company with Hiring HUBs based in the US, Canada, UK, and Germany.

The Data Platform team at Stack Overflow builds and maintains the data processing and analytic pipelines that democratize access to data across our organization. Your cross-functional team will optimize flow and collection of all of our product and business data, enabling data at scale for Stack Overflow. You'll ensure that our data delivery architecture is optimized and consistent, enabling software engineers, database architects, data analysts, and data scientists to do their best work. Data engineers have several key responsibilities:

  • Create and maintain optimal data pipeline architecture to extract, transform, and load data from a wide variety of data sources using SQL and Azure "big data" technologies
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Keep our data separated and secure across national boundaries through multiple data centers and Azure regions
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader

Skills and Requirements

We expect to see:

  • 5+ years experience building and optimizing "big data" pipelines, architectures, and data sets
  • 5+ years working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of database platforms
  • 5+ years working with Python
  • Strong analytic skills related to working with free-form text
  • 5+ years experience building processes supporting data transformation, data structures, metadata, dependencies, and workload management
  • A track record of leading and mentoring less experienced developers. You are eager to teach others and invested in the growth of your team.
  • Self-motivating, self-directing, and a great communicator (written and oral). You thrive in an environment that grants you a lot of autonomy to explore creative solutions.
  • Excellent problem solving skills. You excel at analyzing and solving problems using technology.
  • Living and working within GMT-7:00 (US) to GMT+2:00 (Europe) time zones.

We like to see (but not required):

  • Experience with Microsoft technologies and Azure cloud services for building and operating data pipelines
  • Experience working remotely and/or working with teams that are distributed geographically.
  • Experience with Agile methodologies such as Scrum, XP, or Kanban. Certification is a plus, but not a requirement.
  • An active Stack Overflow profile, open source code, example projects that you're proud of (whether open source or worked on at a previous job), or any other evidence of your passion for building great software.
  • Knowledge of how Stack Overflow works from our blog, podcasts, and other public artifacts. Ideas about how to evolve the platform and increase our impact on the developer community are even better.
  • Experience with leveraging cloud-native technologies and techniques to build product ecosystems

What you'll get in return:

  • Competitive Base Salary
  • Generous paid vacation
  • Generous parental leave (16 weeks at 100% pay), family care leave, and unlimited sick days
  • Equity (RSUs) for all employees at all levels
  • Industry-leading health benefits that are applicable per country of residence for all our full-time employees
  • Company-paid Life Insurance
  • Home Internet stipend
  • Professional allocation for your growth and development
  • One-time allowance to assist with your home office setup
  • Company-paid access to Calm, Bravely, LinkedIn Learning, MyAcademy and Overdrive

Stack Overflow is proud to be an equal opportunity workplace. We value diversity, inclusion, equity and belonging and these pillars are at the heart of how we work together here at Stack. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

For individuals based in California, and other locations where required, we will consider employment qualified applicants with arrest and conviction records.

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    1 month ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Software Engineer

    2 weeks ago

    New York, United States Informa PLC Full time

    Job Description Curinos is currently seeking a  Senior Software Engineer  to join the Data Platforms group. This team owns the shared data ecosystems upon which our B2B SaaS applications are built. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data platform is integral to our product...

  • Senior Data Engineer

    2 months ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Platform Engineer

    4 weeks ago

    New York, United States Nationstaff Full time

    Company Description Over the last twenty years, our company has completely revolutionized the fixed-income market by creating a single platform using proprietary technology that connects the world's most influential financial institutions. Today, more than 1,800 institutional investors and broker-dealer firms rely on us to bring them accurate market data to...

  • Senior platform engineer

    3 weeks ago

    New York, United States Writer Corporation Full time

    ????? About Writer AI your people will love. That's our vision, and it contains multitudes :-) AI your people will love. We're filling a big need for generative AI built ground-up for the needs of enterprises and embraced by their teams. As generative AI became a board-level initiative almost overnight for most enterprises, our market matured...

  • Senior platform engineer

    3 weeks ago

    New York, United States Writer Corporation Full time

    ????? About Writer Writer is the full-stack generative AI platform delivering transformative ROI for the worlds leading enterprises. Named one of the top 50 companies in AI by Forbes, Writer empowers hundreds of customers like Accenture, Intuit, LOreal, and Vanguard to transform the way they work. Our all-in-one solution makes it easy to deploy customized...

  • Senior Software Engineer

    1 month ago

    New York, United States Curinos Full time

    Curinos is the leading provider of data, technologies and insights that enable financial institutions to make better, and more profitable, data-driven decisions faster. Born out of the combination of two familiar industry powerhouses, Novantas and Informa’s FBX business, Curinos brings to market a new level of industry expertise across deposits, lending...

  • Senior Software Engineer

    3 weeks ago

    New York, United States Curinos Full time

    Curinos is the leading provider of data, technologies and insights that enable financial institutions to make better, and more profitable, data-driven decisions faster. Born out of the combination of two familiar industry powerhouses, Novantas and Informa’s FBX business, Curinos brings to market a new level of industry expertise across deposits, lending...

  • Senior Software Engineer

    7 days ago

    New York, United States Curinos Full time

    Curinos is the leading provider of data, technologies and insights that enable financial institutions to make better, and more profitable, data-driven decisions faster. Born out of the combination of two familiar industry powerhouses, Novantas and Informa’s FBX business, Curinos brings to market a new level of industry expertise across deposits, lending...

  • Senior Data Engineer

    5 days ago

    New York, United States Perchwell Full time

    Who We Are Perchwell is the premier workflow software and data platform for real estate professionals and consumers. Based on the industry's foundational data, Perchwell builds a modern software suite to empower real estate professionals to do their best work, provide differentiated service to their clients, and grow their businesses. Backed by Founders...

  • Senior Data Engineer

    4 weeks ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    3 weeks ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Platform Engineer

    3 weeks ago

    New York, United States Resonance Full time

    We are seeking senior platform engineers to join a pioneering fashion technology startup. We empower sustainable and valuable fashion brands with our cloud-based platform, ONE. We are the canvas upon which the future of the $3T fashion industry will be painted, its operating system. We are reimagining it and rebuilding from the ground up! At Resonance we are...

  • Senior Platform Engineer

    1 month ago

    New York, United States Resonance Companies Full time

    We are seeking senior platform engineers to join a pioneering fashion technology startup. We empower sustainable and valuable fashion brands with our cloud-based platform, ONE. We are the canvas upon which the future of the $3T fashion industry will be painted, its operating system. We are reimagining it and rebuilding from the ground up!At Resonance we are...

  • Senior Data Engineer

    2 days ago

    New York, United States Perchwell Full time

    Who We Are Perchwell is the premier workflow software and data platform for real estate professionals and consumers. Based on the industry's foundational data, Perchwell builds a modern software suite to empower real estate professionals to do their best work, provide differentiated service to their clients, and grow their businesses. Backed by Founders...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Forsyth Barnes Full time

    Position: Senior Data EngineerSalary: up to $180,000Industry: RetailLocation: Remote, USWe are currently partnered with a global organization on their search for a Senior Data Engineer. The Data Engineer will play a critical role in engineering of data solutions that support reporting and analytic needs. As a key member of the Data engineering team, will...

  • Senior Systems Engineer

    1 month ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...