Senior Data Engineer

2 months ago

San Diego, California, United States AppFolio, Inc Full time
About the Role

We are seeking a highly skilled Sr. Data Engineer to join our growing Data Engineering and Operations team at AppFolio, Inc.

Key Responsibilities
  • Design, build, and operate next-generation data pipeline infrastructure based on Apache Kafka and its ecosystem.
  • Improve data architecture, quality, discoverability, and access policies to enable and enforce data governance.
  • Collaborate with engineers, data analysts, and scientists to ensure that our data infrastructure meets the SLOs of our data-intensive customers.
  • Develop techniques for monitoring the completeness, correctness, and reliability of our data sets.
  • Leverage agile practices, encourage collaboration, prioritization, and urgency to develop at a rapid pace.
  • Research, share, and recommend new technologies and trends.
Requirements
  • Hands-on experience with using Apache Kafka in production and a passion for building a reliable, scalable, and fault-tolerant infrastructure.
  • Hands-on experience with data warehouse technology, particularly with Snowflake.
  • Experience with a variety of data sources, including change data capture systems, event sourcing, and clickstreams, in production.
  • Experience with real-time transformation technologies such as Apache Flink.
  • Care about work-life balance and want your company to care about it too; you'll put in the extra hour when needed but won't let it become a habit.
  • Want to work with a high degree of autonomy, while at the same time working on initiatives of high importance to the company.
Must-Haves
  • 5+ years of experience working with languages like Python or Ruby, Infrastructure as Code, configuration management, and monitoring tools.
  • Proficient in creating consumable tools for platform management.
  • Proficient in tooling orchestration utilizing CICD best practices with tools like CircleCI or Jenkins.
  • Experience with containers and container orchestration tools. Docker and Kubernetes experience.
  • Experience with Kafka, Kafka Connect, and its ecosystem.
  • Experience with AWS primitives (IAM, VPC, RDS, S3, MSK, EKS, etc.).
  • Excellent MySQL operational knowledge.
  • Proficient in RBAC and Data Governance across multiple platforms and ecosystems (AWS, Snowflake, Kafka, etc.).
  • Bachelor's in Computer Science or other quantitative fields.
Nice-to-Haves
  • Experience with Debezium connector is highly desirable.
  • Experience with clickstream tracking technology, e.g. Snowplow, is desirable.
  • Experience with large-scale Data Lakes and Lake Houses, especially with Apache Iceberg is a plus.
  • Background in monitoring and maintaining cost management on the cloud (FinOps).
  • Data science skills for analyzing data and communicating with ML engineers are a plus.
  • Proven mentoring experience to help develop peers.
Compensation & Benefits

The base salary that we reasonably expect to pay for this role is $128,000-$176,000. The actual base salary for this role will be determined by a variety of factors, including but not limited to the candidate's skills, education, experience, etc.

Please note that base pay is one important aspect of a compelling Total Rewards package. The base pay range indicated here does not include any additional benefits or bonuses that you may be eligible for based on your role and/or employment type. Regular full-time employees are eligible for benefits.

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States BRAIN CORP Full time

    Job Title: Senior Data EngineerBRAIN CORP is seeking a highly skilled Senior Data Engineer to lead the development of data-centric products that enhance our innovative BrainOS platform.This individual will be responsible for designing, constructing, and maintaining the systems and infrastructure to facilitate efficient collection, storage, and analysis of...

  • Senior Azure Data Engineer

    3 weeks ago

    San Diego, California, United States Kyocera Full time

    Job Title: Senior Azure Data EngineerAt Kyocera, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data solutions on the Azure platform.Key Responsibilities:Design and implement data architectures for...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States Vets Hired Full time

    About the JobAs a Senior Data Engineer at Vets Hired, you will play a critical role in building quality data pipelines that drive analytic solutions. Your expertise in data architecture, data engineering, and data analysis will enable the organization to advance its data-driven decision-making capabilities.Key ResponsibilitiesDesign, develop, and maintain...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States Lockheed Martin Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Lockheed Martin's Enterprise Business and Digital Transformation organization. As a key member of our Data Engineering development efforts, you will be responsible for delivering full-stack data solutions across the entire data processing pipeline.Key ResponsibilitiesDesign...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States BioPhase Full time

    Position OverviewThe Senior Data Engineer will play a pivotal role in designing, implementing, and maintaining data pipelines that process and analyze large volumes of instrument data, clinical biomarker inputs, and patient information. This role requires a strong technical foundation, experience in startup environments, and the ability to navigate the...

  • Senior Azure Data Engineer

    3 weeks ago

    San Diego, California, United States Kyocera Full time

    Job DescriptionAt Kyocera, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data solutions on the Azure platform.The ideal candidate will have a strong background in data engineering, with experience in...

  • Senior Data Science Engineer

    3 weeks ago

    San Diego, California, United States Intuit Full time

    Job SummaryWe are seeking a highly skilled Senior Machine Learning Engineer to join our team at Intuit. As a key member of our data science team, you will be responsible for designing, developing, and deploying machine learning models at scale using the latest industry tools and technologies.Key Responsibilities:Design and develop machine learning models...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States CoStar Realty Information, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at CoStar Realty Information, Inc. This is a unique opportunity to work on cloud-based data pipelines for machine learning, data processing with Apache Spark, and database development.ResponsibilitiesDesigning, building, testing, and deploying scalable, reusable, and...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States Apple Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Apple. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data solutions that support our software engineering group.Key Responsibilities:Develop and maintain Tableau dashboards and other analytical tools to provide visibility into...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using SQL and Snowflake. You will work closely with our data team to ensure the smooth...

  • Senior Data Solutions Engineer

    2 weeks ago

    San Diego, California, United States Neurocrine Biosciences Full time

    About the Role:We are seeking a highly skilled Senior Data Solutions Engineer to join our team at Neurocrine Biosciences. As a key member of our data operations team, you will be responsible for developing and maintaining platforms, patterns, pipelines, assets, and business intelligence solutions that support cross-functional data operations and...

  • Senior Data Engineer

    3 weeks ago

    San Diego, California, United States AppFolio, Inc Full time

    About the RoleWe are seeking a highly skilled Sr. Data Engineer to join our growing Data Engineering and Operations team at AppFolio, Inc.The successful candidate will design, build, and operate next-generation data pipeline infrastructure based on Apache Kafka and its ecosystem.Key Responsibilities:Design and implement scalable and fault-tolerant data...

  • Senior Data Engineer

    2 weeks ago

    San Jose, California, United States Intelliswift Software Inc Full time

    Job Title: Senior Data EngineerAbout the Role:Intelliswift Software Inc. is seeking a skilled Senior Data Engineer to conceptualize, build, and support the world's most amazing technology products and solutions. As a Senior Data Engineer, you will be responsible for translating business requirements into technical specifications using logical and critical...

  • Senior Software Engineer

    3 weeks ago

    San Diego, California, United States ServiceNow Full time

    Job OverviewServiceNow is seeking a highly skilled Senior Software Engineer - Data Platform to join our Cloud Platform Persistence team. As a key member of this group, you will be responsible for designing and developing scalable and efficient data storage solutions for our customers.Key Responsibilities:Design and implement data storage solutions using...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Webologix Ltd INC Full time

    Role: Senior Data EngineerLocation: Dallas, TX / San Francisco, CA / Seattle, WAType of hiring: FTEJob Overview:We are seeking a highly skilled Senior Data Engineer to join our team at Webologix Ltd/ INC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data engineering solutions on...

  • Senior Data Engineer

    2 weeks ago

    San Diego, California, United States BRAIN CORP Full time

    Job Summary:Brain Corp is a leading AI company that creates transformative core technology for the robotics industry. We are seeking a highly skilled Senior Data Engineer to lead the development of data-centric products that enhance our innovative BrainOS platform.This individual will be responsible for designing, constructing, and maintaining the systems...

  • Senior Data Architect

    3 weeks ago

    San Diego, California, United States NavAide Full time

    Job Summary:NavAide is seeking a highly skilled Senior Data Engineer to lead and manage data engineering initiatives. The ideal candidate will have extensive experience in data architecture, data processing, and analytics solutions. This role is critical for supporting the Navy's mission by ensuring the integrity, availability, and security of data assets....

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States SS&C Technologies Full time

    Job DescriptionSS&C Technologies is seeking a highly skilled Senior Data Engineer to join our team in San Francisco, California. As a Senior Data Engineer, you will be responsible for designing and implementing a leading cloud platform using the latest big data, cloud native, and machine learning technologies.The ideal candidate will have a strong background...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States SoFi Full time

    Shape a Brighter Financial Future with SoFiWe're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals.The industry is going through an unprecedented transformation, and we're at the forefront. We're seeking a highly motivated Senior Software Engineer to join...

  • Senior Data Engineer

    4 weeks ago

    San Diego, California, United States AppFolio, Inc Full time

    About the RoleWe are seeking a highly skilled Sr. Data Engineer to join our growing Data Engineering and Operations team at AppFolio, Inc.Key ResponsibilitiesDesign, build, and operate next-generation data pipeline infrastructure based on Apache Kafka and its ecosystem.Improve data architecture, quality, discoverability, and access policies to enable and...