Data observability Engineer

2 days ago

Charlotte, North Carolina, United States KaffyTech Full time $120,000 - $200,000 per year

About the Role
We are seeking a Data Observability Engineer – Connectors to design, build, and maintain robust integrations between our observability platform and diverse data ecosystems. This role sits at the intersection of data engineering, platform reliability, and product extensibility, ensuring our customers can seamlessly monitor data quality, lineage, and reliability across all their data sources.

You will own the development of connectors that integrate with databases, data warehouses, SaaS platforms, message queues, and modern data stack tools. Your work will directly enable customers to gain end-to-end visibility into their data pipelines and prevent downstream data incidents.

Key Responsibilities
Connector Development & Maintenance

Design, build, and maintain high-performance connectors for databases, warehouses (Snowflake, BigQuery, Redshift), and SaaS sources (Salesforce, Netsuite, Workday, etc.).

Implement real-time and batch ingestion frameworks to support multiple pipeline types.

Ensure extensibility and modularity of connectors to accelerate future integrations.

Data Observability Enablement

Embed data quality metrics (freshness, volume, schema drift, anomalies) into connectors.

Implement hooks for lineage capture, monitoring, and alerting.

Collaborate with data science and platform teams to enrich connectors with ML-based anomaly detection capabilities.

Reliability & Performance

Optimize connectors for scalability, throughput, and fault tolerance in large enterprise environments.

Build resilient retry, logging, and error-handling mechanisms.

Partner with SRE and platform teams to ensure SLA compliance for connector uptime and latency.

Security & Compliance

Implement strong data security and encryption practices in connectors.

Ensure compliance with GDPR, HIPAA, SOC 2, and enterprise governance policies.

Work with InfoSec to address data residency and access controls.

Collaboration

Partner with Product Managers to prioritize connector roadmap based on customer demand.

Work closely with Customer Engineering teams to resolve client issues and implement feedback loops.

Contribute to open-source connector frameworks where applicable (e.g., Airbyte, Singer, DBT adapters).

Required Qualifications
Bachelor's/Master's degree in Computer Science, Data Engineering, or related field.

4+ years of experience in data engineering, integration development, or observability tooling.

Strong coding skills in Python, Java, or Go for connector/integration development.

Deep experience with databases, warehouses, and SaaS APIs (SQL, REST, gRPC, GraphQL).

Familiarity with ETL/ELT pipelines and orchestration frameworks (Airflow, Dagster, Prefect).

Knowledge of streaming platforms (Kafka, Pulsar, Kinesis).

Solid understanding of data quality principles and observability metrics.

Hands-on experience with cloud platforms (AWS, GCP, Azure).

Preferred Qualifications
Experience with open-source connector frameworks (Airbyte, Singer, Meltano).

Familiarity with data observability platforms (Monte Carlo, Metaplane, Bigeye, Databand, Acceldata).

Knowledge of data governance and cataloging tools (Collibra, Alation, Atlan).

Experience building multi-tenant SaaS connectors for enterprise scale.

Contributions to open-source data projects.

Key Attributes
Customer-centric mindset with the ability to translate business needs into technical solutions.

Strong problem-solving and debugging skills for complex distributed systems.

Passion for improving data reliability and enabling trust in enterprise data.

Ability to thrive in a fast-paced, cross-functional environment.

  • Director, Data Engineering

    4 days ago

    Charlotte, North Carolina, United States AssetMark Full time $156,000 - $173,000 per year

    Job Description:AssetMark is a leading strategic provider of innovative investment and consulting solutions serving independent financial advisors. We provide investment, relationship, and practice management solutions that advisors use in helping clients achieve wealth, independence, and purpose.The Director of Data Engineering & Platform Strategy is a...

  • Data Engineer

    3 days ago

    Charlotte, North Carolina, United States Euclid Innovations Full time $120,000 - $200,000 per year

    Cloud Data EngineerCharlotte, NC (3 days/week)Financial Client12 MonthsJob Description:Seeking a Cloud Data Engineer skilled in Python, PySpark, SQL, and enterprise-level data warehousing. Must collaborate effectively with business users and possess business analyst expertise.Major Responsibilities:Build and optimize data pipelines ensuring quality and...

  • Data Engineer

    4 days ago

    Charlotte, North Carolina, United States SMBC Group Full time $122,000 - $205,000 per year

    SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group,...

  • Data Engineer

    4 days ago

    Charlotte, North Carolina, United States ATC Full time $200,000 - $250,000 per year

    Role DescriptionWe are seeking experienced software Data engineers in Charlotte (N.C) with 10+ years of relevant experience to support the design and development of a strategic data platform for investment bank.Role ObjectivesThese roles will be part of the Data Strategy team spanning across the Capital Markets and securities teams, broker-dealer and...

  • Cloud Data Engineer

    4 days ago

    Charlotte, North Carolina, United States Euclid Innovations Full time $120,000 - $180,000 per year

    Cloud Data EngineerLocation: Charlotte, NC12 Months ContractCloud Data Engineer Job Description:This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.Major...

  • Director of Data Engineering

    4 days ago

    Charlotte, North Carolina, United States Brightway Insurance Full time $180,000 - $300,000 per year

    OverviewBrightway is a data-rich insurance franchise with over $1 billion in premium and hundreds of thousands of customers on a significant growth trajectory. As we scale our data capabilities to meet enterprise-grade requirements, we need an experienced Director of Data Engineering to lead our comprehensive data strategy across all platforms and systems....

  • ML Ops Engineer

    3 days ago

    Charlotte, North Carolina, United States NTT DATA North America Full time $120,000 - $200,000 per year

    At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company's growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work...

  • Associate Data Engineer

    3 days ago

    Charlotte, North Carolina, United States AssetMark Full time $95,000 - $107,000 per year

    Job Description:AssetMark is a leading strategic provider of innovative investment and consulting solutions serving independent financial advisors. We provide investment, relationship, and practice management solutions that advisors use in helping clients achieve wealth, independence, and purpose.The Job/What You'll Do:The Associate Data Engineer will play a...

  • Sr. Data Engineer

    4 days ago

    Charlotte, North Carolina, United States INSPYR Solutions Full time

    **Title: Sr. Data EngineerLocation: RemoteJob Summary**We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.Key skills include...

  • Data Platform Engineer

    4 days ago

    Charlotte, North Carolina, United States Centraprise Full time $120,000 - $150,000 per year

    Data Platform EngineerMalvern PA or Charlotte, NC (Onsite)ContractResponsibilitiesData Platform engineers to help us build the AI-ready data platformsQualificationsAWS Step Functions, ETL, Glue, batch processing, S3, Lake Formation, Iceberg, AthenaPythonGithub CI/CD5-8 years software development experienceExperience in optimizing cloud infrastructure for...