Data Engineer II

1 day ago

Atlanta, GA, United States Cinc Inc Full time

Data Engineer II

Reports to: Team Lead

Overview:

The Data Engineer II will architect and implement data systems at TruBase. This role focuses on designing distributed data processing systems, optimizing data pipelines, and ensuring system reliability at scale.

Essential Behaviors & Activities:

  1. Build distributed data systems
    1. Design for fault tolerance Balance consistency and availability requirements
    2. Scale processing across multiple instances
  2. Implement database solutions
    1. Recommend appropriate database technologies based on workloads
    2. Design efficient schemas and indices
    3. Optimize query patterns and data access
  3. Build efficient and correct ETL pipelines
    1. Design high-throughput data flows
    2. Implement data transformation logic
    3. Monitor pipeline performance and correctness
    4. Ensure data integrity across systems
  4. Troubleshoot performance issues
    1. Profile system bottlenecks
    2. Analyze memory, CPU, and network usage
    3. Implement distributed tracing
  5. Advance technical capabilities
    1. Be familiar with emerging technologies
    2. Implement proof-of-concepts
    3. Document architectural decisions
    4. Mentor junior engineers


Competencies and Experience:

Core Competencies
  • Distributed systems knowledge (idempotence, consistency, consensus)
  • Understand how databases work (B+-trees vs LSMs, columnar vs. row storage, storage tiering)
  • Performance debugging and profiling practices and tools (strace, py-spy, flamegraphs)
  • Memory access/usage, IO, and CPU usage optimization
  • Data transformation and aggregation at scale
  • Experience with log-based distributed streaming systems (Kafka, Pulsar, Kinesis)
  • Experience with relational and columnar databases (Postgres, Redshift, Clickhouse, Dynamo)
  • Advanced language skills (Python, TypeScript)
  • Container orchestration (Kubernetes)
  • CI/CD for data pipelines
Desirable Technical Experience
  • Experience with lower level lang
  • Understanding of codecs and compression (JSON, Protobuf, FlatBuffers)
  • AWS cloud architecture
  • Data governance implementation
Measurables
  • System reliability and scalability
  • Query and pipeline performance improvements
  • Architecture quality
  • Technical documentation clarity
  • Knowledge sharing effectiveness
Other Information:

Supervisory Responsibility: This position has no direct reports.

Position Type/Expected Hours of Work
  • This is a full-time position; days and hours of work are Monday through Friday, 40 hours a week.
  • (Hybrid, Atlanta Area - 2 Days/Week in Office)
  • Work Authorization:Applicants must be legally authorized to work in the United States for any employer. We are unable to provide visa sponsorship (e.g., H-1B, OPT extensions) at this time.


This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

  • Data Engineer

    2 weeks ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 day ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Manager II, Data Engineering

    2 days ago

    Atlanta, GA, United States Kroll Full time

    Job Description At Kroll, our professionals combine analytical rigor, deep market insight, and independence to deliver defensible analysis and practical solutions. We think globally, act with transparency, and encourage our people to do the same. Join our collaborative and supportive environment, where your work makes a real impact, this is the Kroll...

  • Data Scientist II

    1 week ago

    Atlanta, GA, United States Amazon Full time

    Description Employer: Amazon.com Services LLC Position: Data Scientist II Location: Atlanta, GA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult...

  • Data Scientist II

    2 weeks ago

    Atlanta, GA, United States Amazon Full time

    Description Employer: Amazon.com Services LLC Position: Data Scientist II Location: Atlanta, GA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult...

  • Data Scientist II

    1 week ago

    Atlanta, GA, United States Amazon Full time

    Description Employer: Amazon.com Services LLC Position: Data Scientist II Location: Atlanta, GA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult...

  • Data Scientist II

    22 hours ago

    Atlanta, GA, United States Amazon Full time

    Description Employer: Amazon.com Services LLC Position: Data Scientist II Location: Atlanta, GA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult...

  • Data Engineer II

    7 days ago

    Atlanta, GA, United States Travelers Insurance Full time

    Who Are We? Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 170 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what...

  • Data Engineer II

    5 days ago

    Atlanta, GA, United States Travelers Insurance Full time

    Who Are We? Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 170 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what...