Senior Data Engineer

1 day ago

Dallas, TX, United States Purple Drive Full time
****************LOCAL ONLY*******************

Role Overview

We are seeking a highly skilled Senior Data Engineer with strong expertise in building scalable, secure, and high-performance data solutions on AWS. The ideal candidate should have hands-on experience with Databricks (DBX), distributed data processing, cloud-native frameworks, and automation using Terraform.

Key Responsibilities

  • Design, develop, and optimize data pipelines on AWS leveraging EMR, EKS, and Databricks.
  • Implement Infrastructure as Code (IaC) using Terraform to automate cloud deployments.
  • Develop scalable solutions using Scala, Python, and Java for big data processing.
  • Integrate structured, semi-structured, and unstructured data sources into the data platform.
  • Collaborate with data scientists, analysts, and application teams to deliver end-to-end solutions.
  • Ensure platform security, reliability, cost optimization, and adherence to best practices.
  • Implement CI/CD pipelines and monitoring for data workflows.
Required Skills

  • AWS Cloud Services: EMR, EKS, S3, IAM, Lambda, Glue, VPC.
  • Databricks (DBX): Delta Lake, Spark, MLflow (nice to have).
  • Programming: Strong proficiency in Scala, Python, Java.
  • Infrastructure as Code (IaC): Terraform (must-have).
  • Data Engineering: Spark, distributed computing, data pipelines, orchestration.
  • DevOps/CI-CD: Git, Jenkins, Docker, Kubernetes (EKS).
  • Strong problem-solving, debugging, and optimization skills.
Nice-to-Have Skills

  • Experience with event-driven architectures (Kafka, Kinesis).
  • Familiarity with data governance, lineage, and security frameworks.
  • Knowledge of Agile methodologies and collaborative development practices.

  • Senior Data Engineer

    2 weeks ago

    Dallas, TX, United States Saviance Full time

    Job Title-Senior Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) About BigRio: BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis,...

  • Senior Data Engineer

    1 week ago

    Dallas, TX, United States Saviance Full time

    Job Title-Senior Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) About BigRio: BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis,...

  • Senior Data Engineer

    2 days ago

    Dallas, TX, United States BravoTECH Full time

    Job DescriptionSenior Data Engineer (Developer) In-office position Salary: Up to $145K Location: Dallas Join Our Innovative MediaLab Team as a Senior Data Engineer Are you passionate about designing cutting-edge data solutions and eager to contribute to a dynamic, collaborative environment? We are seeking a seasoned Senior Data Engineer to join our Shared...

  • Senior Data Engineer

    1 day ago

    Dallas, TX, United States BravoTECH Full time

    Job DescriptionSenior Data Engineer (Developer) In-office position Salary: Up to $145K Location: Dallas Join Our Innovative MediaLab Team as a Senior Data Engineer Are you passionate about designing cutting-edge data solutions and eager to contribute to a dynamic, collaborative environment? We are seeking a seasoned Senior Data Engineer to join our Shared...

  • Senior Data Engineer

    7 days ago

    Dallas, TX, United States CRC GROUP INC Full time

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. If you have a disability and need assistance with the application, you can request a reasonable accommodation. Send an email to Accessibility (accommodation requests only;...

  • Senior Data Engineer

    2 weeks ago

    Dallas, TX, United States Polly Full time

    Who you are: You're a hands on Senior Data Engineer with strong Python skills and experience building robust data pipelines in cloud environments. You enjoy solving complex data problems, working cross-functionally, and building the infrastructure that powers analytics and product development. You're ready to take the next step in your career at a company...

  • Senior Data Engineer

    2 days ago

    Dallas, TX, United States Polly Full time

    Who you are: You're a hands on Senior Data Engineer with strong Python skills and experience building robust data pipelines in cloud environments. You enjoy solving complex data problems, working cross-functionally, and building the infrastructure that powers analytics and product development. You're ready to take the next step in your career at a company...

  • Senior Data Engineer

    5 days ago

    Dallas, TX, United States Accellor Full time

    At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate an...

  • Senior Data Engineer

    2 days ago

    Dallas, TX, United States Accellor Full time

    At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate an...

  • (USA) Senior, Data Engineer

    5 days ago

    Dallas, TX, United States Walmart Full time

    Position Summary... We are seeking an enthusiastic Senior Data Engineer to help build the next generation of data infrastructure at Vizio. This role will develop and maintain core infrastructure critical to optimizing our data systems and platforms. This is an individual contributor position and will report directly to the Manager of Data Engineering. We are...