Data Engineer

3 weeks ago


Austin, United States Diverse Lynx Full time
Role : Data Engineer
Location: Austin/ Sunnyvale, CA (Onsite)
Contract

Key skills: Python, Kube, Big Data, AlgoCD and AirFlow

* Experience in monitoring and troubleshooting large scale data platforms, data pipelines, complex backend services
* Able to effectively communicate incidents, coordinate incident responses, document/manage runbooks, set up processes to support other software engineering teams and data analysts
* Experience in managing large datasets
* Experience in creating Kubernetes configurations, managing services in Kubernetes, building docker images
* Demonstrate good understanding & troubleshooting Spark jobs
* Experience in developing/maintaining automation tools in programming/scripting languages like Python
* Demonstrate good understanding in Big data eco-systems such as HDFS, Kafka, SQL etc.
* Experience in using IT automation tools such as AlgoCD, and job orchestrator systems such as AirFlow, Jenkins
* Experience in cloud based environment (AWS/GCP etc.) is a big plus.
* Experience in monitoring tools such as Splunk, Prometheus/Grafana is a big plus.
* Experience with Full-Stack web development (React, Django etc.) is a big plus.
Responsibilities

* Support large scale data pipelines and backend services by monitoring and troubleshooting/recovering incidents
* Manage large volume datasets in Spark and Hadoop environments using scripts and automation
* Build and operate data management infra services
* Automate build, deployment, and monitoring
* Participate at an onCall & release turn
* Taking an oncall turn including weekend coverage

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Data Engineer

    2 days ago


    Austin, United States XeoMatrix Full time

    Data Engineer We are currently seeking an experienced data engineer with 5 - 7 years with hands-on data engineering experience. This candidate must possess technical, business analysis, and communication skills. This position offers an opportunity to work directly with clients to design strategic data solutions that help them visualize complex data in a...

  • Data Engineer

    17 hours ago


    Austin, United States XeoMatrix Full time

    Data Engineer We are currently seeking an experienced data engineer with 5 - 7 years with hands-on data engineering experience. This candidate must possess technical, business analysis, and communication skills. This position offers an opportunity to work directly with clients to design strategic data solutions that help them visualize complex data in a...

  • Data Engineer

    15 hours ago


    Austin, Texas, United States Apple Full time

    SummaryPosted: Apr 24, 2024Weekly Hours: 40Role Number: At Apple, we work every day to create products that enrich people's lives Our Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on their devices while helping publishers and developers promote and monetize their work. Today,...

  • Data Engineer

    3 weeks ago


    Austin, United States X-Bow Systems Full time

    Job DescriptionJob DescriptionCompany Overview:X-Bow Launch Systems, Inc. is a cutting-edge aerospace technology company at the forefront of revolutionizing space launch and transportation. With a commitment to innovation and a mission to advance space exploration, we are always on the lookout for talented individuals to join our dynamic team.Location: This...

  • Data Engineer

    7 days ago


    Austin, United States Russell Tobin Full time

    Job DescriptionJob DescriptionLocation: Remote/Prefers someone to work in the central time zonePay Range: $55.00 - 67.00/hour W2Contract Duration: 12+ Potential to extend Summary:Client Commerce Engineering Operations is building next-generation business analytics and decision support capabilities to enable modern, data-driven engineering management and...

  • Data Engineer

    2 weeks ago


    Austin, United States Vaco Full time

    Responsibilities:Assembling mixed sets of data that meet non-functional and functional business requirements.Identifying, designing, and implementing internal process improvements including re-designinginfrastructure for greater scalability, optimizing data delivery, and automating manualprocesses.Building required infrastructure for optimal extraction,...

  • Data Engineer

    2 weeks ago


    Austin, United States Vaco Full time

    Responsibilities:Assembling mixed sets of data that meet non-functional and functional business requirements.Identifying, designing, and implementing internal process improvements including re-designinginfrastructure for greater scalability, optimizing data delivery, and automating manualprocesses.Building required infrastructure for optimal extraction,...

  • Data Engineer

    2 weeks ago


    Austin, United States Vaco Full time

    Responsibilities:Assembling mixed sets of data that meet non-functional and functional business requirements.Identifying, designing, and implementing internal process improvements including re-designinginfrastructure for greater scalability, optimizing data delivery, and automating manualprocesses.Building required infrastructure for optimal extraction,...

  • Data Engineer

    24 hours ago


    Austin, Texas, United States Dealerware Full time

    About Dealerware:Dealerware transforms the automotive retailers of today into the mobility network of tomorrow. Launched in 2016, Dealerware manages tens of thousands of vehicles at dealerships in North America across every major manufacturer brand. Dealerware is committed to being a people-first culture and a great place to work for all, with a remote-first...

  • Data Engineer

    10 hours ago


    Austin, United States Dealerware Full time

    About Dealerware: Dealerware transforms the automotive retailers of today into the mobility network of tomorrow. Launched in 2016, Dealerware manages tens of thousands of vehicles at dealerships in North America across every major manufacturer brand. Dealerware is committed to being a people-first culture and a great place to work for all, with a...

  • Lead Data Engineer

    1 month ago


    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: The Fraud Analytics unit within the Data Reviews Division of the Office of Inspector General (OIG) is responsible for performing innovative and advanced data analytics to detect fraud, waste and abuse in state health and human services programs such as Medicaid, the Childrens Health Insurance Program (CHIP), Supplemental Nutrition...

  • Azure Data Engineer

    1 week ago


    Austin, United States Epicor Inc Full time

    Epicor is seeking a highly skilled Azure Data Engineer to join our dynamic team. As Data Engineer, you will be responsible for overseeing all aspects of our Azure data processing pipelines, including development, implementation, and testing. In addition, you will work closely with our business functions and BI team to identify opportunities to optimize their...

  • Senior Data Engineer

    1 month ago


    Austin, United States Linux Foundation Full time

    Job DescriptionJob DescriptionCompany DescriptionThe Linux Foundation is the organization of choice for the world’s top developers and companies to build ecosystems that accelerate open technology development and commercial adoption. Together with the worldwide open source community, it is solving the hardest technology problems by creating the largest...


  • Austin, United States E-Solutions Full time

    Python Data Engineer Austin, TX (Onsite from day 1)Only Full time no contract Minimum 5+ years of experience as a Data Engineer role.Proven experience in designing, building, and deploying data pipelines in the cloud (ideally GCP).Python API development experienceStrong understanding of data architecture principles and best practices.Expertise in SQL and...


  • Austin, United States E-Solutions Full time

    Python Data Engineer Austin, TX (Onsite from day 1)Only Full time no contract Minimum 5+ years of experience as a Data Engineer role.Proven experience in designing, building, and deploying data pipelines in the cloud (ideally GCP).Python API development experienceStrong understanding of data architecture principles and best practices.Expertise in SQL and...

  • Python Data Engineer

    11 hours ago


    Austin, United States E-Solutions Full time

    Python Data Engineer Austin, TX (Onsite from day 1)Only Full time no contract Minimum 5+ years of experience as a Data Engineer role.Proven experience in designing, building, and deploying data pipelines in the cloud (ideally GCP).Python API development experienceStrong understanding of data architecture principles and best practices.Expertise in SQL and...


  • Austin, United States E-Solutions Full time

    Python Data Engineer Austin, TX (Onsite from day 1)Only Full time no contract Minimum 5+ years of experience as a Data Engineer role.Proven experience in designing, building, and deploying data pipelines in the cloud (ideally GCP).Python API development experienceStrong understanding of data architecture principles and best practices.Expertise in SQL and...


  • Austin, United States MyFitnessPal Full time

    At MyFitnessPal, we believe health starts with what you eat. We provide tools, resources and support to enable users to reach their health goals. The Marketing team at MyFitnessPal collaborates with all business units to help drive our business forward and help our users achieve their goals. We are looking for a Data Engineering Manager to join the...

  • Senior Data Engineer

    2 weeks ago


    Austin, United States MVP Group Inc Full time

    Job DescriptionJob DescriptionAbout MVP:Headquartered in the heart of Austin, Texas, MVP is the best-in-class SaaS measurement platform that provides omnichannel media and sponsorship valuation. We offer a built-to-scale software for our clients - Fortune 1,000 brands, professional sports, global agencies and media, to accurately quantify the value of their...

  • Sr Data Engineer

    1 day ago


    Austin, Texas, United States Horizontal Talent Full time

    Join our dynamic team as we seek a Senior Data Engineer with a focus on finance to bolster our client's Data and Analytics division. This role offers an exhilarating chance to contribute to the evolution and modernization of analytics We're on the lookout for individuals with exceptional communication skills, adept at engaging with stakeholders at all levels...