Sr Data Engineer Lead

4 weeks ago

Irving, United States Diverse Lynx Full time
Sr Data Engineer Lead
Onsite - Irving, TX

Perform the Data Engineer activities
Experience 10to14Yrs 4.Required Skills , Hive, PySpark, Cloud Dataproc,
Unix Shell Scripting, GCP

Roles & Responsibilities
  • Analyzes complex data structures from disparate data sources and design large scale data engineering pipeline
  • Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs .
  • Collaborates with product business and data science team to collect user stories and translate into technical specifications
  • Uses knowledge in Cloud & Hadoop architecture, HDFS commands and experience designing & optimizing queries to build data pipelines
  • Uses strong programming skills in PySpark, Python, Java or any of the major languages to build robust data pipelines and dynamic systems
  • Builds highly scalable and extensible data marts and data models to support Data Science and other internal customers on Cloud.
  • Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
  • Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions
  • Experiments with available tools and advice on new tools to determine optimal solution given the requirements dictated by the model/use case Required Qualifications
  • 3+ years of progressively complex related experience in cloud data engineering and data analysis
  • Knowledge in programing languages such as PySpark, Java, Python, Hive, SQL
  • Knowledge in Cloud Technology, Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment
  • Strong knowledge of large-scale search applications and building high volume data pipelines, preferably using Dataproc, composer services on GCP or other Cloud Platforms Preferred Qualifications
  • Ability to leverage multiple tools and programming languages to analyze and manipulate datasets from disparate data sources
  • Ability to understand complex systems and solve challenging analytical problems
  • Experience with bash shell scripts, UNIX utilities & UNIX Commands

Top three skills
  • Pyspark, Java, Python, Hive, SQL
  • Hadoop architecture and commands
  • Dataproc, Composer services on GCP


Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Sr. Data Engineer

    2 weeks ago

    Irving, United States Object Technology Solutions, Inc. Full time

    Object Technology Solutions, Inc (OTSI) has an immediate opening for an Sr. Data Engineer Sr. Data Engineer (Irving, TX)JOB DESCRIPTION:Analyze and understand data sources & APIsDesign and Develop methods to connect & collect data from different data sourcesDesign and Develop methods to filter/cleanse the dataDesign and Develop SQL , Hive queries, APIs to...

  • Sr. Data Engineer

    3 weeks ago

    Irving, United States Addison Group Full time

    Job DescriptionJob DescriptionJob Title: Sr. Data EngineerLocation: Irving, TX 75039Work Model: Onsite Position, no relocation available.Pay Rate: $60-$70/hourConversion Salary Range: $115K-$125KJob Description: We are seeking a Sr. Data Engineer to join our growing team and be a part of an exciting phase of our journey to redesign the data infrastructure....

  • Sr Python Microservices Developer

    5 days ago

    Irving, United States NTT DATA Full time

    Req ID:278251 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Python Microservices Developer to join our team in Irving, Texas (US-TX), United States (US). Job...

  • Lead Data Engineer

    5 days ago

    Irving, United States Resource Informatics Group Inc Full time

    Job DescriptionJob DescriptionPlease help us  with Lead Data engineers with 12+ yrs of exp into ETL.  Ask here is strong Lead who can also do coding, lead the team and take care of Deliverables. Please help us  with Lead Data engineers with 12+ yrs of exp in to ETL.  Ask here is strong Lead who can also do coding, lead the team and take care of...

  • Lead Data Engineer

    4 days ago

    Irving, United States Omega Holdings Full time

    Omega Holdings is a private equity-owned leading distributor of air conditioning and other high demand aftermarket components to a broad range of light-duty and heavy-duty vehicle end markets. Omega has created a unique, market leading platform in the automotive aftermarket with numerous opportunities to apply its repeatable playbook to grow both organically...

  • Sr. Data Engineer(Onsite )_ FULL TIME

    1 week ago

    Irving, United States Prudent Technologies and Consulting, Inc. Full time

    Position : Sr. Data Engineer(Onsite )_ FULL TIMELocation: Irving TexasPosition type: Direct-HireEducation/Experience:BS or MS degree in Computer Science or a related fieldMicrosoft DP-203 certification preferred.5+ years of database architecture and dimensional data modelling2+ years assisting in Master Data Management efforts, including metadata...

  • Sr. Data Engineer(Onsite )_ FULL TIME

    1 week ago

    Irving, United States Prudent Technologies and Consulting, Inc. Full time

    Position : Sr. Data Engineer(Onsite )_ FULL TIMELocation: Irving TexasPosition type: Direct-HireEducation/Experience:BS or MS degree in Computer Science or a related fieldMicrosoft DP-203 certification preferred.5+ years of database architecture and dimensional data modelling2+ years assisting in Master Data Management efforts, including metadata...

  • Sr Data Engineer- Big Data/Python/Databricks

    1 week ago

    Irving, United States OscarMike Full time

    *HYBRID* Sr Data Engineer- Big Data/Python/DatabricksDirect Hire 1099 or W2 only. The client is not offering subcontracting for this position.This role is onsite in Irving, TX. Hybrid schedule, 2 days a week required onsite.[10811-HOLD]We are hiring highly enthusiastic Python/Databricks engineers to create, tune, maintain and build reporting for the Big...

  • Sr Python Microservices Developer

    4 days ago

    Irving, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Python Microservices Developer to join our team in Irving, Texas (US-TX), United States (US). Job Responsibilities:...

  • Sr Python

    4 days ago

    Irving, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Python - Microservices Developer to join our team in Irving, Texas (US-TX), United States (US). Job Duties and...

  • Lead Data Engineer

    4 days ago

    Irving, United States Alcority Full time

    About the Role:The Lead Data Engineer is the senior software engineer in the Business Intelligence and Data Warehousing team. This role develops data ingestion to enable high-value business intelligence products. This is a senior individual contributor role with a focus on hands on development, collaborative problem solving, and mentorship of junior...

  • Lead Data Engineer

    4 days ago

    Irving, United States Alcority Full time

    About the Role:The Lead Data Engineer is the senior software engineer in the Business Intelligence and Data Warehousing team. This role develops data ingestion to enable high-value business intelligence products. This is a senior individual contributor role with a focus on hands on development, collaborative problem solving, and mentorship of junior...

  • Data Engineer

    2 days ago

    Irving, United States NTT DATA Services Full time

    Req ID: 283859  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Python to join our team in Irving, Texas (US-TX), United States (US). Job...

  • Data Engineer

    3 days ago

    Irving, United States NTT DATA Services Full time

    Req ID: 283859 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Python to join our team in Irving, Texas (US-TX), United States (US).Job Responsibilities: -...

  • Data Engineer

    6 hours ago

    Irving, United States NTT DATA Services Full time

    Req ID: 283859 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Python to join our team in Irving, Texas (US-TX), United States (US).Job Responsibilities: -...

  • Sr Python-MS Developer

    5 days ago

    Irving, United States NTT DATA Group Corporation Full time

    Sr Python-MS Developer - 24-00873 1yr Duration Hybrid Onsite in Irving, TX (2-3 Days/Week) W2 Only - Must be able to work Directly with NTTD / NO C2C NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now....

  • Sr Python Microservices Developer

    4 days ago

    Irving, United States NTT DATA Services Full time

    Req ID: 278251  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Python Microservices Developer to join our team in Irving, Texas (US-TX), United States...

  • Sr. Data Engineer

    4 days ago

    Irving, Texas, United States Avaya Full time

    About AvayaBusinesses are built by the experiences they provide, and every day, millions of those experiences are delivered by Avaya. Organizations trust Avaya to provide innovative solutions for some of their most important ambitions and challenges, giving them the freedom to engage their customers and employees in ways that deliver the greatest business...

  • Sr Fullstack Developer

    4 days ago

    Irving, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Fullstack Developer to join our team in Irving, Texas (US-TX), United States (US).Position's General Duties and...

  • Sr Python

    3 days ago

    Irving, United States NTT DATA Services Full time

    Req ID: 278252    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.   We are currently seeking a Sr Python - Microservices Developer to join our team in Irving, Texas (US-TX),...