Lead Data Engineer

1 month ago

Plano, United States Insight Global Full time

Location: Plano, TX (Hybrid schedule, 2-3 days/week onsite)

Hours: Must be available to work as early as 6am CT for international meetings

Pay Range: $65-$80/HR


A Fortune 50 client is looking for a Data Engineering Lead to overseeing a data product build and operations around Corporate Social Responsibility and Sustainability data. You will be responsible for driving a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the enterprise Datalake in Azure, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of this client's flagship data products around topics like revenue management, supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. This role will not be hands on; however we are looking for someone who still has the engineering skills to be able to resolve coding issues if needed. The technology stack of this CSR data product build is Azure SQL Datawarehouse, Python, Databricks, and Azure Datalake at a high level. You'll be working in a hybrid environment with in-house, on-premise data sources as well as cloud and remote systems. This position works across this client's enterprise in a global capacity, so we are looking for someone who can lead and collaborate with multiple teams, in addition someone who can present and share proactive updates to executive level leadership. This position is hybrid onsite 2-3 days a week, in Plano, TX and requires someone to be available starting around 6:30/7am CST to work with their data engineers in India and reporting manager in the EU.


-10+ years of overall technology experience that includes at least 8+ years of hands-on software development, data engineering, and systems architecture.

-5-6+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools

-8+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.

-5+ years overall experience in cloud data engineering with at least 2-3 of more recent years of experience in Azure

-Fluent with Azure cloud services -- IaaS/PaaS/SaaS as it relates to data

-4+ years of experience managing and/or scaling team of 5+ engineers

-Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines

-Experience with data quality and data profiling tools like Apache Griffin, Deequ, and/or Great Expectations

-Experience with at least one MPP database technology such as Azure SQL Datawarehouse, Redshift, Synapse or SnowFlake (coding is in Databricks)

-Experience with version control systems like Github and deployment & CI tools

-Experience with Azure Data Factory, Databricks, or Mlflow

-Working knowledge of agile development, including DevOps and DataOps concepts

-Familiarity with business intelligence tools (such as PowerBI).

-BA/BS in Computer Science, Math, Physics, or other technical fields

-Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management

-Strong leadership, organizational and interpersonal skills -- proven track record of leading/mentoring/hiring data teams and fostering a team culture of accountability and self-management

  • Lead Data and Integration Engineer

    1 day ago

    Plano, Texas, United States Magellan Health Full time

    Interested in a Data Engineering role with a progressive healthcare company that's making a difference in the world? Come join us at Magellan Data Engineering tools experience, such as SQL tuning and SQL concepts. AWS Knowledge and Expertise is a highly desirable. Interoperability and FHIR knowledge is essential and would be a large plus Hands-on...

  • Data Engineer

    1 month ago

    Plano, United States Promantus Inc Full time

    Data Engineer Location Plano Texas (Remote until COVID) Duration Long-term Job Description Develops Python/PySpark HQL queries. Develops new data models as necessary with Lead Backend Developer and Architect. Performs data visualization and analysis. Produces data samples for UI/UX Designer. Communicates insights to Architect Lead Backend Developer ...

  • Data Engineer

    1 month ago

    Plano, Texas, United States Promantus Inc Full time

    Data Engineer Location Plano Texas (Remote until COVID) Duration Long-term Job Description Develops Python/PySpark HQL queries. Develops new data models as necessary with Lead Backend Developer and Architect. Performs data visualization and analysis. Produces data samples for UI/UX Designer. Communicates insights to Architect Lead Backend Developer Lead...

  • Lead Software Engineer

    2 days ago

    Plano, United States National Guard Employment Network Full time

    Job Description ATTENTION MILITARY AFFILIATED JOB SEEKERS - Our organization works with partner companies to source qualified talent for their open roles. The following position is available to Veterans, Transitioning Military, National Guard and Reserve Members, Military Spouses, Wounded Warriors, and their Caregivers. If you have the required skill set,...

  • Data engineer

    1 day ago

    Plano, Texas, United States Blueera Technologies Full time

    Job briefWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example you'll create algorithms and conduct statistical analysis. Overall you'll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position you should...

  • Data engineer

    1 hour ago

    Plano, United States Blueera Technologies Full time

    Job briefWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example you’ll create algorithms and conduct statistical analysis. Overall you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position you...

  • Tableau Data Engineer

    4 weeks ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Tableau Data Engineer12+ months contractPlano, TX (Hybrid Tuesdays to Thursdays)Responsibilities:Technology Architecture and IntegrationsDesign end-to-end business analytics solution architectures incorporating cloud, AI, automation, blockchain, data management, integration technologies, and multi-vendor capabilities.Act as a trusted advisor to innovate...

  • Tableau Data Engineer

    4 weeks ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Tableau Data Engineer12+ months contractPlano, TX (Hybrid Tuesdays to Thursdays)Responsibilities:Technology Architecture and IntegrationsDesign end-to-end business analytics solution architectures incorporating cloud, AI, automation, blockchain, data management, integration technologies, and multi-vendor capabilities.Act as a trusted advisor to innovate...

  • Tableau Data Engineer

    5 days ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Tableau Data Engineer 12+ months contract Plano, TX (Hybrid Tuesdays to Thursdays) All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description. Responsibilities: Technology Architecture and Integrations Design end-to-end business analytics solution architectures incorporating cloud,...

  • Lead Software Engineer

    4 weeks ago

    Plano, United States JPMorgan Chase & Co. Full time

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and...

  • Databricks DLT Lead Engineer

    10 hours ago

    Plano, United States CrackaJack Digital Solutions Full time

    Databricks DLT Lead EngineerPlano, TX (Hybrid, 3 Days a week)12 Months *** Local Candidates Highly Preferred** Job Summary: We are seeking an experienced Senior Databricks Engineer to join our team of data professionals. In this role, you will collaborate closely with Data Scientists to prepare and transform large-scale datasets using PySpark, a popular...

  • Data Engineer

    7 hours ago

    Plano, United States Apex Systems Full time

    Data EngineerRate: $70/HRLocation: Plano, TX (Hybrid, Tuesday, Wednesday, Thursday on site)Duration: 6-12 months contract with possibility for extension.Contract Type: W2 (No C2C at this time) Job Description: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering....

  • Senior Manager of Data Engineering

    7 days ago

    Plano, United States JPMorgan Chase Full time

    You have the opportunity to unleash your full potential at a world-renowned company and take the lead in shaping the future of technology.As a Senior Manager of Data Engineering at JPMorgan Chase within the Corporate Sector, Data Services, you serve in a leadership role by providing technical coaching and advisory for multiple technical teams, as well as...

  • Lead Project Engineer

    15 hours ago

    Plano, United States CESO Full time

    CESO, Inc. Lead Project Engineer Pittsburgh , Pennsylvania Apply Now Are you a Civil Lead Project Engineer seeking purpose, challenge, and talented colleagues? With a diverse portfolio of residential, energy, commercial, light industrial and public programs, CESO has the opportunity for you to develop your career. We develop leaders and empower our...

  • AWS Data Engineer

    4 days ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Position: AWS Data EngineerEmployment Type: Contract to HireLocation: Irving, TX (Onsite)Job Responsibilities:Looking for an AWS Data Engineer that has AI understanding and wants to build on this knowledge!Design, build & maintain scalable data pipelines in AWS to ensure their compliance with up-time, security, and privacy.Actively contribute to both data &...

  • AWS Data Engineer

    3 weeks ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Position: AWS Data EngineerEmployment Type: Contract to HireLocation: Irving, TX (Onsite)Job Responsibilities:Looking for an AWS Data Engineer that has AI understanding and wants to build on this knowledge!Design, build & maintain scalable data pipelines in AWS to ensure their compliance with up-time, security, and privacy.Actively contribute to both data &...

  • AWS Data Engineer

    3 weeks ago

    Plano, United States Yoh, A Day & Zimmermann Company Full time

    Position: AWS Data EngineerEmployment Type: Contract to HireLocation: Irving, TX (Onsite)Job Responsibilities:Looking for an AWS Data Engineer that has AI understanding and wants to build on this knowledge!Design, build & maintain scalable data pipelines in AWS to ensure their compliance with up-time, security, and privacy.Actively contribute to both data &...

  • Mid-Senior Data Engineer

    1 week ago

    Plano, United States Ascentt Full time

    Job Summary: We are seeking an experienced Mid-Senior Data Engineer (PySpark Engineer) to join our team of data professionals. In this role, you will collaborate closely with Data Scientists to prepare and transform large-scale datasets using PySpark, a popular open-source Python library for Apache Spark. You will play a crucial role in enabling effective...

  • Mid-Senior Data Engineer

    1 week ago

    Plano, United States Ascentt Full time

    Job Summary: We are seeking an experienced Mid-Senior Data Engineer (PySpark Engineer) to join our team of data professionals. In this role, you will collaborate closely with Data Scientists to prepare and transform large-scale datasets using PySpark, a popular open-source Python library for Apache Spark. You will play a crucial role in enabling effective...

  • Mid-Senior Data Engineer

    1 week ago

    Plano, United States Ascentt Full time

    Job Summary: We are seeking an experienced Mid-Senior Data Engineer (PySpark Engineer) to join our team of data professionals. In this role, you will collaborate closely with Data Scientists to prepare and transform large-scale datasets using PySpark, a popular open-source Python library for Apache Spark. You will play a crucial role in enabling effective...