Databricks Lead

3 days ago


Reston, Virginia, United States LTIMindtree Full time

About Us:

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit our website.

Job Title: Databricks Lead

Work Location: Hybrid – Onsite

Required Experience: 10+ Years

Job Description:

  • The individual is highly skilled and experienced Databricks expert to design and development of end-to-end data products.
  • This job will require expertise in developing and building data products in Databricks using PySpark.
  • The candidate will have a strong background in data engineering and a deep understanding of cloud data stacks and a proven track record of delivering robust and scalable data solutions.

Key Responsibilities:

  • Lead the design, development, and deployment of data products on the Databricks platform.
  • Implement, maintain, and optimize complex data pipelines to process large amounts of structured and unstructured datasets.
  • Proficient in Databricks Lakehouse and Apache Spark Framework, highly skilled in Python, PySpark, and SQL.
  • Experienced in developing data solutions on cloud platforms, preferably AWS.
  • Establish and advocate for best practices in data engineering principles and standards, including code quality, data validation, governance, and security controls.
  • Closely collaborate and engage with business stakeholders and product owners to prepare and coordinate data sharing, conduct workshops, and ensure data products developed meet business needs and provide actionable insights.
  • Mentor and guide junior data engineers, providing technical leadership and expertise.
  • Comfortable in Agile Processes.
  • Problem-solving skills and hands-on attitude, and strong interpersonal and communication skills.

Tools and Technologies:

  • Extensive experience with Databricks solutions, PySpark, Spark SQL, and cloud data platforms, preferably AWS Cloud.
  • Strong fundamental knowledge of ETL Processes, Data warehousing, Data Lakes, and Data Modeling.
  • Proficiency in working with AWS or Azure cloud platforms, including services like S3, Lambda, Glue, Azure Data Lake, Azure SQL Data Warehouse, etc.
  • Hands-on experience with version control systems, Git, Bitbucket, and CICD pipelines.
  • Excellent problem-solving skills and ability to troubleshoot complex data issues.
  • Experience working with Agile methodologies, Scrum, Kanban.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Requirements:

  • Databricks, PySpark, Python, Data Management, ETL Design.
  • Basic knowledge on Alteryx tools.
  • Atlassian Tools, JIRA, Confluence.
  • Agile Scrum methodology.

Soft Skills:

  • Process Oriented.
  • Excellent verbal and written communication skills, including communicating technical issues to non-technical audiences and presentation skills.
  • Experience with team management.

Benefits and Perks:

  • Comprehensive Medical Plan Covering Medical, Dental, Vision.
  • Short Term and Long-Term Disability Coverage.
  • 401(k) Plan with Company match.
  • Life Insurance.
  • Vacation Time, Sick Leave, Paid Holidays.
  • Paid Paternity and Maternity Leave.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.

Safe return to office:

In order to comply with LTIMindtree's company COVID-19 vaccine mandate, candidates must be able to provide proof of full vaccination against COVID-19 before or by the date of hire. Alternatively, one may submit a request for reasonable accommodation from LTIMindtree's COVID-19 vaccination mandate for approval, in accordance with applicable state and federal law, by the date of hire. Any request is subject to review through LTIMindtree's applicable processes.



  • Reston, Virginia, United States Programmers Full time

    Job Title: Lead Databricks EngineerWe are seeking a highly skilled Lead Databricks Engineer to join our team at Programmers. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Databricks.Key Responsibilities:Design and implement data governance solutions...


  • Reston, Virginia, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...


  • Reston, Virginia, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive...


  • Reston, Virginia, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive...


  • Reston, Virginia, United States Capgemini Full time

    Job Title: Test Automation LeadJob Summary:Capgemini is seeking a highly skilled Test Automation Lead to join our team. The ideal candidate will have experience in Robot Framework, Agile Functional testing, and Test Automation, with a strong background in Azure Data Factory, Databricks, and ETL tools.Key Responsibilities:Design and implement test automation...

  • Lead Data Engineer

    4 weeks ago


    Reston, Virginia, United States Yoh Full time

    Job SummaryWe are seeking a highly skilled Lead Data Engineer to join our team in a hybrid role. As a Lead Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure Data Factory, Databricks, and other related technologies.Key ResponsibilitiesDesign and develop new data pipelines leveraging...

  • Data Engineer Lead

    3 weeks ago


    Reston, Virginia, United States Cruxito Tech Full time

    About Cruxito TechWe are a team of skilled coders, creators, and problem solvers who work to solve complex issues our clients face. Our diverse skills and perspectives enable us to transform the way data, systems, and ingenuity are used to help our clients advance in a constantly evolving world.Our team thrives on the unknown and enjoys tackling our clients'...

  • SAP Data Engineer

    6 days ago


    Reston, Virginia, United States IS&T IT Services Full time

    Job Title: SAP Data EngineerWe are seeking an experienced SAP Data Engineer to join our team at IS&T IT Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines, ETL/ELT processes, and data integration workflows using Azure Data Factory, Azure Synapse Analytics, Spark SQL, and...

  • Data Engineer

    3 days ago


    Reston, Virginia, United States Murphy & Associates, Inc. Full time

    Data Engineer - Integration SpecialistMurphy & Associates, Inc. is seeking a highly skilled Data Engineer to join our team as an Integration Specialist. As a key member of our Data Services team, you will play a lead role in the design, development, and implementation of data integration solutions using Databricks, Oracle, and other...

  • Cloud Data Architect

    4 weeks ago


    Reston, Virginia, United States Hexaware Technologies Full time

    Unlock Your Potential at HexawareAre you a data engineering expert looking for a new challenge? Do you have a passion for cloud-based solutions and a desire to lead innovative projects? Look no further than Hexaware Technologies, where we empower our team members to achieve their full potential and drive growth.As a Cloud Data Architect at Hexaware, you will...


  • Reston, Virginia, United States Apt Full time

    Apt is seeking a seasoned Senior Project Manager to lead our hybrid team in Birmingham, AL.We value our contractors' well-being and offer comprehensive health, dental, and vision insurance, as well as 401k matching to support their financial future.About the Role:We are looking for an experienced Senior Project Manager with a proven track record in managing...

  • Data Architect Lead

    1 week ago


    Reston, Virginia, United States Alldus Full time

    About Alldus:We are a cutting-edge biotech startup focused on drug discovery, building on years of world-class research from the co-founders as well as top academic institutions in cellular stress. To that end, we are developing new custom robotic high-throughput wet-lab(s) integrated with AI-powered software solutions.About the Role:We are looking for an...

  • Data Architect

    3 days ago


    Reston, Virginia, United States CitiusTech Full time

    About the RoleCitiusTech is seeking a highly skilled Data Architect to join our team. As a key member of our Agile team, you will be responsible for designing and architecting scalable, high-performance, and cost-effective cloud-based solutions using AWS services and Databricks.Key ResponsibilitiesDesign and implement data pipelines that handle large-scale...

  • Lead Java Developer

    3 days ago


    Reston, Virginia, United States ATC Full time

    Job Title: Lead Java DeveloperATC is seeking a highly skilled Lead Java Developer to join our team. As a key member of our development team, you will be responsible for designing, developing, and maintaining complex computer systems using Java.Key Responsibilities:Design and develop well-structured, testable code using Spring MVC, Hibernate framework, and...


  • Reston, Virginia, United States Davenport Resourcing Limited Full time

    Senior Insurance Lead Job DescriptionKey Responsibilities:Act as the primary liaison between senior client management and company Senior Leadership.Develop and maintain client relationships, driving business growth by offering tailored Analytics and Actuarial solutions.Collaborate with client leadership to translate business challenges into actionable...


  • Reston, Virginia, United States Alldus Full time

    About Alldus:We are a cutting-edge biotech startup focused on drug discovery, building on years of world-class research from the co-founders as well as top academic institutions in cellular stress. To that end, we are developing new custom robotic high-throughput wet-lab(s) integrated with AI-powered software solutions.About the Role:We are seeking an...


  • Reston, Virginia, United States Mondo Full time

    Job Title: AI Big Data EngineerJob SummaryMondo is seeking a highly skilled AI Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines, data lakes, and platforms to support analytics and business intelligence.Key ResponsibilitiesDesign and implement...

  • Data Engineer

    3 weeks ago


    Reston, Virginia, United States Harmonia Holdings Group, LLC Full time

    Job Title: Data Engineer - MongoDB ExpertHarmonia Holdings Group, LLC is a leading federal government contractor committed to delivering innovative solutions to our clients. We are seeking a highly skilled Data Engineer - MongoDB Expert to join our team.Responsibilities:Design and implement MongoDB data models and schemas for real-time event-driven...


  • Reston, Virginia, United States Atlas Full time

    Job DescriptionAtlas is seeking a highly skilled Technical Delivery Lead to drive the delivery of technical solutions in our Clinical Trial Management System domain.Key Responsibilities:Lead the development of a robust BI data model layer for reporting, working closely with business stakeholders and IT teams.Drive the data relation conversation for reporting...


  • Reston, Virginia, United States Visionaire Partners Full time

    Senior Data ScientistThis is an exciting opportunity to contribute to the development of innovative AI solutions for a global technology and services company that is a leader in its industry.Key Responsibilities:Analyze large and complex datasets to uncover patterns, trends, and insights that can improve business performance and decision-making.Develop...