Lead Databricks Engineer

1 month ago

Iselin, United States Persistent Systems Full time

About Persistent

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum by reporting $328.2M revenue in Q1 FY25, delivering 16% Y-o-Y growth. Our 23,500+ global team members, located in 19 countries, have been instrumental in helping the market leaders transform their industries. We’re also pleased to share that Persistent has been recognized as a Leader in the ISG Provider Lens™ Digital Engineering Services Quadrant Report for the U.S. and Europe 2024. We were also recognized for excellence in governance and executive leadership in Institutional Investor’s 2024 Asia Executive Team Survey. Throughout our market-leading growth, we’ve maintained a strong employee satisfaction score of 8.2/10.


About Position:

Role: Lead Databricks Engineer

Location: Iselin NJ (Hybrid 2-3 days from office)

Experience: 12+



What You'll Do:

Strong knowledge on data bricks architecture and tools

Have experience of task and wf jobs creations in data bricks.

Deep understanding of distributed computing and how to use spark for data processing.

SQL and Pyspark : strong command over querying databases and proficiency in pyspark.

Cloud platform: Preferred Azure for data bricks deployment.

5+ years of experience in data engineering with Databricks and Spark

Proficient in SQL and Python and Pyspark

Experience with Azure Databricks Medallion Architecture with DLT, Iceberg

Financial/Corporate Banking context would be a plus

Experience with data integration and ETL tools, such as Azure Data Factory

Experience with Azure cloud platform and services

Experience with data warehouse and data lake concepts and architectures

Good to have experience with big data technologies, such as Kafka, Hadoop, Hive, et


Expertise You'll Bring:

Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed

Optimize data pipelines for performance, scalability, and reliability

Ensure data quality and integrity throughout the data lifecycle

Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs

Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations

Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management

Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community

Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies


Benefits:

Competitive salary and benefits package

Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications.

Opportunity to work with cutting-edge technologies.

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents


Our company fosters a values-driven and people-centric work environment that enables our employees to:


· Accelerate growth, both professionally and personally

· Impact the world in powerful, positive ways, using the latest technologies

· Enjoy collaborative innovation, with diversity and work-life wellbeing at the core

· Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent - persistent.com/careers

  • Lead Databricks Engineer

    1 month ago

    Iselin, New Jersey, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Senior Data Engineer

    1 week ago

    Iselin, New Jersey, United States Seven Seven Software Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Seven Seven Software. As a key member of our data engineering team, you will be responsible for designing and implementing high-performance data ingestion pipelines using Azure Databricks. Your expertise in building data pipelines using Azure Data Factory and Databricks will...

  • Senior Data Engineer

    2 weeks ago

    Iselin, New Jersey, United States CloudBC Labs Full time

    Job Summary:CloudBC Labs is seeking a highly skilled Senior Data Engineer to lead the design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with a focus on cloud-based...

  • Lead Database Engineer

    2 weeks ago

    Iselin, New Jersey, United States Wells Fargo Full time

    About this RoleWells Fargo is seeking a highly skilled Lead Database Engineer to join our Chief Technology Office (CTO). As a key member of our team, you will be responsible for designing, building, and maintaining databases to meet business needs.You will work closely with cross-functional teams to ensure the integrity, availability, and performance of...

  • ServiceNow with App Engine

    2 weeks ago

    Iselin, United States Lorven Technologies, Inc. Full time

    Job Title: ServiceNow with App Engine Location: Iselin, NJ (Hybrid Mode onsite for 3 days) Duration: 12+months Job Description: Bachelor's degree or equivalent working experience with minimum of 10+ years of IT experience. Required Skills: Lead ServiceNow roadmap, requirements gathering and design sessions in order to provide ServiceNow solutions for...

  • Lead Systems Operations Engineer

    3 weeks ago

    Iselin, New Jersey, United States Wells Fargo Full time

    About This RoleWe are seeking a highly skilled Lead Systems Operations Engineer to join our Commercial and Corporate & Investment Banking Technology (CCIBT) team. As a key member of our team, you will be responsible for leading complex initiatives, providing high-level systems consultation, and collaborating with technical peers to resolve systems support...

  • Senior Data Architect

    5 days ago

    Iselin, New Jersey, United States CloudBC Labs Full time

    Job Title: Senior Data ArchitectJob Summary:CloudBC Labs is seeking a highly skilled Senior Data Architect to design and implement large-scale data solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with experience in Snowflake utilities such as Snow SQL,...

  • ServiceNow Tech Lead with App Engine Expertise

    1 month ago

    Iselin, New Jersey, United States Cays Inc Full time

    Job Title: ServiceNow Tech Lead with App Engine ExpertiseJob Summary:Cays Inc is seeking a highly skilled ServiceNow Tech Lead with expertise in App Engine to lead the conceptualization, design, development, implementation, and maintenance of new and existing features for the existing portfolio of applications for a business area.Key...

  • Senior Software Development Lead

    3 weeks ago

    Iselin, New Jersey, United States Veracity Full time

    Job Title: Lead Software Engineer / Pega EngineerDuration: 12+ MonthsLocation: Hybrid Role (3 Days Onsite/2 Days WFH)Required Qualifications:5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, or education.Certified Pega engineer, CSSA...

  • Electrical Engineer

    1 day ago

    Iselin, United States Futures Consulting Full time

    Job DescriptionJob DescriptionElectrical Project EngineerJob ResponsibilitiesEngineer TasksDesign of electrical systems for a variety of projects.Create plans, schematics, equipment selection, load calculations, systems narratives and specifications, system design and layout, field investigation and construction administration.Perform design work on Revit...

  • Electrical Engineer

    2 weeks ago

    Iselin, New Jersey, United States Mott MacDonald Group Full time

    Electrical Engineer Job DescriptionMott MacDonald Group is seeking an experienced Electrical Engineer to join our team in the Northeast unit. As an Electrical Engineer, you will play a key role in delivering electrical projects for water and wastewater infrastructure.Key Responsibilities:Lead the design of electrical systems for water and wastewater...

  • Principal Geotechnical Engineer

    5 days ago

    Iselin, New Jersey, United States Mott MacDonald Full time

    Mott MacDonald is a leading engineering and advisory consultancy with a strong national presence in transportation and infrastructure, water/wastewater, and energy sectors.We are seeking a highly skilled technical principal engineer to join our Geotechnics Practice and support our current and future infrastructure projects throughout North America.The...

  • Solutions Engineering Leader

    2 weeks ago

    Iselin, New Jersey, United States Cisco Full time

    About the RoleCisco is seeking a highly skilled and experienced Solutions Engineering Leader to join our team. As a key member of our sales engineering organization, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.Key ResponsibilitiesDrive revenue through account planning, resource...

  • ServiceNow Architect App Engine

    5 days ago

    Iselin, New Jersey, United States Lorven Technologies Full time

    Job Summary: We are seeking a highly skilled ServiceNow Architect App Engine to lead our team in delivering exceptional IT service management solutions. The ideal candidate will have a minimum of 12 years of experience in App Engine development, with expertise in ITSM modules, integration, and migrations projects. Key Responsibilities:Design and implement...

  • Lead Java Developer

    1 week ago

    Iselin, New Jersey, United States Genesis Corp dba Genesis10 Full time

    Genesis10 is seeking a Lead Java Developer to join our team in the financial industry. This is a 12+ month contract position.Key Responsibilities: Consult on or participate in moderately complex initiatives and deliverables within Software Engineering Review and analyze moderately complex Software Engineering challenges Contribute to the resolution of...

  • Senior Cloud Software Engineer

    1 week ago

    Iselin, New Jersey, United States JobRialto Full time

    Job Description:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our infrastructure team, you will be responsible for designing, developing, and maintaining our cloud-based middleware infrastructure. Key Responsibilities:Design and implement cloud-based middleware solutions using Java, Spring...

  • Principal Geotechnical Engineer

    4 days ago

    Iselin, New Jersey, United States Mott MacDonald Group Full time

    Mott MacDonald is a multi-disciplined engineering and advisory consultancy, with a significant national presence in the transportation and infrastructure, water/wastewater, energy realm.We are seeking a technical principal engineer to support our current and future infrastructure projects throughout Mott MacDonald's East Unit and beyond.The successful...

  • Senior Cloud Software Engineer

    5 days ago

    Iselin, New Jersey, United States JobRialto Full time

    Job Summary:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our organization, you will be responsible for designing, developing, and deploying cloud-based software applications using Java and React. Your expertise in cloud infrastructure, middleware, and software engineering will be crucial in...

  • ServiceNow with App Engine

    1 week ago

    Iselin, United States Lorven Technologies Inc. Full time

    Our client is looking ServiceNow with App Engine for long term project in Iselin, NJ Below is the detail requirement.Job Title: ServiceNow with App EngineLocation: Iselin, NJ (Hybrid Mode onsite for 3 days)Duration: 12+monthsJob Description: Bachelor’s degree or equivalent working experience with minimum of 10+ years of IT experience.Required Skills:Lead...

  • Solutions Engineering Leader

    2 weeks ago

    Iselin, New Jersey, United States Cisco Full time

    About the RoleCisco is seeking a highly skilled Solutions Engineering Leader to join our team. As a key member of our sales engineering team, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.You will drive revenue through account planning, resource planning, and allocation. You will...