Lead Databricks Engineer

2 months ago

Iselin, United States Persistent Systems Full time

About Persistent

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum by reporting $328.2M revenue in Q1 FY25, delivering 16% Y-o-Y growth. Our 23,500+ global team members, located in 19 countries, have been instrumental in helping the market leaders transform their industries. We’re also pleased to share that Persistent has been recognized as a Leader in the ISG Provider Lens™ Digital Engineering Services Quadrant Report for the U.S. and Europe 2024. We were also recognized for excellence in governance and executive leadership in Institutional Investor’s 2024 Asia Executive Team Survey. Throughout our market-leading growth, we’ve maintained a strong employee satisfaction score of 8.2/10.


About Position:

Role: Lead Databricks Engineer

Location: Iselin NJ (Hybrid 2-3 days from office)

Experience: 12+



What You'll Do:

Strong knowledge on data bricks architecture and tools

Have experience of task and wf jobs creations in data bricks.

Deep understanding of distributed computing and how to use spark for data processing.

SQL and Pyspark : strong command over querying databases and proficiency in pyspark.

Cloud platform: Preferred Azure for data bricks deployment.

5+ years of experience in data engineering with Databricks and Spark

Proficient in SQL and Python and Pyspark

Experience with Azure Databricks Medallion Architecture with DLT, Iceberg

Financial/Corporate Banking context would be a plus

Experience with data integration and ETL tools, such as Azure Data Factory

Experience with Azure cloud platform and services

Experience with data warehouse and data lake concepts and architectures

Good to have experience with big data technologies, such as Kafka, Hadoop, Hive, et


Expertise You'll Bring:

Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed

Optimize data pipelines for performance, scalability, and reliability

Ensure data quality and integrity throughout the data lifecycle

Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs

Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations

Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management

Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community

Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies


Benefits:

Competitive salary and benefits package

Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications.

Opportunity to work with cutting-edge technologies.

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents


Our company fosters a values-driven and people-centric work environment that enables our employees to:


· Accelerate growth, both professionally and personally

· Impact the world in powerful, positive ways, using the latest technologies

· Enjoy collaborative innovation, with diversity and work-life wellbeing at the core

· Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent - persistent.com/careers

  • Senior Data Engineer

    3 weeks ago

    Iselin, New Jersey, United States Seven Seven Software Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Seven Seven Software. As a key member of our data engineering team, you will be responsible for designing and implementing high-performance data ingestion pipelines using Azure Databricks. Your expertise in building data pipelines using Azure Data Factory and Databricks will...

  • Data Engineer

    1 day ago

    Iselin, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Senior Data Engineer

    4 weeks ago

    Iselin, New Jersey, United States CloudBC Labs Full time

    Job Summary:CloudBC Labs is seeking a highly skilled Senior Data Engineer to lead the design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with a focus on cloud-based...

  • Lead Database Engineer

    4 weeks ago

    Iselin, New Jersey, United States Wells Fargo Full time

    About this RoleWells Fargo is seeking a highly skilled Lead Database Engineer to join our Chief Technology Office (CTO). As a key member of our team, you will be responsible for designing, building, and maintaining databases to meet business needs.You will work closely with cross-functional teams to ensure the integrity, availability, and performance of...

  • ServiceNow with App Engine

    4 weeks ago

    Iselin, United States Lorven Technologies, Inc. Full time

    Job Title: ServiceNow with App Engine Location: Iselin, NJ (Hybrid Mode onsite for 3 days) Duration: 12+months Job Description: Bachelor's degree or equivalent working experience with minimum of 10+ years of IT experience. Required Skills: Lead ServiceNow roadmap, requirements gathering and design sessions in order to provide ServiceNow solutions for...

  • Senior Data Architect

    3 weeks ago

    Iselin, New Jersey, United States CloudBC Labs Full time

    Job Title: Senior Data ArchitectJob Summary:CloudBC Labs is seeking a highly skilled Senior Data Architect to design and implement large-scale data solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with experience in Snowflake utilities such as Snow SQL,...

  • Senior Software Engineer/Technical Lead

    2 weeks ago

    Iselin, United States New York Technology Partners Full time

    Description: Research and analyze various software's/systems and database tools to identify best technologies for developing software applications in conjunction w/hardware. Participate in multiple phases of project life cycle development including requirement gathering, software design/architecture, development, testing, deployment and support of software...

  • Electrical Engineer

    2 weeks ago

    Iselin, United States Futures Consulting Full time

    Job DescriptionJob DescriptionElectrical Project EngineerJob ResponsibilitiesEngineer TasksDesign of electrical systems for a variety of projects.Create plans, schematics, equipment selection, load calculations, systems narratives and specifications, system design and layout, field investigation and construction administration.Perform design work on Revit...

  • Electrical Engineer

    4 weeks ago

    Iselin, New Jersey, United States Mott MacDonald Group Full time

    Electrical Engineer Job DescriptionMott MacDonald Group is seeking an experienced Electrical Engineer to join our team in the Northeast unit. As an Electrical Engineer, you will play a key role in delivering electrical projects for water and wastewater infrastructure.Key Responsibilities:Lead the design of electrical systems for water and wastewater...

  • Principal Geotechnical Engineer

    3 weeks ago

    Iselin, New Jersey, United States Mott MacDonald Full time

    Mott MacDonald is a leading engineering and advisory consultancy with a strong national presence in transportation and infrastructure, water/wastewater, and energy sectors.We are seeking a highly skilled technical principal engineer to join our Geotechnics Practice and support our current and future infrastructure projects throughout North America.The...

  • Solutions Engineering Leader

    4 weeks ago

    Iselin, New Jersey, United States Cisco Full time

    About the RoleCisco is seeking a highly skilled and experienced Solutions Engineering Leader to join our team. As a key member of our sales engineering organization, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.Key ResponsibilitiesDrive revenue through account planning, resource...

  • ServiceNow Architect App Engine

    3 weeks ago

    Iselin, New Jersey, United States Lorven Technologies Full time

    Job Summary: We are seeking a highly skilled ServiceNow Architect App Engine to lead our team in delivering exceptional IT service management solutions. The ideal candidate will have a minimum of 12 years of experience in App Engine development, with expertise in ITSM modules, integration, and migrations projects. Key Responsibilities:Design and implement...

  • Lead Java Developer

    3 weeks ago

    Iselin, New Jersey, United States Genesis Corp dba Genesis10 Full time

    Genesis10 is seeking a Lead Java Developer to join our team in the financial industry. This is a 12+ month contract position.Key Responsibilities: Consult on or participate in moderately complex initiatives and deliverables within Software Engineering Review and analyze moderately complex Software Engineering challenges Contribute to the resolution of...

  • Senior Cloud Software Engineer

    3 weeks ago

    Iselin, New Jersey, United States JobRialto Full time

    Job Description:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our infrastructure team, you will be responsible for designing, developing, and maintaining our cloud-based middleware infrastructure. Key Responsibilities:Design and implement cloud-based middleware solutions using Java, Spring...

  • Principal Geotechnical Engineer

    3 weeks ago

    Iselin, New Jersey, United States Mott MacDonald Group Full time

    Mott MacDonald is a multi-disciplined engineering and advisory consultancy, with a significant national presence in the transportation and infrastructure, water/wastewater, energy realm.We are seeking a technical principal engineer to support our current and future infrastructure projects throughout Mott MacDonald's East Unit and beyond.The successful...

  • Senior Cloud Software Engineer

    3 weeks ago

    Iselin, New Jersey, United States JobRialto Full time

    Job Summary:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our organization, you will be responsible for designing, developing, and deploying cloud-based software applications using Java and React. Your expertise in cloud infrastructure, middleware, and software engineering will be crucial in...

  • Senior Software Engineering Lead

    2 weeks ago

    Iselin, New Jersey, United States Diverse Lynx Full time

    Role OverviewAt Diverse Lynx LLC, we are seeking a seasoned Technical Lead to spearhead the development of our cutting-edge software solutions. As a key member of our team, you will oversee the design, development, and implementation of complex web applications, leveraging your expertise in Spring Boot, Angular, and microservices.Key ResponsibilitiesLead the...

  • ServiceNow with App Engine

    3 weeks ago

    Iselin, United States Lorven Technologies Inc. Full time

    Our client is looking ServiceNow with App Engine for long term project in Iselin, NJ Below is the detail requirement.Job Title: ServiceNow with App EngineLocation: Iselin, NJ (Hybrid Mode onsite for 3 days)Duration: 12+monthsJob Description: Bachelor’s degree or equivalent working experience with minimum of 10+ years of IT experience.Required Skills:Lead...

  • Solutions Engineering Leader

    4 weeks ago

    Iselin, New Jersey, United States Cisco Full time

    About the RoleCisco is seeking a highly skilled Solutions Engineering Leader to join our team. As a key member of our sales engineering team, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.You will drive revenue through account planning, resource planning, and allocation. You will...

  • Site Reliability Engineer

    4 weeks ago

    Iselin, New Jersey, United States Diverse Lynx Full time

    Job Title: Site Reliability EngineerAbout the Role:At Diverse Lynx LLC, we are seeking a highly skilled Site Reliability Engineer to join our team. As a Site Reliability Engineer, you will play a critical role in ensuring the health and performance of our supporting systems, ensuring that our customer-facing services are available at top performance.Key...