Lead Databricks Engineer
2 months ago
About Persistent
We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.
Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum by reporting $328.2M revenue in Q1 FY25, delivering 16% Y-o-Y growth. Our 23,500+ global team members, located in 19 countries, have been instrumental in helping the market leaders transform their industries. We’re also pleased to share that Persistent has been recognized as a Leader in the ISG Provider Lens™ Digital Engineering Services Quadrant Report for the U.S. and Europe 2024. We were also recognized for excellence in governance and executive leadership in Institutional Investor’s 2024 Asia Executive Team Survey. Throughout our market-leading growth, we’ve maintained a strong employee satisfaction score of 8.2/10.
About Position:
Role: Lead Databricks Engineer
Location: Iselin NJ (Hybrid 2-3 days from office)
Experience: 12+
What You'll Do:
Strong knowledge on data bricks architecture and tools
Have experience of task and wf jobs creations in data bricks.
Deep understanding of distributed computing and how to use spark for data processing.
SQL and Pyspark : strong command over querying databases and proficiency in pyspark.
Cloud platform: Preferred Azure for data bricks deployment.
5+ years of experience in data engineering with Databricks and Spark
Proficient in SQL and Python and Pyspark
Experience with Azure Databricks Medallion Architecture with DLT, Iceberg
Financial/Corporate Banking context would be a plus
Experience with data integration and ETL tools, such as Azure Data Factory
Experience with Azure cloud platform and services
Experience with data warehouse and data lake concepts and architectures
Good to have experience with big data technologies, such as Kafka, Hadoop, Hive, et
Expertise You'll Bring:
Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
Optimize data pipelines for performance, scalability, and reliability
Ensure data quality and integrity throughout the data lifecycle
Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies
Benefits:
Competitive salary and benefits package
Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications.
Opportunity to work with cutting-edge technologies.
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Our company fosters a values-driven and people-centric work environment that enables our employees to:
· Accelerate growth, both professionally and personally
· Impact the world in powerful, positive ways, using the latest technologies
· Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
· Unlock global opportunities to work and learn with the industry’s best
Let’s unleash your full potential at Persistent - persistent.com/careers
-
Senior Data Engineer
3 weeks ago
Iselin, New Jersey, United States Seven Seven Software Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Seven Seven Software. As a key member of our data engineering team, you will be responsible for designing and implementing high-performance data ingestion pipelines using Azure Databricks. Your expertise in building data pipelines using Azure Data Factory and Databricks will...
-
Data Engineer
1 day ago
Iselin, United States Synechron Full timeWe areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...
-
Senior Data Engineer
4 weeks ago
Iselin, New Jersey, United States CloudBC Labs Full timeJob Summary:CloudBC Labs is seeking a highly skilled Senior Data Engineer to lead the design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with a focus on cloud-based...
-
Lead Database Engineer
4 weeks ago
Iselin, New Jersey, United States Wells Fargo Full timeAbout this RoleWells Fargo is seeking a highly skilled Lead Database Engineer to join our Chief Technology Office (CTO). As a key member of our team, you will be responsible for designing, building, and maintaining databases to meet business needs.You will work closely with cross-functional teams to ensure the integrity, availability, and performance of...
-
ServiceNow with App Engine
4 weeks ago
Iselin, United States Lorven Technologies, Inc. Full timeJob Title: ServiceNow with App Engine Location: Iselin, NJ (Hybrid Mode onsite for 3 days) Duration: 12+months Job Description: Bachelor's degree or equivalent working experience with minimum of 10+ years of IT experience. Required Skills: Lead ServiceNow roadmap, requirements gathering and design sessions in order to provide ServiceNow solutions for...
-
Senior Data Architect
3 weeks ago
Iselin, New Jersey, United States CloudBC Labs Full timeJob Title: Senior Data ArchitectJob Summary:CloudBC Labs is seeking a highly skilled Senior Data Architect to design and implement large-scale data solutions on Snowflake Cloud Data Warehouse. The ideal candidate will have a strong background in data warehousing, data modeling, and data engineering, with experience in Snowflake utilities such as Snow SQL,...
-
Senior Software Engineer/Technical Lead
2 weeks ago
Iselin, United States New York Technology Partners Full timeDescription: Research and analyze various software's/systems and database tools to identify best technologies for developing software applications in conjunction w/hardware. Participate in multiple phases of project life cycle development including requirement gathering, software design/architecture, development, testing, deployment and support of software...
-
Electrical Engineer
2 weeks ago
Iselin, United States Futures Consulting Full timeJob DescriptionJob DescriptionElectrical Project EngineerJob ResponsibilitiesEngineer TasksDesign of electrical systems for a variety of projects.Create plans, schematics, equipment selection, load calculations, systems narratives and specifications, system design and layout, field investigation and construction administration.Perform design work on Revit...
-
Electrical Engineer
4 weeks ago
Iselin, New Jersey, United States Mott MacDonald Group Full timeElectrical Engineer Job DescriptionMott MacDonald Group is seeking an experienced Electrical Engineer to join our team in the Northeast unit. As an Electrical Engineer, you will play a key role in delivering electrical projects for water and wastewater infrastructure.Key Responsibilities:Lead the design of electrical systems for water and wastewater...
-
Principal Geotechnical Engineer
3 weeks ago
Iselin, New Jersey, United States Mott MacDonald Full timeMott MacDonald is a leading engineering and advisory consultancy with a strong national presence in transportation and infrastructure, water/wastewater, and energy sectors.We are seeking a highly skilled technical principal engineer to join our Geotechnics Practice and support our current and future infrastructure projects throughout North America.The...
-
Solutions Engineering Leader
4 weeks ago
Iselin, New Jersey, United States Cisco Full timeAbout the RoleCisco is seeking a highly skilled and experienced Solutions Engineering Leader to join our team. As a key member of our sales engineering organization, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.Key ResponsibilitiesDrive revenue through account planning, resource...
-
ServiceNow Architect App Engine
3 weeks ago
Iselin, New Jersey, United States Lorven Technologies Full timeJob Summary: We are seeking a highly skilled ServiceNow Architect App Engine to lead our team in delivering exceptional IT service management solutions. The ideal candidate will have a minimum of 12 years of experience in App Engine development, with expertise in ITSM modules, integration, and migrations projects. Key Responsibilities:Design and implement...
-
Lead Java Developer
3 weeks ago
Iselin, New Jersey, United States Genesis Corp dba Genesis10 Full timeGenesis10 is seeking a Lead Java Developer to join our team in the financial industry. This is a 12+ month contract position.Key Responsibilities: Consult on or participate in moderately complex initiatives and deliverables within Software Engineering Review and analyze moderately complex Software Engineering challenges Contribute to the resolution of...
-
Senior Cloud Software Engineer
3 weeks ago
Iselin, New Jersey, United States JobRialto Full timeJob Description:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our infrastructure team, you will be responsible for designing, developing, and maintaining our cloud-based middleware infrastructure. Key Responsibilities:Design and implement cloud-based middleware solutions using Java, Spring...
-
Principal Geotechnical Engineer
3 weeks ago
Iselin, New Jersey, United States Mott MacDonald Group Full timeMott MacDonald is a multi-disciplined engineering and advisory consultancy, with a significant national presence in the transportation and infrastructure, water/wastewater, energy realm.We are seeking a technical principal engineer to support our current and future infrastructure projects throughout Mott MacDonald's East Unit and beyond.The successful...
-
Senior Cloud Software Engineer
3 weeks ago
Iselin, New Jersey, United States JobRialto Full timeJob Summary:We are seeking a highly skilled Senior Cloud Software Engineer to join our team at JobRialto. As a key member of our organization, you will be responsible for designing, developing, and deploying cloud-based software applications using Java and React. Your expertise in cloud infrastructure, middleware, and software engineering will be crucial in...
-
Senior Software Engineering Lead
2 weeks ago
Iselin, New Jersey, United States Diverse Lynx Full timeRole OverviewAt Diverse Lynx LLC, we are seeking a seasoned Technical Lead to spearhead the development of our cutting-edge software solutions. As a key member of our team, you will oversee the design, development, and implementation of complex web applications, leveraging your expertise in Spring Boot, Angular, and microservices.Key ResponsibilitiesLead the...
-
ServiceNow with App Engine
3 weeks ago
Iselin, United States Lorven Technologies Inc. Full timeOur client is looking ServiceNow with App Engine for long term project in Iselin, NJ Below is the detail requirement.Job Title: ServiceNow with App EngineLocation: Iselin, NJ (Hybrid Mode onsite for 3 days)Duration: 12+monthsJob Description: Bachelor’s degree or equivalent working experience with minimum of 10+ years of IT experience.Required Skills:Lead...
-
Solutions Engineering Leader
4 weeks ago
Iselin, New Jersey, United States Cisco Full timeAbout the RoleCisco is seeking a highly skilled Solutions Engineering Leader to join our team. As a key member of our sales engineering team, you will be responsible for providing technical direction, business mentorship, and leadership to our operation sales team.You will drive revenue through account planning, resource planning, and allocation. You will...
-
Site Reliability Engineer
4 weeks ago
Iselin, New Jersey, United States Diverse Lynx Full timeJob Title: Site Reliability EngineerAbout the Role:At Diverse Lynx LLC, we are seeking a highly skilled Site Reliability Engineer to join our team. As a Site Reliability Engineer, you will play a critical role in ensuring the health and performance of our supporting systems, ensuring that our customer-facing services are available at top performance.Key...