Sr.Lead Data Engineer
6 days ago
Role: Sr. Lead Data Engineer
VISA: Any VISA (H1B Transfer OK). But Only FTE.
Job Title: Sr/Lead Data Engineer
Location: Edison/Montvale, NJ
Local to NJ or Relocation.
Duration: FTE
Number of positions: 1
Job Description:
A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the client engagements and provide value-added services to their clients. The project currently uses Azure data technologies and Databricks.
About the Job:
We are looking for an experienced professional with at least 6+ years of hands-on experience with Databricks technology.
What Candidates Will Do:
Design, build, and manage scalable data architectures using Databricks and Azure data technologies.
Architect and implement modern data lake house solutions, ensuring seamless data integration, storage, and processing.
Collaborate with cross-functional teams to gather and translate business requirements into effective technical designs.
Ensure data quality and governance practices are implemented throughout the data lifecycle.
Optimize data workflows for performance, reliability, and security using Azure Synapse, Data Factory, and Databricks.
Develop and enforce best practices in data modeling, pipeline design, and storage architecture.
Conduct regular assessments of data systems to identify and address performance bottlenecks or areas for improvement.
Must-Have:
10+ Years of total IT experience in Data engineering and Data warehouse project development.
6+ years of hands-on experience with Azure Databricks and expertise in PySpark & Python development.
Proven expertise in designing and managing scalable data architectures.
6+ years' experience with Azure Synapse, Data Factory, and other Azure data technologies.
8+ years' experience in data modeling,
6+ Years experience with Data pipelines design and implementation, and cloud storage architecture.
Deep understanding of data quality and governance practices, and hands-on with Data quality and governance using Unity catalog or azure purview.
Ability to collaborate with cross-functional teams and translate business requirements into technical designs.
Nice-to-Have:
Familiarity with other modern data processing tools and technologies.
Previous experience in a similar role working with large-scale data systems.
-
Sr.Lead Data Engineer
3 weeks ago
Edison, United States Mindware INC Full timeRole: Sr. Lead Data EngineerVISA: Any VISA (H1B Transfer OK). But Only FTE.Job Title: Sr/Lead Data EngineerLocation: Edison/Montvale, NJLocal to NJ or Relocation.Duration: FTENumber of positions: 1Job Description:A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the...
-
Data Engineer Specialist
3 days ago
Edison, New Jersey, United States Orion Innovation Full timeJob SummaryWe are seeking an experienced Data Engineer Specialist to join our team at Orion Innovation. This role will involve designing and implementing big data pipelines, developing Hadoop batch jobs, and working with clients to elicit architectural requirements.ResponsibilitiesDesign and implement big data pipelines to ingest and process data in...
-
Big Data Engineer
4 weeks ago
Edison, United States Orion Innovation Full timeOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Big Data Engineer
3 weeks ago
Edison, United States Orion Innovation Full timeOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Big Data Engineer
1 month ago
Edison, United States Orion Innovation Full timeOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Data Visualization Engineer
1 day ago
Edison, New Jersey, United States ACI Infotech Full timeData Visualization EngineerWe are seeking a Data Visualization Engineer to join our team at ACI Infotech. As a Data Visualization Engineer, you will be responsible for designing and developing data visualizations, dashboards, and reports using QlikView. Your expertise in data visualization will enable you to create interactive and dynamic visualizations that...
-
Data Engineering Lead
1 day ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Title: Big Data EngineerAt Vimerse InfoTech Inc, we are seeking an experienced Big Data Engineer to join our team in Edison, NJ. This role will involve designing, developing, and maintaining large-scale data processing systems.We offer a competitive salary of $120,000 - $150,000 per annum, depending on experience. The ideal candidate should have at least...
-
Senior Data Engineering Leader
3 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Title: Senior Data Engineering LeaderAbout UsVimerse InfoTech Inc is a leading technology company that specializes in data engineering solutions.Job DescriptionWe are seeking an experienced Senior Data Engineering Leader to lead our data engineering team. The ideal candidate will have 12 years of experience in data modeling, ETL Development, Data...
-
Lead Data Engineer Specialist
1 day ago
Edison, New Jersey, United States Mindware INC Full timeAbout Mindware INC:We are a leading technology company that specializes in data engineering and data warehousing solutions. Our team is passionate about delivering innovative solutions that meet the needs of our clients.What We Offer:A competitive salary ranging from $180,000 to $220,000 per year, depending on experience.A comprehensive benefits package,...
-
Senior Data Engineering Specialist
3 weeks ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob TitleSenior Data Engineering SpecialistCompany OverviewVimerse InfoTech Inc is a renowned technology firm seeking a seasoned data engineer to spearhead its data architecture initiatives.Salary & BenefitsThe salary for this position is estimated to be around $160,000 - $200,000 per annum, commensurate with experience. Additionally, Vimerse InfoTech Inc...
-
Senior Data Solutions Engineer
3 days ago
Edison, New Jersey, United States The Dignify Solutions LLC Full timeJob Title: Senior Data Solutions EngineerWe are seeking an experienced Data Solutions Engineer to join our team at The Dignify Solutions LLC. As a key member of our data engineering group, you will be responsible for designing, developing, and implementing large-scale data pipelines using Informatica Mappings, Workflows, and processes.About the Role:7+ years...
-
Chief Data Engineering Specialist
3 weeks ago
Edison, New Jersey, United States Expeditors Full timeJob OverviewWe are seeking a skilled Senior Data Engineer to join our agile analytics team at Expeditors.The ideal candidate will have extensive experience in designing, developing, and optimizing complex data infrastructure and pipelines. They will play a pivotal role in delivering high-impact reporting, analytics, and machine learning solutions that drive...
-
Data Automation Engineer
5 days ago
Edison, New Jersey, United States Wakefern Food Corp. Full timeAbout Wakefern Food Corp.Wakefern Food Corp., the largest retailer-owned cooperative in the United States, supports its co-operative members' retail operations under various banners. As a wholesale business services leader, we help independent retailers compete in a big business world by providing innovative technology, private label development, and...
-
Data Migration engineer
3 weeks ago
Edison, United States Diverse Lynx Full timeRole: Data Migration engineer Location: - REMOTE Duration : Long Term Hands-on experience of data migration at scale Technical expertise with RDS , MongoDB, ETL Knowledge, skills and expertise with AWS technical expertise with Python, Java specialty pharmacy domain experience Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified...
-
Data Migration engineer
4 weeks ago
Edison, United States Diverse Lynx Full timeRole: Data Migration engineer Location: - REMOTE Duration : Long Term Hands-on experience of data migration at scale Technical expertise with RDS , MongoDB, ETL Knowledge, skills and expertise with AWS technical expertise with Python, Java specialty pharmacy domain experience Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified...
-
Junior Data Scientist Engineer
1 day ago
Edison, New Jersey, United States SynergisticIT Full timeAbout the RoleWe are currently seeking a Junior Data Scientist Engineer to join our data analytics team. In this role, you will work closely with cross-functional teams to design, develop, and deploy machine learning models that drive business growth and improve operational efficiency. As a valuable member of our team, you will have access to cutting-edge...
-
Data Center Mechanical Systems Engineer
3 weeks ago
Edison, New Jersey, United States Synectics Full timeAbout the RoleWe are seeking an experienced and highly skilled Data Center Mechanical Systems Engineer to join our team at Synectics. This is a key position that will be responsible for designing mechanical systems for data center facilities, ensuring reliability, efficiency, and compliance with mission-critical requirements.Key ResponsibilitiesDesign and...
-
Lead Data Engineer
4 weeks ago
Edison, United States Vimerse InfoTech Inc Full timeRole : Lead Data Engineer (This is with our Direct Client) Location : Edison, NJ (Hybrid) Skill Set : • 12 years' industry experience as a Data Engineer with demonstrated experience in data modeling, ETL Development, Data Warehousing, Data Lakes, and/or consolidating data from distributed systems • 2 years' experience building enterprise level batch...
-
Senior Mechanical Engineer
4 weeks ago
Edison, United States Synectics Full timeCompany Overview: Our clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information connectivity through an ever-expanding array of devices, we deliver robust design/build solutions for cloud, colo, datacenter, and edge...
-
Big Data Engineer Professional
3 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Description We are looking for a highly skilled Hadoop Developer Lead to join our team at Vimerse InfoTech Inc in Edison, NJ. This is an onsite position requiring a minimum of 6 to 8 years of IT experience.Responsibilities The successful candidate will be responsible for leading the development and implementation of big data solutions using Hadoop, Hive...