Big Data Engineer
1 month ago
Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.
Job Responsibilities:
- Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application.
- Design, build, install, configure, and support Hadoop (Big Data).
- Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system.
- Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system.
- Deliver functional enhancements to the existing big data applications.
- Provide inputs on solution architecture based on evaluation/understanding of solution alternatives, frameworks, and products.
- Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories (Hadoop, Neo4J, MongoDB, Apache SOLR).
- Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability.
- Participate in designing the data model structured data in RDBMS into a graph database solution and NoSQL database solution.
- Develop near real-time data processing solutions using Kafka and Spark Streaming.
- Participate in designing Spark architecture with Databricks and Structured Streaming.
- Set up Microsoft Azure with Databricks, and Databricks Workspace for business analytics.
- Contribute to the automate build process by using Jenkins and Ansible to achieve continuous integration and continuous deployment.
Master's in Computer Science/Applications, Information Technology/Systems or Electronics/Electrical Engineering + minimum 1 year experience as Big Data Engineer, Data Engineer, Data Engineering Specialist, Data Warehousing Analyst or related occupation.
Must be willing to travel/relocate to anywhere in the US.
Edison, NJ and unanticipated locations throughout US
Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
Candidate Privacy Policy
Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, "Orion," "we" or "us") are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) ("Notice") explains:
- What information we collect during our application and recruitment process and why we collect it;
- How we handle that information; and
- How to access and update that information.
Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
-
Big Data Engineer
4 weeks ago
Edison, United States Orion Innovation Full timeOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Big Data Engineer
4 weeks ago
Edison, United States Orion Innovation Full timeOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Big Data Solutions Architect
2 days ago
Edison, New Jersey, United States Orion Innovation Full timeJob Overview: We are seeking an experienced Big Data Engineer to join our team at Orion Innovation. This is a challenging role that requires a strong background in big data technologies, including Hadoop, Spark, and NoSQL databases. The ideal candidate will have a master's degree in computer science or a related field and at least 1 year of experience as a...
-
Big Data Engineer Professional
3 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Description We are looking for a highly skilled Hadoop Developer Lead to join our team at Vimerse InfoTech Inc in Edison, NJ. This is an onsite position requiring a minimum of 6 to 8 years of IT experience.Responsibilities The successful candidate will be responsible for leading the development and implementation of big data solutions using Hadoop, Hive...
-
Big Data Technology Specialist
3 days ago
Edison, New Jersey, United States Orion Innovation Full timeAbout the Job:We are seeking an experienced Big Data Engineer to join our team at Orion Innovation. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems using Hadoop and Spark.Key Responsibilities:Design and Implement Data Pipelines: Develop and maintain efficient data...
-
Big Data Cloud Architect-Digital
5 months ago
Edison, United States TEPHRA Full timeDescription: Our client's Analytics & Insights (A&I) Services helps organizations to provide insights that enable smart decisions across functions. A&I help organizations in data estate modernizations, in the design of innovative solutions for superior business outcomes and help execute effective data-driven strategies. They help organizations analyze their...
-
Big Data Solutions Expert
3 days ago
Edison, New Jersey, United States TEPHRA Full timeJob Overview:Tephra is seeking a talented Big Data Solutions Expert to join our team. As a key member of our Analytics & Insights (A&I) Services, you will play a critical role in helping organizations provide insights that enable smart decisions across functions.A&I helps organizations modernize their data estate, design innovative solutions for superior...
-
Data Engineer Specialist
3 days ago
Edison, New Jersey, United States Orion Innovation Full timeJob SummaryWe are seeking an experienced Data Engineer Specialist to join our team at Orion Innovation. This role will involve designing and implementing big data pipelines, developing Hadoop batch jobs, and working with clients to elicit architectural requirements.ResponsibilitiesDesign and implement big data pipelines to ingest and process data in...
-
Big Data Solutions Architect
2 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeVimerse InfoTech Inc. is seeking an experienced Big Data Solutions Architect to lead the development of scalable data processing systems. The ideal candidate will have a minimum of 6-8 years of IT experience and possess in-depth knowledge of Unix and proficiency in Hadoop, Hive Concepts, Spark, Scala, and SQL.About the RoleIn this role, you will be...
-
Data Engineering Lead
2 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Title: Big Data EngineerAt Vimerse InfoTech Inc, we are seeking an experienced Big Data Engineer to join our team in Edison, NJ. This role will involve designing, developing, and maintaining large-scale data processing systems.We offer a competitive salary of $120,000 - $150,000 per annum, depending on experience. The ideal candidate should have at least...
-
Big Data Cloud Architect-Digital Specialist
3 weeks ago
Edison, New Jersey, United States TEPHRA Full timeAt TEPHRA, we're seeking a seasoned Big Data Cloud Architect to lead the full lifecycle of our cloud-based solutions. This includes requirements analysis, platform selection, technical architecture design, application development, testing, and deployment in cloud infrastructures.We're looking for someone with advisory and thought leadership skills on...
-
Data Automation Engineer
6 days ago
Edison, New Jersey, United States Wakefern Food Corp. Full timeAbout Wakefern Food Corp.Wakefern Food Corp., the largest retailer-owned cooperative in the United States, supports its co-operative members' retail operations under various banners. As a wholesale business services leader, we help independent retailers compete in a big business world by providing innovative technology, private label development, and...
-
Orion Innovation Data Solutions Expert
3 days ago
Edison, New Jersey, United States Orion Innovation Full timeAbout the Position:We are looking for an experienced Big Data Engineer to join our team at Orion Innovation. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key Responsibilities:Data Pipeline Development: Develop and maintain efficient data pipelines to...
-
Data Scientist Specialist
3 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Description: We are looking for a Senior Big Data Engineer to join our team at Vimerse InfoTech Inc. in Edison, NJ. This is an onsite position. As a key member of our team, you will be responsible for designing and implementing large-scale data processing systems using Hadoop and related technologies. The ideal candidate will have at least 6-8 years of...
-
Data Visualization Engineer
2 days ago
Edison, New Jersey, United States ACI Infotech Full timeData Visualization EngineerWe are seeking a Data Visualization Engineer to join our team at ACI Infotech. As a Data Visualization Engineer, you will be responsible for designing and developing data visualizations, dashboards, and reports using QlikView. Your expertise in data visualization will enable you to create interactive and dynamic visualizations that...
-
Sr.Lead Data Engineer
3 weeks ago
Edison, United States Mindware INC Full timeRole: Sr. Lead Data EngineerVISA: Any VISA (H1B Transfer OK). But Only FTE.Job Title: Sr/Lead Data EngineerLocation: Edison/Montvale, NJLocal to NJ or Relocation.Duration: FTENumber of positions: 1Job Description:A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the...
-
Sr.Lead Data Engineer
7 days ago
Edison, United States Mindware inc Full timeRole: Sr. Lead Data EngineerVISA: Any VISA (H1B Transfer OK). But Only FTE.Job Title: Sr/Lead Data EngineerLocation: Edison/Montvale, NJLocal to NJ or Relocation.Duration: FTENumber of positions: 1Job Description:A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the...
-
Senior Data Engineering Leader
3 days ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob Title: Senior Data Engineering LeaderAbout UsVimerse InfoTech Inc is a leading technology company that specializes in data engineering solutions.Job DescriptionWe are seeking an experienced Senior Data Engineering Leader to lead our data engineering team. The ideal candidate will have 12 years of experience in data modeling, ETL Development, Data...
-
Lead Data Engineer Specialist
2 days ago
Edison, New Jersey, United States Mindware INC Full timeAbout Mindware INC:We are a leading technology company that specializes in data engineering and data warehousing solutions. Our team is passionate about delivering innovative solutions that meet the needs of our clients.What We Offer:A competitive salary ranging from $180,000 to $220,000 per year, depending on experience.A comprehensive benefits package,...
-
Senior Data Engineering Specialist
3 weeks ago
Edison, New Jersey, United States Vimerse InfoTech Inc Full timeJob TitleSenior Data Engineering SpecialistCompany OverviewVimerse InfoTech Inc is a renowned technology firm seeking a seasoned data engineer to spearhead its data architecture initiatives.Salary & BenefitsThe salary for this position is estimated to be around $160,000 - $200,000 per annum, commensurate with experience. Additionally, Vimerse InfoTech Inc...