Big Data Engineer

1 week ago

Edison, United States Orion Innovation Full time

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Job Responsibilities:

  • Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application.
  • Design, build, install, configure, and support Hadoop (Big Data).
  • Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system.
  • Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system.
  • Deliver functional enhancements to the existing big data applications.
  • Provide inputs on solution architecture based on evaluation/understanding of solution alternatives, frameworks, and products.
  • Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories (Hadoop, Neo4J, MongoDB, Apache SOLR).
  • Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability.
  • Participate in designing the data model structured data in RDBMS into a graph database solution and NoSQL database solution.
  • Develop near real-time data processing solutions using Kafka and Spark Streaming.
  • Participate in designing Spark architecture with Databricks and Structured Streaming.
  • Set up Microsoft Azure with Databricks, and Databricks Workspace for business analytics.
  • Contribute to the automate build process by using Jenkins and Ansible to achieve continuous integration and continuous deployment.
Requirements:

Master's in Computer Science/Applications, Information Technology/Systems or Electronics/Electrical Engineering + minimum 1 year experience as Big Data Engineer, Data Engineer, Data Engineering Specialist, Data Warehousing Analyst or related occupation.

Must be willing to travel/relocate to anywhere in the US.

Edison, NJ and unanticipated locations throughout US

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, "Orion," "we" or "us") are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) ("Notice") explains:
  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

  • Big Data Engineer

    3 weeks ago

    Edison, United States Orion Innovation Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Big Data Engineer

    1 week ago

    Edison, United States Orion Innovation Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Big Data Cloud Architect-Digital

    4 months ago

    Edison, United States TEPHRA Full time

    Description: Our client's Analytics & Insights (A&I) Services helps organizations to provide insights that enable smart decisions across functions. A&I help organizations in data estate modernizations, in the design of innovative solutions for superior business outcomes and help execute effective data-driven strategies. They help organizations analyze their...

  • Big Data Cloud Architect-Digital Specialist

    7 days ago

    Edison, New Jersey, United States TEPHRA Full time

    At TEPHRA, we're seeking a seasoned Big Data Cloud Architect to lead the full lifecycle of our cloud-based solutions. This includes requirements analysis, platform selection, technical architecture design, application development, testing, and deployment in cloud infrastructures.We're looking for someone with advisory and thought leadership skills on...

  • Senior Electrical or Mechanical Engineer

    3 months ago

    Edison, United States BRUNS-PAK Data Center Solutions Full time

    Job Title: Senior Electrical or Mechanical Engineer (Contract) - Data Center FacilitiesJob Type: Contract. On-Site in Edison, NJ.Company Overview:BRUNS-PAK helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information...

  • Sr.Lead Data Engineer

    3 days ago

    Edison, United States Mindware INC Full time

    Role: Sr. Lead Data EngineerVISA: Any VISA (H1B Transfer OK). But Only FTE.Job Title: Sr/Lead Data EngineerLocation: Edison/Montvale, NJLocal to NJ or Relocation.Duration: FTENumber of positions: 1Job Description:A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the...

  • Sr. Mechanical Engineer

    3 months ago

    Edison, United States BRUNS-PAK Data Center Solutions Full time

    Job Title: Senior Mechanical Engineer (P.E.) - Data Center FacilitiesJob Type: Full-time. On-Site in Edison, NJCompany Overview:BRUNS-PAK is a New Jersey based data center engineering firm that helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by...

  • Sr. Electrical Engineer

    4 months ago

    Edison, United States BRUNS-PAK Data Center Solutions Full time

    Job Title: Senior Electrical Engineer (P.E.) - Data Center Facilities Job Type: Full-time. On-Site in Edison, NJCompany Overview:BRUNS-PAK helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information connectivity through an...

  • Senior Data Engineering Specialist

    5 days ago

    Edison, New Jersey, United States Vimerse InfoTech Inc Full time

    Job TitleSenior Data Engineering SpecialistCompany OverviewVimerse InfoTech Inc is a renowned technology firm seeking a seasoned data engineer to spearhead its data architecture initiatives.Salary & BenefitsThe salary for this position is estimated to be around $160,000 - $200,000 per annum, commensurate with experience. Additionally, Vimerse InfoTech Inc...

  • Chief Data Engineering Specialist

    2 days ago

    Edison, New Jersey, United States Expeditors Full time

    Job OverviewWe are seeking a skilled Senior Data Engineer to join our agile analytics team at Expeditors.The ideal candidate will have extensive experience in designing, developing, and optimizing complex data infrastructure and pipelines. They will play a pivotal role in delivering high-impact reporting, analytics, and machine learning solutions that drive...

  • Data Migration engineer

    1 week ago

    Edison, United States Diverse Lynx Full time

    Role: Data Migration engineer Location: - REMOTE Duration : Long Term Hands-on experience of data migration at scale Technical expertise with RDS , MongoDB, ETL Knowledge, skills and expertise with AWS technical expertise with Python, Java specialty pharmacy domain experience Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified...

  • Data Migration engineer

    1 week ago

    Edison, United States Diverse Lynx Full time

    Role: Data Migration engineer Location: - REMOTE Duration : Long Term Hands-on experience of data migration at scale Technical expertise with RDS , MongoDB, ETL Knowledge, skills and expertise with AWS technical expertise with Python, Java specialty pharmacy domain experience Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified...

  • BigData Engineer

    4 days ago

    Edison, United States Vimerse InfoTech Inc Full time

    Role : Big data engineer Location : Edison, NJ( Onsite) Skills: Hadoop, Hive Concepts, Spark, Scala, Sql, Unix Job Description: Min 6 to 8 Year experience of IT experience Must Have Skillset : Hadoop, Hive Concepts, Spark, Scala, Sql, Unix Should have strong knowledge of Unix

  • Data Center Mechanical Systems Engineer

    7 days ago

    Edison, New Jersey, United States Synectics Full time

    About the RoleWe are seeking an experienced and highly skilled Data Center Mechanical Systems Engineer to join our team at Synectics. This is a key position that will be responsible for designing mechanical systems for data center facilities, ensuring reliability, efficiency, and compliance with mission-critical requirements.Key ResponsibilitiesDesign and...

  • BigData Engineer

    3 weeks ago

    Edison, United States Vimerse InfoTech Inc Full time

    Role : Big data engineer Location : Edison, NJ( Onsite) Skills: Hadoop, Hive Concepts, Spark, Scala, Sql, Unix Job Description: Min 6 to 8 Year experience of IT experience Must Have Skillset : Hadoop, Hive Concepts, Spark, Scala, Sql, Unix Should have strong knowledge of Unix

  • Lead Data Engineer

    1 week ago

    Edison, United States Vimerse InfoTech Inc Full time

    Role : Lead Data Engineer (This is with our Direct Client) Location : Edison, NJ (Hybrid) Skill Set : • 12 years' industry experience as a Data Engineer with demonstrated experience in data modeling, ETL Development, Data Warehousing, Data Lakes, and/or consolidating data from distributed systems • 2 years' experience building enterprise level batch...

  • Senior Electrical or Mechanical Engineer

    4 weeks ago

    Edison, NJ, United States BRUNS-PAK Data Center Solutions Full time

    Job Title: Senior Electrical or Mechanical Engineer (Contract) - Data Center FacilitiesJob Type: Contract. On-Site in Edison, NJ.Company Overview:BRUNS-PAK helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information...

  • Data Automation Architect

    2 months ago

    Edison, United States Wakefern Food Corp. Full time

    About Wakefern Wakefern Food Corp. is the largest retailer-owned cooperative in the United States and supports its co-operative members' retail operations, trading under the ShopRite®, Price Rite®, The Fresh Grocer®, Dearborn Markets®, and Gourmet Garage® banners. Employing an innovative approach to wholesale business services, Wakefern focuses on...

  • Senior Mechanical Engineer

    1 week ago

    Edison, United States Synectics Full time

    Company Overview: Our clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information connectivity through an ever-expanding array of devices, we deliver robust design/build solutions for cloud, colo, datacenter, and edge...

  • Data Center Engineer

    5 days ago

    Edison, New Jersey, United States Leaseweb Full time

    Leaseweb USA is a dynamic and international team, always looking for talented professionals to join us. Our company overview focuses on Customer Satisfaction. We strive to give our customers royal treatment. The role of the Data Center Operations Engineer is involved in the daily management of our 9 data center facilities throughout the US.We are currently...