Big Data Engineer

5 days ago


Jersey City, New Jersey, United States Implify Full time
Company Description

Implify, Inc is a Global IT Solutions and services firm. Since it's inception, Implify, Inc has been providing best-quality and cost-effective IT solutions to fortune 1000 companies, mid-range companies and upcoming companies via its onsite, Offshore and in-house service models.

IMPLIFY is an IT consulting services and software development firm dedicated to business success through long-term relationships with our clients and staff. IMPLIFY has built a dynamic, profitable, service-oriented enterprise, and is positioned to successfully respond to trends and changes in the information technology industry.

Job Description

Job Title: Big Data Engineer / Sr. Engineer
Location: Jersey City NJ
Full Time Permanent

RESPONSIBILITIES

Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you.

• You would be responsible for evaluating, developing, maintaining and testing big data solutions for advanced analytics projects

• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights

• The role would also involve testing various machine learning models on Big Data, and deploying learned models for ongoing scoring and prediction. An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.

QUALIFICATIONS & EXPERIENCE

• 3+ years of demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
Ideally, this would include work on the following technologies:

• Expert-level proficiency in at-least one of Java, C++ or Python (preferred). Scala knowledge a strong advantage.

• Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies -- one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc..

• Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage.

• Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI)

• Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks

• Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works
In addition, the ideal candidate would have great problem-solving skills, and the ability & confidence to hack their way out of tight corners.

Must Have (hands-on) experience:

• Java or Python or C++ expertise

• Linux environment and shell scripting

• Distributed computing frameworks (Hadoop or Spark)

• Cloud computing platforms (AWS).

Desirable (would be a plus):

• Statistical or machine learning DSL like R

• Distributed and low latency (streaming) application architecture

• Row store distributed DBMSs such as Cassandra

• Familiarity with API design

EDUCATION

• B.E/B.Tech in Computer Science or related technical degree

Additional Information

All your information will be kept confidential according to EEO guidelines.


  • Big Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Sonsoft Full time

    Company Description SonSoft Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. SonSoft Inc is growing at a steady pace specializing in the fields of Software Development, Software Consultancy, and Information Technology Enabled Services. Job Description Our Big Data capability team needs hands-on developers who can...

  • Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Derex Technologies Inc Full time

    Company Description Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients...


  • Jersey City, New Jersey, United States JPMorgan Chase Full time

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.Ready to push the limits of what's possible?Join us for a career-defining adventure where your expertise will shape the future of market-leading technology products. As a Lead Software Engineer within our Commercial & Investment Bank Data...

  • Sr. Data Engineer

    2 weeks ago


    Jersey City, New Jersey, United States Verisk Analytics Full time

    DescriptionThe hire will be responsible for expanding and optimizing our data pipeline architecture. The ideal candidate is an experienced data pipeline builder and data wrangler with strong experience in handling data at scale. The Data Engineer will support our software developers, data analysts and data scientists on various data initiatives.This is a...


  • Jersey City, New Jersey, United States Small Arc Inc Full time

    Job Title: Sr. Data EngineerLocation: Jersey City, NJ – Hybrid (3–4 days onsite)Full Time – Visa Independent Candidates OnlySenior Data EngineerWe are seeking a highly skilled Senior Data Engineer with strong experience in building scalable data pipelines, orchestration frameworks, API-driven integrations, and modern DevOps practices. The ideal...


  • Jersey City, New Jersey, United States AIG Full time $134,000 - $168,000

    At AIG, we are reimagining the way we help customers to manage risk. Join us as an Assistant VP, Data Engineering to play your part in that transformation. It's an opportunity to grow your skills and experience as a valued member of the team.Make your mark in Information TechnologyAt AIG, technology is at the heart of everything we do, from underwriting...

  • Data Owner

    3 days ago


    Jersey City, New Jersey, United States Chase Full time

    Description Are you passionate about using data to accelerate product development, drive business growth, and improve Financial Analytics experience? Join us to make a significant impact on our firm's agenda of enabling faster innovation through data.As a Senior Data Owner in the Community & Consumer Banking Finance team, you will play a crucial role in...


  • Jersey City, New Jersey, United States JPMorganChase Full time

    DescriptionWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.Job Summary:As a Sr Lead Software Engineer at JPMorgan Chase within the Wholesale Credit Risk team, you will play a pivotal role in designing and implementing scalable hybrid cloud solutions. You will collaborate with development...


  • Jersey City, New Jersey, United States VySystems Full time

    We are looking for a skilledData Engineer with strong Snowflake expertisewho can also handleproduction supportactivities for data pipelines, ETL workflows, and Snowflake environments. The ideal candidate should have hands-on experience in building and maintaining scalable data solutions along with troubleshooting and resolving production issues in real...


  • Jersey City, New Jersey, United States Bank of America Full time $89,800 - $153,300

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.Being a Great Place to Work is core to how we drive Responsible Growth. This includes our...