Senior Bigdata Developer

4 weeks ago

Jersey City, United States CareerBuilder Full time

Role: Senior Big Data Engineer
Location : NJ (hybrid)
Experience : 8+ Year
Duration : 12+ months

Job Description:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and Delta Lake will be essential in driving the success of our data initiatives.
Qualifications :

Master's degree in Computer Science, Data Science, or a related field.
Minimum of 3 years of professional experience in data engineering,

working with Java, Python, Spark, and big data technologies.
Strong programming skills in Java and Python, with expertise in building scalable and maintainable code.
Proven experience in Spark cluster management, optimization, and performance tuning.
Solid understanding of data science concepts and experience working with data scientists and analysts.
Proficiency in SQL and experience with relational databases (e.g: Snowflake, Delta Tables).
Experience in designing and developing REST APIs using frameworks such as Flask or Spring.
Familiarity with cloud-based data platforms (e.g: Azure)
Experience with data warehousing concepts and tools (e.g: Snowflake, BigQuery) is a plus.
Strong problem-solving and analytical skills, with the ability to tackle complex data engineering challenges.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.

Responsibilities:

Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions.
Manage and optimize Spark clusters to ensure high performance and reliability.
Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling.
Develop and maintain data models and schemas to support data integration and analysis.
Implement data quality and validation checks to ensure accuracy and consistency of data.
Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption.
Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues.
Stay updated with the latest technologies and trends in big data, data engineering, data science, and REST API development, and provide recommendations for process improvements.
Mentor and guide junior team members, providing technical leadership and sharing best practices.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr

  • Bigdata Developer

    1 month ago

    Texas City, United States TNSS Full time

    Design build and configure applications to meet business process and application requirements. Responsible for developing and work on project enhancements using Aws Hadoop Hive Spark Kafka flume Cassandra Oracle Java and Python. work with client leads to understand the requirements and work on sprints. AWS BigData (P4 - Expert) Core Java EE Design...

  • Senior Developer Java

    1 month ago

    Jersey City, United States QData Full time

    Required Skills - GemFire Cache EMS/Solace or Kafka Messaging services. Strong experiences in implementation of the following technologies Java J2EE Spring framework H Fully hands-on with Unix/Linux troubleshooting multi-threaded applications continuous development and deployment.Desired Skills - Working knowledge of BigData is a plus Decent...

  • Senior Developer Java

    4 weeks ago

    Jersey City, New Jersey, United States QData Full time

    Required Skills GemFire Cache EMS/Solace or Kafka Messaging services. Strong experiences in implementation of the following technologies Java J2EE Spring framework H Fully hands-on with Unix/Linux troubleshooting multi-threaded applications continuous development and deployment.Desired Skills Working knowledge of BigData is a plus Decent experience and...

  • Senior SQL Developer

    6 hours ago

    Delaware City, United States Diverse Lynx Full time

    Job Title : Senior SQL Developer - MS SQL Server 2019 & T-SQL Location-Delaware, Charlotte, NC Type- Permanen t JD: Must Have Technical/Functional Skills • Primary Skills: o T-SQL: Experience in MS SQL Server 2019 o Scripting: Shell Scripting o Database Tuning and Optimization Experience Required :10+ Years Roles & Responsibilities •...

  • Developer (Senior)

    4 weeks ago

    Jersey City, United States ZAR IT Solutions Full time

    Job DescriptionJob DescriptionACTUAL JOB TITLE: Senior Quantitative Analyst We are looking for a consultant to join the Quantitative Risk Management group (“QRM”), which is responsible for quantitative model development and performance assessment including model performance monitoring (“MPM”) and backtesting (“BT”).The consultant will support the...

  • Senior Database And Report Developer

    1 month ago

    Jersey City, New Jersey, United States Mastech Inc Full time

    Role: Senior Database and Report DeveloperSenior Database and Report Developer10+ years of hands-on experience as a Business Objects and/or Power BI developer.Excellent Knowledge of Business Objects or Power BI.Business Objects developerOracle/SQL Server database developer.Bachelor's degree in Computer Science, Electrical/Electronic Engineering, Information...

  • Senior Mainframe Developer

    5 days ago

    Jersey City, United States Saxon Global Full time

    Role -Senior Mainframe Developer- 3 positions Duration - 6 month Location - Jersey City, NJ Visa - (GC, USC, GCEAD) Pay rate- $50-60/hr on W2 Client - JPMC Requirements with Job description Must Have: min 7 plus years of experience DB2 Cobol Stored procedures Nice to have: financial industry experience security and money movement...

  • Senior Quantitative Developer

    1 month ago

    Jersey City, United States ZAR IT Solutions Full time

    Job DescriptionJob DescriptionAbout the jobSenior Quantitative DeveloperJersey City, NJ - Hybrid location1 year Contract plusW2 Pay rate $100/hr.We are looking for someone who is fast learner with positive attitude, who has good quantitative skills, programing skills (Python/SQL) and also some financial modeling skills. Fixed Income/risk management is...

  • Senior Java Developer

    3 weeks ago

    Jersey City, United States Motion Recruitment Full time

    Grow your career as a Senior Java Developer with an innovative global bank in Jersey City, NJ. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. Will...

  • US|Developer (Senior)

    1 day ago

    Jersey City, United States Hire Talent Full time

    Job Title: Senior Full Stack DeveloperType: 6 months Contract To FulltimeLocation: Hyderabad or Chennai- would prefer candidates go into office until they are converted to a FTEPay: 40 LPA MaxClient: DTCC if interested please share your resume! Job Description• Laying the foundational framework for the systems modernization• Participate in requirements...

  • Senior Java Developer

    3 weeks ago

    Jersey City, New Jersey, United States Motion Recruitment Full time

    Grow your career as a Senior Java Developer with an innovative global bank in Jersey City, NJ. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week.Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. Will...

  • Senior Technical Developer

    1 day ago

    Jersey City, New Jersey, United States Royal Bank of Canada Full time

    Job SummaryJob DescriptionSenior Technical Developer, RBC Capital Markets, LLC, Jersey City, NJ: Design and develop solutions for Capital Markets application using Java, J2EE frameworks and Spring Boot. Model wireframes for UI requirements using JavaScript, AngularJS UI, JQuery frameworks. Expertise with designing applications hosted on Docker containers....

  • Senior Snowflake

    6 days ago

    Jersey City, United States High 5 Full time

    Job Title : Senior Snowflake & Python Developer Location - New Jersey, US - Onsite Pay Rate : $50/hr - $53/hr Duration : 26 W Person should be available to work in person from New Jersey, US Snowflake DB Developer with expertise in python pandas, Snowpark, snowflake-connect, oracledb, mssql 9+ years of relevant experience and skilled in - Snowflake DB,...

  • Senior Big Data

    6 days ago

    Jersey City, United States Diverse Lynx Full time

    Role: Senior Big Data /Scala Developer Location: Jersey city NJ and Tampa , FL (Onsite) Contract JD:- Big Dat Hadoop Spark Scal Cluster Kafk Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated...

  • Senior Manager, Application Development

    1 month ago

    Jersey City, United States Phaxis Full time

    Salary is 160k to 180k + bonusHybrid positionSeeking a dynamic and experienced Senior Application Development Manager with a strong background in financial services and IT strategy. In this role, you will be responsible for overseeing technology strategy, software development and life cycle infrastructure high-level strategy, and providing strategic guidance...

  • Senior Manager, Application Development

    4 weeks ago

    Jersey City, United States Phaxis Full time

    Salary is 160k to 180k + bonusHybrid positionSeeking a dynamic and experienced Senior Application Development Manager with a strong background in financial services and IT strategy. In this role, you will be responsible for overseeing technology strategy, software development and life cycle infrastructure high-level strategy, and providing strategic guidance...

  • Senior Java Developer with cloud experience

    1 week ago

    Jersey City, United States Iris Software Inc. Full time

    Iris is looking for a Senior Java Developer with cloud experience (W2 only)Role: Senior Java Developer with cloud experience (W2 only)Location: Jersey City, NJOnsite : all 5 days onsiteDuration: Long Term ContractClient : BankingJob Description:9+ years of experience of overall.must have strong experience working as Java development.must have good experience...

  • Senior Java Developer with cloud experience

    1 week ago

    Jersey City, United States Iris Software Inc. Full time

    Iris is looking for a Senior Java Developer with cloud experience (W2 only)Role: Senior Java Developer with cloud experience (W2 only)Location: Jersey City, NJOnsite : all 5 days onsiteDuration: Long Term ContractClient : BankingJob Description:9+ years of experience of overall.must have strong experience working as Java development.must have good experience...

  • C++ Developer

    1 month ago

    Jersey City, United States Techmorgonite Software Solutions LLC Full time

    Job Title Senior C++ DeveloperDuration 12 monthsLocation Jersey City NJ (Initally Remote)Requirements5-8 years of solid software engineering experienceCompletely hands-on with 5+ years of experience in C or C++3+ years of experience in Perl & Shell Script on Unix/Linux platform.Good knowledge in relational database (Sybase/ Oracle) SQL's and store...

  • C++ Developer

    1 month ago

    Jersey City, New Jersey, United States Techmorgonite Software Solutions LLC Full time

    Job Title Senior C++ DeveloperDuration 12 monthsLocation Jersey City NJ (Initally Remote)Requirements5-8 years of solid software engineering experienceCompletely hands-on with 5+ years of experience in C or C++3+ years of experience in Perl & Shell Script on Unix/Linux platform.Good knowledge in relational database (Sybase/ Oracle) SQL's and store...