See more Collapse

Data engineer

1 month ago

Weehawken, United States Diverse Lynx Full time

Title - Java + Databricks developer

Location – Weehawken, NJ (Onsite)

Responsibilities

Must have skills -

Java, PySpark and Azure Databricks, Azure PaaS experience

6 to 8 years of IT experience and at least 4+ years in cloud native data engineering solution design/architecture and development. Strong hands-on expertise in building Data engineering solutions using Java, Apache Spark and Scala. Deep expertise in Performance tuning and optimization of Java/Spark/Scala programs. Ability to design and build data engineering tasks using Data bricks framework. Hands on experience working with Azure Cloud services like Azure Data Factory, Azure Data Lake Storage, Azure Even hub, Azure SQL, Azure Analytical services, Azure Cosmos DB, Should be able to demonstrate expertise in designing and building efficient and scalable data engineering solutions using Massively Parallel Processing (MPP) architecture. Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks. Build data pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL Experience in writing HQL queries in Hive Data warehouse and performance tuning of HIVE scripts Well versed with Relational and Dimensional Modelling techniques like Star, Snowflake Schema, OLTP, OLAP, Normalization, Fact and Dimensional Tables Proficient in creating Technical Design Documents (TDD). Familiar with DevOps principles and experience in CD/CI implementations using Azure native services. Very good customer relationship and stakeholder management skills Excellent communication and presentation skills.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. #J-18808-Ljbffr

We have other current jobs related to this field that you can find below

  • Data Engineer

    1 week ago

    Weehawken, United States UBS Full time

    Data EngineerUBS - Weehawken, NJUnited StatesProduct Management and Development, Quantitative Analysis, ResearchGlobal Wealth ManagementJob Reference # 296427BRCity WeehawkenJob Type Full TimeYour role Are you an analytical data expert with the technical skills and curiosity to solve complex problems? Do you blend mathematics, computer science, program...

  • Data Engineer

    1 week ago

    Weehawken, New Jersey, United States UBS Full time

    Data EngineerUBS - Weehawken, NJUnited StatesProduct Management and Development, Quantitative Analysis, ResearchGlobal Wealth ManagementJob Reference #296427BRCityWeehawkenJob TypeFull TimeYour roleAre you an analytical data expert with the technical skills and curiosity to solve complex problems? Do you blend mathematics, computer science, program...

  • Data Engineer – T-SQL, Python, Shell Scripting, and Azure

    4 weeks ago

    Weehawken, United States Synechron Full time

    Role: Data Engineer – T-SQL, Python, Shell Scripting, and AzureWeehawken, New Jersey, United StatesDay 1 OnsiteSummary: We are seeking an experienced candidate who can facilitate the migration of legacy systems, which are primarily developed in T-SQL, Perl, and Shell Scripting with Sybase databases, to the Azure Cloud platform. The ideal candidate should...

  • Data Engineer – T-SQL, Python, Shell Scripting, and Azure

    4 weeks ago

    Weehawken, United States Synechron Full time

    Role: Data Engineer – T-SQL, Python, Shell Scripting, and AzureWeehawken, New Jersey, United StatesDay 1 OnsiteSummary: We are seeking an experienced candidate who can facilitate the migration of legacy systems, which are primarily developed in T-SQL, Perl, and Shell Scripting with Sybase databases, to the Azure Cloud platform. The ideal candidate should...

  • IT –Hadoop Developer

    2 months ago

    Weehawken, United States Elajika Inc Full time

    Title IT –Hadoop Developer /Big Data EngineerLocation Weehawken NJDuration 06+ MonthsClient InfosysJob DetailsMust-Have SkillsAzure DatabricksSpark PySprakADF EventHub Delta LakeJava ETL Technologies - PreferredDetailed Job DescriptionCandidate should have excellent hands-on experience in Azure Cloud.Should have experience in Spark and Java...

  • Senior Databricks Engineer

    2 months ago

    Weehawken, United States Luxoft Full time

    Project description In our agile operating model, crews are aligned to larger products and services fulfilling client's needs and encompass multiple autonomous pods. You will be part of Global Markets Financing stream within Investment Banking division in US. The team is responsible for feature development, modernization and transformation of the platform...

  • Network Engineer III

    4 weeks ago

    Weehawken, United States OmniForce Solutions Full time

    Our client is a leading technology and telecommunications company with remote opportunities nationwide. With 450,000 route fiber miles serving customers in more than 60 countries, they deliver the fastest, most secure global platform for applications and data to help businesses, government and communities deliver amazing experiences. If you are prepared to...

  • Network Engineer III

    4 weeks ago

    Weehawken, United States OmniForce Solutions Full time

    Our client is a leading technology and telecommunications company with remote opportunities nationwide. With 450,000 route fiber miles serving customers in more than 60 countries, they deliver the fastest, most secure global platform for applications and data to help businesses, government and communities deliver amazing experiences. If you are prepared to...

  • Network Engineer

    4 weeks ago

    Weehawken, United States Infomatics, Inc Full time

    The Main Responsibilities• The Lead Network engineer interfaces with complex projects, is effectively able to communicate the client’s needs, and can architect, design, and implement solutions that align with those business needs.• Architect, Design, Implement, and Troubleshoot diverse multi-protocol Networks for the different needs of the financial...

  • Lead Network Engineer

    4 weeks ago

    Weehawken, United States The Ash Group Full time

    **W2 ONLY, NO C2C or 3rd Parties**Title: Lead Network EngineerLocation: Weehawken, NJSetting: Hybrid (Onsite at customer location once per week)Pay: $65 - $72.41/hr on W2Duration: 6-month contract, possible extension/conversionThe RoleAs a Lead Network Engineer, you will interact with Lumen’s financial services clients and Lumen’s engineering teams to...

  • Lead Network Engineer

    4 weeks ago

    Weehawken, United States The Ash Group Full time

    **W2 ONLY, NO C2C or 3rd Parties**Title: Lead Network EngineerLocation: Weehawken, NJSetting: Hybrid (Onsite at customer location once per week)Pay: $65 - $72.41/hr on W2Duration: 6-month contract, possible extension/conversionThe RoleAs a Lead Network Engineer, you will interact with Lumen’s financial services clients and Lumen’s engineering teams to...

  • Network Engineer III

    4 weeks ago

    Weehawken, United States TekWissen ® Full time

    Job Title: Network Engineer III Location: Weehawken, NJ 07086 (Will be supporting NY, NJ, CT)Duration: 6 Months Job Type: Contract Work Type: Hybrid (Once in a Week)Pay Rate: $65 - 70$/hr. on W2 Job Description: The Role As a Lead Network Engineer, you will interact with Client’s financial services clients and client’s engineering teams to Architect,...

  • Network Engineer III

    4 weeks ago

    Weehawken, United States TekWissen ® Full time

    Job Title: Network Engineer III Location: Weehawken, NJ 07086 (Will be supporting NY, NJ, CT)Duration: 6 Months Job Type: Contract Work Type: Hybrid (Once in a Week)Pay Rate: $65 - 70$/hr. on W2 Job Description: The Role As a Lead Network Engineer, you will interact with Client’s financial services clients and client’s engineering teams to Architect,...

  • Network Engineer III

    3 weeks ago

    Weehawken, United States TekWissen ® Full time

    Job Title: Network Engineer III Location: Weehawken, NJ 07086Duration: 6 Months Job Type: Contract Work Type: Hybrid (Once in a Week)Pay Rate: $68 to 70/hr on W2 Job Description: The Role As a Lead Network Engineer, you will interact with Client’s financial services clients and client’s engineering teams to Architect, engineer, and implement network...

  • Network Engineer III

    3 weeks ago

    Weehawken, United States TekWissen ® Full time

    Job Title: Network Engineer III Location: Weehawken, NJ 07086Duration: 6 Months Job Type: Contract Work Type: Hybrid (Once in a Week)Pay Rate: $68 to 70/hr on W2 Job Description: The Role As a Lead Network Engineer, you will interact with Client’s financial services clients and client’s engineering teams to Architect, engineer, and implement network...

  • Network Engineer III

    4 weeks ago

    Weehawken, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. The below job opportunity is to one of Our clients is an American telecommunications company headquartered in Monroe, Louisiana, that offers communications, network services, security, cloud solutions, voice,...

  • Lead Network Engineer

    2 months ago

    Weehawken, New Jersey, United States Lumen Full time

    About LumenLumen connects the world. We are igniting business growth by connecting people, data and applications – quickly, securely, and effortlessly. Together, we are building a culture and company from the people up – committed to teamwork, trust and transparency. People power progress. We're invested in providing the flexibility you need to thrive...

  • AV Integration Engineer

    1 month ago

    Weehawken, United States TierPM Full time

    The Audio Visual Engineer will handle all aspects of post-sale audio visual system engineering and design, and support the project team during the installation and commissioning phases.Position Description:Review new projects validate design requirements.Participate in audio visual integration project kick-off meetings.Review, validate and provide feedback...

  • AV Integration Engineer

    4 weeks ago

    Weehawken, United States TierPM Full time

    The Audio Visual Engineer will handle all aspects of post-sale audio visual system engineering and design, and support the project team during the installation and commissioning phases.Position Description:Review new projects validate design requirements.Participate in audio visual integration project kick-off meetings.Review, validate and provide feedback...

  • UI Engineer

    2 months ago

    Weehawken, United States The Rockridge Group Full time

    Job DescriptionJob DescriptionTitle: Investment Analytics – UI EngineerYour Role:We are looking for a UI/UX Designer & Developer that excels at turning a business concept into a functional web application. The responsibilities will include crafting/reviewing wire frames and then translating them into front-ends that are highly intuitive and flexible. Huge...