Current jobs related to Senior Databricks Engineer - Weehawken - Luxoft


  • Weehawken, New Jersey, United States OneAPPS Consulting Full time

    Company Overview:OneAPPS Consulting is a premier technology consulting firm with a strong presence in Europe. Our diverse and multicultural teams are engaged in a variety of projects, collaborating with clients to foster their growth and success. With multiple locations across the globe, we are dedicated to ensuring the seamless delivery of our clients'...


  • Weehawken, New Jersey, United States OneAPPS Consulting Full time

    Company Overview:OneAPPS Consulting is a premier technology advisory firm headquartered in London, with a presence across Europe. Our organization is engaged in a variety of projects that leverage diverse, multicultural teams to serve clients throughout the continent. We pride ourselves on being a trusted partner, aiding in the development and success of our...


  • Weehawken, New Jersey, United States OneAPPS Consulting Full time

    Company Overview:OneAPPS Consulting is a premier technology advisory firm with a strong presence in Europe. Our diverse and multicultural teams are engaged in a variety of projects, collaborating with clients to drive their growth and success. With multiple locations across the globe, we are committed to delivering seamless project execution for our...


  • Weehawken, United States Luxoft Full time

    Project descriptionYou'll be working in the Client Discovery, Planning and Wealth Way team. We provide engineering services to WMA business divisions of the Global Investment Bank. Together as a team, we provide solutions to unique business/market requirements per established Corporate IT Standards. As a database specialist, you'll play an important role in...


  • Weehawken, New Jersey, United States American Unit, Inc Full time

    Hello,Greetings from American Unit Inc.We are currently seeking a highly qualified and experienced professional for the position of Senior Automation QA Engineer.Job Overview:As a Senior Automation QA Engineer, you will be instrumental in enhancing our testing processes through automation. Your primary focus will be on ensuring the quality of our software...


  • Weehawken, United States Elajika Inc Full time

    Title IT –Hadoop Developer /Big Data EngineerLocation Weehawken NJDuration 06+ MonthsClient InfosysJob DetailsMust-Have SkillsAzure DatabricksSpark PySprakADF EventHub Delta LakeJava ETL Technologies - PreferredDetailed Job DescriptionCandidate should have excellent hands-on experience in Azure Cloud.Should have experience in Spark and Java...


  • Weehawken, New Jersey, United States EPAM Systems Full time

    Senior Python DeveloperEPAM Systems - Weehawken, NJWe are hiring a Senior Python Developer, who has experience designing and developing innovative digital solutions that solve complex business problems. Here at EPAM, we fully recognize that our people are the source of our success, and we are committed to helping EPAMers achieve their goals by offering...


  • Weehawken, United States Wipro Full time

    Spark and SQL Sr. DeveloperWeehawken, United StatesTech Hiring3085692Job DescriptionAbout Wipro: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. We leverage our holistic portfolio of...


  • Weehawken, New Jersey, United States EPAM Full time

    Are you ready to take your career to the next level in a pivotal role as a Senior Application Security Lead? At EPAM, we are a global leader in digital transformation, and we are seeking a talented individual to join our dynamic team. This position offers the chance to work on a variety of innovative projects for some of the most recognized brands worldwide....


  • Weehawken, New Jersey, United States Synechron Full time

    We are in search of a Senior QA Automation Engineer specializing in Kafka.Essential Requirement: Hands-on experience with Kafka is crucial for this position.Position Overview:We are looking for a highly proficient Automation QA/SDET with a focus on Kafka, Cucumber, Selenium, Java, and database testing.The successful candidate will be instrumental in...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Mission:As a Senior Actimize Engineer specializing in Tibco StreamBase, you will engage with various stakeholders throughout the organization to tackle intricate technical challenges. Your role will involve overseeing multiple projects, prioritizing tasks, resolving complex issues, and escalating matters when necessary, all within a dynamic work...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Challenge:As a Senior Actimize Engineer with expertise in Tibco StreamBase, you will engage with various stakeholders across the organization to tackle intricate technical specifications. Your role will involve managing multiple projects, prioritizing tasks, resolving complex issues, and escalating matters as needed in a dynamic environment. The...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Challenge:As a Senior Actimize Engineer with expertise in Tibco StreamBase, you will engage with various stakeholders across the organization to address intricate technical requirements. Your role will involve managing multiple projects, prioritizing tasks, resolving complex issues, and escalating when necessary, all within a dynamic work environment....


  • Weehawken, New Jersey, United States Synechron Full time

    Our Challenge:As a Senior Actimize Engineer with Tibco StreamBase, you will engage with various stakeholders across the organization to tackle intricate technical requirements. Your role will involve managing multiple projects, prioritizing tasks, resolving complex issues, and escalating when necessary, all within a dynamic environment. The...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Challenge:As a Senior Actimize Engineer with Tibco StreamBase, you will engage with various stakeholders across the organization to tackle intricate technical requirements. Your role will involve managing multiple projects, prioritizing tasks, resolving complex issues, and escalating matters as needed in a dynamic environment. The...

  • Data Engineer

    1 month ago


    Weehawken, New Jersey, United States UBS Full time

    Data EngineerUBS - Weehawken, NJUnited StatesProduct Management and Development, Quantitative Analysis, ResearchGlobal Wealth ManagementJob Reference #296427BRCityWeehawkenJob TypeFull TimeYour roleAre you an analytical data expert with the technical skills and curiosity to solve complex problems? Do you blend mathematics, computer science, program...

  • Data Engineer

    1 month ago


    Weehawken, United States UBS Full time

    Data EngineerUBS - Weehawken, NJUnited StatesProduct Management and Development, Quantitative Analysis, ResearchGlobal Wealth ManagementJob Reference # 296427BRCity WeehawkenJob Type Full TimeYour role Are you an analytical data expert with the technical skills and curiosity to solve complex problems? Do you blend mathematics, computer science, program...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Mission:As a Senior Actimize Developer with expertise in Tibco StreamBase, you will engage with various stakeholders to tackle intricate technical challenges. Your role will involve managing several projects, prioritizing tasks, resolving complex issues, and escalating matters when necessary in a dynamic work environment. Key Responsibilities:Design,...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Mission:As a Senior Actimize Developer specializing in Tibco StreamBase, you will engage with various stakeholders to address intricate technical challenges. Your role will involve managing multiple projects, prioritizing tasks, and resolving complex issues in a dynamic environment. Your Responsibilities:Design and customize Actimize models, workflows,...


  • Weehawken, New Jersey, United States Synechron Full time

    Our Challenge:As a Senior Actimize Developer specializing in Tibco StreamBase, you will engage with various stakeholders throughout the organization to address intricate technical requirements. Your role will involve managing multiple projects, prioritizing tasks, resolving complex issues, and escalating matters as needed in a dynamic environment. The...

Senior Databricks Engineer

2 months ago


Weehawken, United States Luxoft Full time
Project description

In our agile operating model, crews are aligned to larger products and services fulfilling client's needs and encompass multiple autonomous pods.
You will be part of Global Markets Financing stream within Investment Banking division in US. The team is responsible for feature development, modernization and transformation of the platform used by both internal and external users.

Responsibilities

We are looking for Senior Cloud data Engineer having at least 10+ years of industry experience in building Enterprise data warehouse solution using Spark with Scala or python and also Investment bank domain knowledge of at least 8+ year. Candidate is expected to be in office (in Person) at least 3 times a week.

This person will be responsible to develop the framework required to load and transform data into a data vault modeling design to consume gigabyte of historical data for daily reporting purposes.

This person will also help the team to learn and design next gen data warehouse solution using Cloud technology as per latest Industry standards.

This person should have good experience in designing data vault modeling with Star & Snowflake modeling as well and should be able to design the next generation financial data model which can deal with both EOD as well as Real time streaming data. As this model will be serve as the base for all reporting across multiple business line , therefore efficiency , data quality and optimized heavy read is expected.

Skills

Must have

Bachelor's and/or Master's degree in Computer Science, Computer Engineering or related technical discipline

Total experience in IT - 15 years.

At least 10+ years of experience in working in large global teams, especially for high-performance, large-scale systems data warehouse solution using Data bricks , Spark (Python/Scala)

Microsoft Azure experience is a must

Spark/Databricks batch and streaming solutions (Delta Lake, Lakehouse)

Knowledge of Azure Data Factory and Cosmos DB

Knowledge of Kafka, Event hubs and ADLS Gen2 on Microsoft Azure

Understanding of dev ops tools and engineering practices using micro-services, ci/cd pipeline and test automation

Cloud technologies & design patterns

building and optimizing 'big data' data pipelines, architectures, and data sets

proven skills in performance tuning and quality improvements

Strong in Algorithms and Data Structures

Infrastructure-as-code, using tools such as Terraform, ARM, Bicep or CloudFormation

Azure CLI, setting up ADO pipelines, Terraform Enterprise, etc

Nice to have

Other

Languages

English: C1 Advanced

Seniority

Senior