Senior Big Data Engineer
1 month ago
Title: Senior Big Data Engineer - Python/PySpark
Location: Whippany, NJ (hybrid 2 days onsite)
Type: Contract
Duration: Long Term
Description:
8+ years of experience in Python, PySpark, Hadoop Big Data
Build PySpark based applications for both batch and streaming requirements, which will require in-depth knowledge on majority of Hadoop and NoSQL databases as well. Optimize performance of the built Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD's.
Should be skilled to use APIs in order to process huge datasets.
They can run Spark/pyspark on open source frameworks such as Hadoop in the cloud with complicated data.
Develop, test and maintain high-quality software using Python programming .
Participate in the entire software development lifecycle, building, testing and delivering high-quality solutions.
Collaborate with cross-functional teams to identify and solve complex problems.
Strong Backend development Experience in Python
Good Understanding of python libraries like Pandas, Polars, NumPy, Matplotlib, Plotly, Seaborn, Altair.
Conceptually Strong in Python and Analytics
Design and implement web applications using Python framework like Streamlit.
Design visualizations, custom widgets, and components, translate complex data processing and analysis tasks into intuitive, user-friendly web interfaces.
Collaborate with back-end developers to integrate APIs and databases with Streamlit applications.
Working with large data sets and incomplete information as required.
Working with users, business stakeholders, product owners /technology teams to deeply understand customer needs, develop solutions independently.
Experience of working in a financial organization or awareness of financial concepts especially related to Trading hub.
Rewrite and decom legacy controls: consider a python framework for converting Bank Java for scenarios outside Trading Hub and BABS to transition all remaining legacy Bank scenarios to new Surveillance capabilities.
-
Senior Data Engineer Leader
4 weeks ago
Hanover Twp, United States CV Library Full timeJob Title: Senior Data Engineer LeaderWe are seeking an experienced Senior Data Engineer Leader to join our team at CV Library. The ideal candidate will have a strong background in Python, PySpark, and Hadoop Big Data.About the RoleThe Senior Data Engineer Leader will be responsible for building and maintaining high-quality software applications using Python...
-
Info Big Data Engineer
4 months ago
Superior Twp, United States Hyundai America Technical Center Full timeLocation: Superior Township, MI Job Level: Senior Engineer Level of Education: B.S. or M.S. (preferred) Computer Science, Computer Engineering, Electrical Engineering, or a combination of education and equivalent experience Level of Industry Experience: Minimum 3 years in data analysis in automotive or IT realm Job Type: Full-Time Starting Date: ASAP Job...
-
Big Data Specialist
2 weeks ago
Superior Twp, United States Hyundai America Technical Center Full timeAbout the JobWe are seeking a highly skilled Big Data Specialist to join our team at Hyundai America Technical Center, Inc. (HATCI) in Superior Township, MI.As a Big Data Specialist, you will be responsible for analyzing and interpreting large data sets to drive business decisions and improve customer experiences.Your primary responsibilities will...
-
Big data Production Support Engineer
4 weeks ago
Woodbridge Twp, United States CV Library Full timeJob Description:The position will form part of Data Engineering team working with global technology team, largely based in the US. The candidate will be expected to provide production support for Data Engineering team. Resource will coordinate with various teams like Infrastructure, Network Security, Support teams across Market Surveillance technology and...
-
Associate Principle Data Scientist
3 days ago
Hanover Twp, United States TTI of USA, Inc. Full timeJOB DESCRIPTION In this role, you will have the opportunity to contribute to developing a cutting-edge Commercial Reporting solution with AI and GenAI capabilities. You will play an instrumental part in building AI and GenAI solutions, harnessing large data sets from across the organization, and collaborating with cross-functional teams and stakeholders to...
-
Senior Testing Engineer
4 weeks ago
Cranberry Twp, United States Arconic Full timeSenior Testing Engineer - 112320 DESCRIPTION/RESPONSIBILITIES: Arconic is currently in search of a Senior Testing Engineer to join our Kawneer Business. The primary function of the Senior Testing Engineer is to complete all required tasks associated with R&D, new product and sustaining engineering product testing. Responsibilities Job Duties and...
-
Software Engineer Specialist
5 days ago
Hanover Twp, United States Sierre Technologies Full timeSierre Technologies is a top HRMS company seeking a skilled Fullstack Developer. This is a full-time role on W2, with an estimated salary range of $50-$65 per hour. We cannot sponsor visa or C2C opportunities.About the JobThis is a senior-level position that requires strong experience in Java and Angular 8+. The ideal candidate will have a deep understanding...
-
Senior Java Architect
5 days ago
Hanover Twp, United States Sierre Technologies Full timeSierre Technologies is a leading HRMS company seeking a highly skilled Fullstack Developer. This is a full-time role on W2, with an estimated salary range of $50-$65 per hour. We cannot sponsor visa or C2C opportunities.About the CompanySierre Technologies is a top HRMS company that provides innovative solutions to clients worldwide. We are committed to...
-
Senior Network Engineer
4 days ago
Branchburg Twp, United States Indotronix International Corporation Full timeJob Title: Senior Network EngineerJob Overview:Indotronix International Corporation is seeking a highly skilled Senior Network Engineer to join our team. As a key member of our IT department, you will be responsible for designing, deploying, and maintaining our network architecture, ensuring seamless communication and data transfer. This is a 12-month...
-
Data Scientist
2 months ago
Hanover Twp, United States TTI of USA, Inc. Full timeIN THIS ROLE In this role, you will have the opportunity to contribute to developing a cutting-edge Commercial Reporting solution with AI and GenAI capabilities. You will play an instrumental part in building AI and GenAI solutions, harnessing large data sets from across the organization, and collaborating with cross-functional teams and stakeholders to...
-
Azure Data Test Engineer
4 weeks ago
Manalapan Twp, United States RIT Solutions, Inc. Full timeThe following are REQUIRED skills, and eligible candidates must have the experience listed and can speak to their experience: Minimum 6-8 years Hands-on, must-have (Advanced-to-Expert) Testing Experience in the following: Desired Testing Experience (In order of importance) 1. Azure Databricks 2. Lakehouse 3. Power BI dashboard UI Automation Testing 4....
-
Gen AI data scientist
3 days ago
Hanover Twp, United States Axelon Full timeJob Title: AI and GenAI Specialist (Hybrid ) Location : East Hanover, NJ Pay Rate : $40/hr Note : Only *** no C2C. Role Description: In this role, you will contribute to developing a cutting-edge commercial reporting solution powered by AI and GenAI capabilities. You will play a vital role in building innovative AI/GenAI solutions, leveraging large...
-
Software Engineer Level 3 w/ 20 years experience
2 months ago
Hanover, United States Onyx Point, Inc. Full timeREQUIRED TO BE CONSIDERED FOR THIS POSITION YOU MUST HAVE AN ACTIVE TS/SCI W/ FULL SCOPE POLYGRAPH SECURITY CLEARANCE (U.S. CITIZENSHIP REQUIRED) In addition to the standard SWE3 experience, the team is looking for a senior JAVA developer with the following experience: Documentation & Presentations: has experience writing technical documentation &...
-
Software Engineer Level 3 w/ 20 years experience
3 weeks ago
Hanover, United States Onyx Point, Inc. Full timeREQUIRED TO BE CONSIDERED FOR THIS POSITION YOU MUST HAVE AN ACTIVE TS/SCI W/ FULL SCOPE POLYGRAPH SECURITY CLEARANCE (U.S. CITIZENSHIP REQUIRED) In addition to the standard SWE3 experience, the team is looking for a senior JAVA developer with the following experience: Documentation & Presentations: has experience writing technical documentation &...
-
Engineer - Senior
2 weeks ago
Clinton Twp, United States DTE Energy Full timeDTE is one of the nation’s largest diversified energy companies. Our electric and gas companies have fueled our customer’s homes and Michigan’s progress for more than a century. And as Michigan’s largest source of renewable energy, we’re creating a cleaner, healthier environment to power our future. We’re also serving communities beyond Michigan,...
-
Engineer - Senior
1 week ago
Clinton Twp, United States DTE Energy Full timeDTE is one of the nation’s largest diversified energy companies. Our electric and gas companies have fueled our customer’s homes and Michigan’s progress for more than a century. And as Michigan’s largest source of renewable energy, we’re creating a cleaner, healthier environment to power our future. We’re also serving communities beyond Michigan,...
-
Software Engineer III
2 months ago
Hanover, United States Reflexive Concepts Full timeReflexive Concepts is seeking a skilled Software Engineer III to join our team! Specifically, we're looking for a back-end developer who has experience in Java, Spring, Docker, MongoDB, ElasticSearch, and AWS. Qualifications: Twenty (20) years experience as a SWE in programs and contracts of similar scope, type, and complexity is required. Bachelor’s...
-
Software Engineer III
4 weeks ago
Hanover, United States Reflexive Concepts Full timeReflexive Concepts is seeking a skilled Software Engineer III to join our team! Specifically, we're looking for a back-end developer who has experience in Java, Spring, Docker, MongoDB, ElasticSearch, and AWS. Qualifications: Twenty (20) years experience as a SWE in programs and contracts of similar scope, type, and complexity is required. Bachelor's...
-
Software Engineer III
3 weeks ago
Hanover, United States Reflexive Concepts Full timeReflexive Concepts is seeking a skilled Software Engineer III to join our team! Develops, maintains, and enhances complex and diverse software systems. Design and code new software or modify existing software to add new features. Debug existing software and correct defects. Assists with developing and executing test procedures for software...
-
Senior Electrical Engineer
3 weeks ago
Antis Twp, United States Pittsburgh Glass Works Full timeSenior Electrical EngineerID 2024-2287Category EngineeringPosition Type Full-TimeLocation : LocationUS-PA-MeadvilleOverviewVitro Architectural Glass was formed from two globally proven legacies in commercial glass manufacturing: PPG and Vitro. It all started in 1883, when Captain John Baptiste Ford and John Pitcairn, Jr. founded Pittsburgh Plate Glass...