Sr. Spark Data Engineer
4 weeks ago
Title: Sr. Spark Data Engineer
Location: O’Fallon, MO (Onsite)
Duration: Fulltime / Permanent
Note: Visa Independent consultant and H1B-Transfer cases only workable for this role
Project Scope:
Seeks a Senior Software Developer who will be a crucial part of our software team.
The selected candidate will have to write scalable, robust, and easy-to-maintain code, and will be required to translate software requirements into high-performance products.
You will also be actively involved in researching new technologies/tools that can be incorporated to improve the current system
Roles and Responsibilities:
- Min 10+ years of hands-on experience in managing complex release cycles and coordinating
- 6+ years of experience in Spark (Scala preferred), Hadoop, Kafka etc.
- Develop batch and streaming solutions using various Big Data technology.
- Fluent in Java, Spring Boot, and Microservices (REST API)
- Experienced in developing UI using Modern Web Development in Angular (2+), NodeJS, GraphQL etc.
- Good understand of Event Driven Design (EDD) - Kafka
- Build an automated quality framework based on JUnit and Mockito and have a solid understanding of the BDD testing framework
Required skills:
- Have hands-on Spark (Scala preferred), Hadoop, Kafka etc.
- Develop batch and streaming solutions using various Big Data technology.
- Have strong programming knowledge in Java, Scala, or Python.
- Have experience working with real-time or near real-time ingestion.
- Be familiar with Agile/Scrum methodologies.
-
Sr. Spark Data Engineer
4 weeks ago
O'Fallon, United States Adbakx Full timeTitle: Sr. Spark Data EngineerLocation: O’Fallon, MO (Onsite)Duration: Fulltime / PermanentNote: Visa Independent consultant and H1B-Transfer cases only workable for this roleProject Scope:Seeks a Senior Software Developer who will be a crucial part of our software team.The selected candidate will have to write scalable, robust, and easy-to-maintain code,...
-
Data Engineer
5 months ago
O'Fallon, United States TDK Technologies Full timeJob Description:Experience dealing with large volumes of data, from various sources, both structured and unstructured.Ability to triage and talk through performance / scaling issues of dealing with data at scale.Good understanding of how data will be read (file formats, partitioning, bucketing).Extensive experience writing testable jobs using Spark (or...
-
Lead Databricks Engineer
1 month ago
O'Fallon, United States Compunnel Inc. Full timeJob Title: Lead Databricks EngineerLocation: O’Fallon, MO (Day 1 Onsite – No Remote)Duration: Full TimeJob Description:Yrs. of experience: Minimum 10+ Yrs. of ExperienceCandidates are required to have these mandatory skills:• Strong hands on in Pyspark and Apache Spark.• Experience in Native Spark Migration to Databricks.• Experience in Hadoop...
-
Sr Firmware Engineer
6 days ago
O'Fallon, United States Talentporte Full timeJob DescriptionJob DescriptionSr. Firmware Engineer Position: Direct HireLocation: Saint Peters, MO (must be local – Hybrid Schedule).Salary: $130K to $140K (depending on experience).Hours: M – F (4 -10’s or 5 – 8’s).Status: Must be a US citizen.Benefits: Health, Dental, Vision, PTO, Holidays, 401K, others.Must Have: C++, 32 Bit and Micro...
-
Lead Databricks Engineer
2 months ago
O'Fallon, United States Programmers.io Full timeRole – Lead Databricks EngineerLocation: O’Fallon, MO (Onsite from Day 1 – No Remote)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Candidates are required to have these mandatory skills:• Strong hands on in Pyspark and Apache Spark.• Experience in Native Spark Migration to Databricks.• Experience in Hadoop Migration to...
-
Lead Databricks Engineer
2 months ago
O'Fallon, United States Programmers.io Full timeRole – Lead Databricks EngineerLocation: O’Fallon, MO (Onsite from Day 1 – No Remote)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Candidates are required to have these mandatory skills:• Strong hands on in Pyspark and Apache Spark.• Experience in Native Spark Migration to Databricks.• Experience in Hadoop Migration to...
-
Data Center Engineer
2 months ago
O'Fallon, United States PRI Global Full timeI humble request you to dont share Data Analyst resumes please.... This is a Data Center Engineer role.The requirement as followsJob title: Data Center Engineer/TechnicianDuration: 12+ monthsLocation: O'Fallon, MOOverview• Our mission is to provide the highest quality network and data center engineering services possible• Deliver comprehensive, reliable...
-
Senior Cloud Data Engineer
5 days ago
O'Fallon, United States Mastercard, Inc. Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer Lead to join our team at Mastercard, Inc. This is a critical role that will drive the development and implementation of our cloud data platforms, ensuring the secure and scalable storage and processing of our vast amounts of data.Key ResponsibilitiesDesign and develop high-quality, secure, and...
-
Cloud Data Engineer Lead
5 days ago
O'Fallon, United States Mastercard, Inc. Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer Lead to join our team at Mastercard, Inc. This is a critical role that will drive the development and implementation of our cloud data platforms, ensuring the secure and scalable storage and processing of our vast amounts of data.Key ResponsibilitiesDesign and develop high-quality, secure, and...
-
Bigdata Consultant with strong Scala exp
4 weeks ago
O'Fallon, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionBigdata Consultant with strong Scala exp Location O`Fallon, MO (Day 1 Onsite) Job Description: Strong People management, leadership, organizational skills. Outstanding communication (written and verbal) skills.Experience leveraging open-source tools, predictive analytics, machine learning, Advanced Statistics, and other data...
-
Lead Data Scientist
3 months ago
O'Fallon, United States CoolSnail Full timeJob DescriptionJob DescriptionJob Title: Lead Data ScientistCompany: Rose InternationalLocation: O’Fallon, MO 63368Duration: 12 monthsEmployment Type: TempOverviewThe AI Services team is looking for a Data Scientist who is passionate about data analysis, Machine Learning, and Artificial Intelligence. The person in this role will be joining a team of...
-
Senior Reliability Engineer for Systems
1 week ago
O'Fallon, Missouri, United States Fulcrum Digital Full timeJob Overview About Us Fulcrum Digital is a forward-thinking digital acceleration firm specializing in digital transformation and technology solutions from conception to execution. Our services cater to a diverse range of sectors, including finance, insurance, retail, education, healthcare, and manufacturing. Role Responsibilities Oversee and...
-
Senior Reliability Engineer for Systems
1 week ago
O'Fallon, Missouri, United States Fulcrum Digital Full timeJob Overview About Us Fulcrum Digital is a forward-thinking digital transformation firm that specializes in providing technology solutions from concept to execution. Our services cater to a diverse range of sectors, including finance, insurance, retail, education, healthcare, and manufacturing. Position Responsibilities Oversee and manage all...
-
Senior Reliability Engineer for Systems
2 weeks ago
O'Fallon, Missouri, United States Fulcrum Digital Full timeJob Overview About Us Fulcrum Digital is a forward-thinking digital transformation company that specializes in providing technology solutions from concept to execution. Our services span a wide range of sectors, including finance, insurance, retail, education, healthcare, and manufacturing. Role Responsibilities Oversee and manage all facets of...
-
SENIOR SOFTWARE DEVELOPMENT ENGINEER IN TEST
3 months ago
O'Fallon, United States Resource Informatics Group Inc Full timeJob DescriptionJob DescriptionRole:-SENIOR SOFTWARE DEVELOPMENT ENGINEER IN TEST (Sr. SDET)Location:-O’fallon MOVisa:-USC/GC Preferred Duration:- 9 Months Interview:-Phone/SkypeOverview• Push Payments Development team owns a number of applications, primarily focusing on the Mastercard Send application.• Mastercard send is an API based application...
-
SENIOR SOFTWARE DEVELOPMENT ENGINEER IN TEST
3 months ago
O'Fallon, United States Resource Informatics Group Inc Full timeJob DescriptionJob DescriptionRole:-SENIOR SOFTWARE DEVELOPMENT ENGINEER IN TEST (Sr. SDET)Location:-O’fallon MOVisa:-USC/GC Preferred Duration:- 9 Months Interview:-Phone/SkypeOverview• Push Payments Development team owns a number of applications, primarily focusing on the Mastercard Send application.• Mastercard send is an API based application...
-
Sr Snowflake Developer
2 months ago
O'Fallon, United States NR Consulting Full timeRole-Sr Snowflake Developer Location -O Fallon MO (Day 1 onsite role (No remote) Skillsets: Snowflake capabilities like Snowpipe, STREAMS, TASKS. Snowflake roles and user security. Roles and Responsibilities: Understanding of Snowflake design patterns and migration architectures Thought leadership, strategy, and direction for the Snowflake practice....
-
Cloud Data Engineer Lead
1 day ago
O'Fallon, MO , USA, United States Mastercard, Inc. Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer Lead to join our team at Mastercard, Inc. This is a critical role that will drive the development and implementation of our cloud data platforms, ensuring the secure and scalable storage and processing of our vast amounts of data.Key ResponsibilitiesDesign and develop high-quality, secure, and...
-
Software Engineer II
2 months ago
O'Fallon, United States MasterCard Full timeSoftware Engineer IIMastercard - O'Fallon, MOOur PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and...
-
Electrical Engineer
2 months ago
O'Fallon, United States Motion Recruitment Full timeOur client, a French multinational company that specializes in digital automation and energy management, is looking to hire an Electrical Engineer to join their team on a HYBRID model in O'Fallon, MO!Alternative Title: Customer Engagement Power Systems Engineer*** This begins as a 12-month contract with any opportunity to extend/convert ****** HYBRID: 80%...