Big Data Software Engineer

4 weeks ago


O'Fallon, United States Tricon Solutions Full time

Job Title: Software Engineer

Location: O Fallon MO 63366

Type: 6 months contract on W2

Description: Seeking a Software Engineer who thrives on designing coding and maintaining large data processing systems primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity. Our team is a mix of software engineers and data analysts working to ensure our inputs algorithms and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top ecommerce sites.

Responsibilities:

  • Develop big data processing systems using Scala Apache Spark Airflow Databricks AWS and related technologies

  • Run our ingestion and publishing processes and debug problems when they occur

  • Follow SDLC and best practices for clean code and architecture

  • Impact system architecture and improve overall system efficiency with growing business needs

  • Deliver assigned work with guidance from experienced team members

  • Understand and follow standard branching (e.g. Gitflow) and peer review practices

  • Understand the big picture and endtoend logical architecture of systems in ownership areas

  • Provide feedback and suggestions on areas to improve

  • Understand requirement analysis being an essential part of delivering value to our customers and partners and participate in elaboration prioritization and effort estimation

  • Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines virtualization and containerization

  • Understand the use of Client technology policies in everyday work

  • Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives

Qualifications:

  • Selfmotivated learner willing to take on challenging problems

  • Aptitude to learn new languages and technologies as necessary

  • Ability to write clean readable and maintainable code that follows best practices

  • Passion for diving deep into data and insights

  • Indepth knowledge of one or more Internet protocols

  • Experience with one or more strongly typed programming languages

  • BS degree in Computer Science related degree or equivalent

  • Understanding/experience in Apache Spark Airflow Databricks AWS and related technologies

  • Fluency in one or more languages like Scala Java Python etc.

  • Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines virtualization and containerization

Desired Skills/Certifications:

  • Data Engineer/SDET

  • Knowledge of Microservices and scaling techniques

  • Experience using web service APIs

  • Ability to create good acceptance and integration test automation scripts and integrate with Continuous Integration (Jenkins/Bamboo) and code coverage tools (Sonar)

  • Certified Associate in Software Testing (CAST)

  • AWS Certified

Java,Scala,Spark,Big Data,Airflow,databricks



  • O'Fallon, Missouri, United States Tricon Solutions Full time

    Job Title: Software EngineerLocation: O Fallon MO 63366Type: 6 months contract on W2Description: Tricon Solutions is seeking a skilled Software Engineer to design, code, and maintain large data processing systems primarily in the Spark framework using Scala. The ideal candidate will have in-depth knowledge of algorithms and processing complexity, as well as...


  • O'Fallon, United States Tricon Solutions Full time

    Job Title: Software Engineer Location: O Fallon MO 63366 Type: 6 months contract on W2 Description: Seeking a Software Engineer who thrives on designing coding and maintaining large data processing systems primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with ...

  • Big Data Specialist

    4 weeks ago


    O'Fallon, Missouri, United States Diverse Lynx Full time

    Job Role: Big Data SpecialistJob Type: ContractLocation: RemoteJob Description:We are seeking a highly skilled Big Data Specialist to join our team at Diverse Lynx LLC. As a Big Data Specialist, you will be responsible for leading collaborative work in complex engineering projects in an Agile setting.Key Responsibilities:Develop and configure dashboards to...


  • O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Principal Software Engineer to join our Data Platforms and Engineering Services team. As a key member of this team, you will be responsible for driving the technology architecture, design, implementation, operation, and support of our data technology and platforms.The Mastercard Data Warehouse is the...

  • Software Engineer

    2 weeks ago


    O'Fallon, United States TechnoSmarts Full time

    TechnoSmarts has a Global Client, located in O'Fallon, MO seeking a Senior Engineer.This is a 6 month contract with potential for extension. Local candidates are desired as this is a Hybrid position requiring on-site presence.Seeking a Software Engineer who thrives on designing, coding, and maintaining large data processing systems, primarily in the Spark...

  • Software Engineer

    1 month ago


    O'Fallon, United States TechnoSmarts, Inc. Full time

    TechnoSmarts has a Global Client, located in O'Fallon, MO seeking a Senior Engineer.This is a 6 month contract with potential for extension. Local candidates are desired as this is a Hybrid position requiring on-site presence.Seeking a Software Engineer who thrives on designing, coding, and maintaining large data processing systems, primarily in the Spark...

  • Software Engineer II

    3 weeks ago


    O'Fallon, United States RIT Solutions, Inc. Full time

    Title: Software Engineer II - Level 8 Job Description: Glider Test: Software Engineer II - (Apache Spark, Airflow, Databricks, AWS, CICD and Coding(Java/Python/Scala) As a Software Engineer for the Graph and Tools Team, you will: Developing work experience with Java, J2EE, Spring and Microservices. Develop big data processing systems using Scala, Apache...

  • Data Engineer

    3 weeks ago


    O'Fallon, United States SBS Creatix Full time

    **No C2C Requests Please**Seeking a skilled and motivated Data Engineer to join an exciting and growing team. Play a crucial role in designing, developing, and maintaining the data infrastructure in the current environment. Will involve collaborating with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support...

  • Senior Data Engineer

    1 month ago


    O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mastercard. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business operations.Your primary focus will be on building and maintaining big data technologies, environments, and...


  • O'Fallon, United States MasterCard Full time

    Job Title: Cloud Data Engineering LeadJob Summary:We are seeking a highly skilled Cloud Data Engineering Lead to drive Predictive and Prescriptive Analytics solutions for our Loyalty Rewards & Segments Program. The successful candidate will design and implement new data pipelines, transfers, and compliance infrastructure to support cloud-based data...

  • Sr Data Engineer

    4 weeks ago


    O'Fallon, United States Tricon Solutions Full time

    ********* W2 ONLY ROLE NO C2C Only qualified candidates located near the OFallon MO area to be considered due to the position requiring an onsite presence ********* Job Title: Senior Data Engineer Location: OFallon MO Type: 9 months contract on W2 Role Overview: Seeking an enthusiastic and adaptable Senior Data Engineer ...

  • Sr Data Engineer

    2 weeks ago


    O'Fallon, United States Tricon Solutions Full time

    ********* W2 ONLY ROLE NO C2C Only qualified candidates located near the OFallon MO area to be considered due to the position requiring an onsite presence ********* Job Title: Senior Data Engineer Location: OFallon MO Type: 9 months contract on W2 Role Overview: Seeking an enthusiastic and adaptable Senior Data Engineer ...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Senior Software EngineeringJob Summary:Mastercard is seeking a Senior Software Engineering professional to join our Quality Engineering team. As a key member of our team, you will be responsible for driving quality and testing strategies to ensure the delivery of high-quality software products.Key Responsibilities: Develop and implement test...


  • O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Principal Data Architect to join our Data Platforms and Engineering Services team at Mastercard. As a key member of our team, you will be responsible for driving the technical vision and architecture for our data platforms and engineering services ecosystem.Key ResponsibilitiesSet and drive the technical...

  • Data Engineer

    2 weeks ago


    O'Fallon, IL, United States SBS Creatix Full time

    **No C2C Requests Please**Seeking a skilled and motivated Data Engineer to join an exciting and growing team. Play a crucial role in designing, developing, and maintaining the data infrastructure in the current environment. Will involve collaborating with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Lead Software EngineerAbout the Role:We are seeking a highly skilled Lead Software Engineer to join our team at Mastercard. As a Lead Software Engineer, you will be responsible for designing and implementing large-scale distributed systems using event-driven architectures. You will work closely with our product partners to drive prioritization...

  • Software Engineer

    3 weeks ago


    O'Fallon, United States Aloden, Inc. Full time

    Job Title: Software Engineer Job Location: O Fallon, MO Work Model: Hybrid Must Have Skills/Attributes: CI/CD tools, JavaScript, Jenkins, JMeter, Kafka, Karate, Microservices, Postman, Spring Boot Job Description ***Only qualified Software Engineer candidates located near (or willing to relocate to) the St. Louis, MO area to be considered due to the...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Senior Software EngineerAbout the Role:We are seeking a highly skilled Senior Software Engineer to join our team at Mastercard. As a Senior Software Engineer, you will be responsible for designing, developing, and deploying software solutions that meet the needs of our customers. You will work closely with cross-functional teams to deliver...


  • O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Mastercard Commercial Solutions team. As a Senior Software Engineer, you will play a key role in driving our customer experience strategy forward by consistently innovating and problem-solving.Key ResponsibilitiesOwn software delivery tasks (design, development, test,...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Principal Data ArchitectWe are seeking a highly skilled Principal Data Architect to lead our data engineering efforts and drive the development of advanced analytics solutions. As a key member of our team, you will be responsible for designing and implementing scalable data architectures, leading cross-functional teams, and collaborating with...