Data Engineer

4 weeks ago


O'Fallon, Missouri, United States Tricon Solutions Full time

Job Title: Data Engineer

Location: O Fallon MO 63366

Type: 6 months contract on W2

Description:

We are seeking a highly skilled Data Engineer to join our team at Tricon Solutions. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and related technologies.

Responsibilities:

  • Develop big data processing systems using Scala, Apache Spark, Airflow, Databricks, and related technologies
  • Run our ingestion and publishing processes and debug problems when they occur
  • Follow SDLC and best practices for clean code and architecture
  • Impact system architecture and improve overall system efficiency with growing business needs
  • Deliver assigned work with guidance from experienced team members
  • Understand and follow standard branching (e.g. Gitflow) and peer review practices
  • Understand the big picture and end-to-end logical architecture of systems in ownership areas
  • Provide feedback and suggestions on areas to improve
  • Understand requirement analysis being an essential part of delivering value to our customers and partners and participate in elaboration, prioritization, and effort estimation
  • Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines, virtualization, and containerization
  • Understand the use of Client technology policies in everyday work
  • Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives

Qualifications:

  • Self-motivated learner willing to take on challenging problems
  • Aptitude to learn new languages and technologies as necessary
  • Ability to write clean, readable, and maintainable code that follows best practices
  • Passion for diving deep into data and insights
  • Indepth knowledge of one or more Internet protocols
  • Experience with one or more strongly typed programming languages
  • BS degree in Computer Science or related degree or equivalent
  • Understanding/experience in Apache Spark, Airflow, Databricks, AWS, and related technologies
  • Fluency in one or more languages like Scala, Java, Python, etc.
  • Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines, virtualization, and containerization

Desired Skills/Certifications:

  • Data Engineer/SDET
  • Knowledge of Microservices and scaling techniques
  • Experience using web service APIs
  • Ability to create good acceptance and integration test automation scripts and integrate with Continuous Integration (Jenkins/Bamboo) and code coverage tools (Sonar)
  • Certified Associate in Software Testing (CAST)
  • AWS Certified

Java, Scala, Spark, Big Data, Airflow, Databricks


  • Senior Data Engineer

    4 weeks ago


    O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mastercard. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business operations.Your primary focus will be on building and maintaining big data technologies, environments, and...

  • Data Engineer

    4 weeks ago


    O'Fallon, Missouri, United States Red River Full time

    Position Overview:We are seeking a highly skilled and motivated Data Engineer to support the Defense Information Systems Agency (DISA) at Scott Air Force Base. The successful candidate will play a crucial role in designing, developing, and maintaining data infrastructure and pipelines to support the federation of structured and unstructured data across the...

  • Senior Data Engineer

    4 weeks ago


    O'Fallon, Missouri, United States MasterCard Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our Customer Intelligence Data Strategy and Enablement team. The successful candidate will be responsible for designing and surfacing critical customer data visualizations and insights to our internal and external stakeholders.The ideal candidate will have experience with data modeling,...


  • O'Fallon, Missouri, United States Tricon Solutions Full time

    Job Title: Software EngineerLocation: O Fallon MO 63366Type: 6 months contract on W2Description: Tricon Solutions is seeking a skilled Software Engineer to design, code, and maintain large data processing systems primarily in the Spark framework using Scala. The ideal candidate will have in-depth knowledge of algorithms and processing complexity, as well as...


  • O'Fallon, Missouri, United States TalTeam Full time

    Job Description:At TalTeam Inc., we are seeking a highly skilled Senior Data Processing Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, coding, and maintaining large data processing systems, primarily in the Spark framework using Scala. Our ideal candidate will have a deep understanding of the...


  • O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Principal Software Engineer to join our Data Platforms and Engineering Services team. As a key member of this team, you will be responsible for driving the technology architecture, design, implementation, operation, and support of our data technology and platforms.The Mastercard Data Warehouse is the...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Principal Data ArchitectWe are seeking a highly skilled Principal Data Architect to lead our data engineering efforts and drive the development of advanced analytics solutions. As a key member of our team, you will be responsible for designing and implementing scalable data architectures, leading cross-functional teams, and collaborating with...

  • Big Data Specialist

    3 weeks ago


    O'Fallon, Missouri, United States Diverse Lynx Full time

    Job Role: Big Data SpecialistJob Type: ContractLocation: RemoteJob Description:We are seeking a highly skilled Big Data Specialist to join our team at Diverse Lynx LLC. As a Big Data Specialist, you will be responsible for leading collaborative work in complex engineering projects in an Agile setting.Key Responsibilities:Develop and configure dashboards to...


  • O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Senior Principal Data Architect to join our Data Platforms and Engineering Services team at Mastercard. As a key member of our team, you will be responsible for driving the technical vision and architecture for our data platforms and engineering services ecosystem.Key ResponsibilitiesSet and drive the technical...

  • Lead Data Scientist

    4 weeks ago


    O'Fallon, Missouri, United States MasterCard Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our Architecture & Technology (A&T) team at Mastercard. As a key member of our Office of the CTO, you will lead the design and development of innovative machine learning models and data analytics solutions to address key business challenges and drive strategic initiatives.Key...

  • Platform Engineer I

    3 weeks ago


    O'Fallon, Missouri, United States MasterCard Full time

    About the RoleMastercard is seeking a highly skilled Platform Engineer I to join our team. As a Platform Engineer I, you will be responsible for the development, building, and maintenance of assigned platform technologies and associated software products.Key Responsibilities Assist with the development, building, and maintenance of assigned platform...

  • Sales Professional

    4 weeks ago


    O'Fallon, Missouri, United States Secure Data Technologies, Inc. Full time

    About the Role:The Sales Executive at Secure Data Technologies will play a crucial role in driving business growth through lead generation, new logo acquisition, and establishing strong relationships with potential clients. This role is focused on hunting new business opportunities and will work closely with our Solutions Architects and our Account Managers...

  • Cooperative Engineer

    4 weeks ago


    O'Fallon, Missouri, United States Rawlings Sporting Goods Company Inc Full time

    Job OverviewThis is an exciting opportunity to join our team as a Quality Assurance/Product Development Co-op Engineer at Rawlings Sporting Goods Company Inc.Job ResponsibilitiesPerform quality audits and new product development testing of sporting goods items, including detailed testing and measuring requirements.Review and test returned goods, including...


  • O'Fallon, Missouri, United States MasterCard Full time

    We are seeking a highly skilled Principal BizOps Engineer to join our team at Mastercard. As a key member of our Business Operations team, you will play a critical role in leading the DevOps transformation across the organization.Key responsibilities will include:Engaging in and improving the whole lifecycle of services-from inception and design, through...


  • O'Fallon, Missouri, United States AFB International Full time

    We are seeking a highly skilled Manufacturing Engineer to join our team at AFB International. As a key member of our operations team, you will be responsible for designing, overseeing, and implementing processes that efficiently make products or provide services.The goal of a Manufacturing Engineer is to create systems that make the best use of workers,...


  • O'Fallon, Missouri, United States Ensign-Bickford Industries, (EBI) Full time

    Job SummaryA Manufacturing Engineer I is responsible for designing, overseeing, and implementing processes that efficiently produce products or provide services. The goal is to create systems that make the best use of workers, machines, materials, information, and energy.Key ResponsibilitiesReview production schedules, design specifications, workflows, and...


  • O'Fallon, Missouri, United States Leidos Full time

    Job Summary:As a Network Engineering Implementation Specialist at Leidos, you will be responsible for coordinating with customers to manage the installation, configuration, testing, and monitoring of network equipment for Department of Defense projects. This role requires a strong understanding of network hardware equipment specifications, configuration, and...


  • O'Fallon, Missouri, United States Leidos Full time

    Job Summary:As a Network Solutions Engineer at Leidos, you will be responsible for designing, implementing, and maintaining network infrastructure for Department of Defense networks. Your expertise will be crucial in ensuring the accuracy and proper formatting of location and interface data. You will work closely with project managers and customers to...


  • O'Fallon, Missouri, United States MasterCard Full time

    Job Title: Senior Software EngineeringJob Summary:Mastercard is seeking a Senior Software Engineering professional to join our Quality Engineering team. As a key member of our team, you will be responsible for driving quality and testing strategies to ensure the delivery of high-quality software products.Key Responsibilities: Develop and implement test...


  • O'Fallon, Missouri, United States MasterCard Full time

    We strive to create a connected and inclusive digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible.Using secure data and networks, partnerships, and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.We foster a...