Data Engineer

7 days ago


St Louis, Missouri, United States Stifel Financial Full time
Summary

The Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. The Data Engineer works with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data security and privacy measures. This role is crucial in enabling efficient and effective data-driven decision-making.

Essential Duties & Responsibilities
  • Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
  • Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs, including understanding data models/schemas and implementing ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination
  • Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.
Qualifications
  • Proficient in programming languages such as Python and SQL for database querying and manipulation.
  • Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
  • Knowledge of database design principles and experience with database management systems.
  • Experience with data storage technologies like relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
  • Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is essential and should be skilled at integrating disparate data sources and ensuring data quality and consistency.
  • Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
  • Familiarity with IAC such as Terraform, git, and DevOps pipelines.
  • Strong analytical thinking and problem-solving abilities are essential to identify and resolve data-related issues effectively, with the ability to analyze complex data sets, identify patterns, and derive actionable insights.
  • Awareness of data governance practices, data privacy regulations, and security protocols is crucial, with experience implementing data security measures and ensuring compliance with relevant standards is desirable.
Education & Experience
  • Bachelor's Degree in Computer Science, related field, or equivalent experience.
  • 3+ years of post-Bachelor progressive experience in data engineering.
Systems & Technology
  • Proficient in the following computer languages:
    • Python
    • SQL
  • AWS technologies to include:
    • Glue
    • S3
    • Redshift
    • Lambda
    • Lake Formation
    • DataZone
About Stifel

Stifel is a more than 130 years old and still thinking like a start-up. We are a global wealth management and investment banking firm serious about innovation and fresh ideas. Built on a simple premise of safeguarding our clients' money as if it were our own, coined by our namesake, Herman Stifel, our success is intimately tied to our commitment to helping families, companies, and municipalities find their own success.

While our headquarters is in St. Louis, we have offices in New York, San Francisco, Baltimore, London, Frankfurt, Toronto, and more than 400 other locations. Stifel is home to approximately 9,000 individuals who are currently building their careers as financial advisors, research analysts, project managers, marketing specialists, developers, bankers, operations associates, among hundreds more. Let's talk about how you can find your place here at Stifel, where success meets success.

At Stifel we offer an entrepreneurial environment, comprehensive benefits package to include health, dental and vision care, 401k, wellness initiatives, life insurance, and paid time off.

Stifel is an Equal Opportunity Employer.

#LI-tw1

  • St Louis, Missouri, United States US Tech Solutions Full time

    Job Description:Be a critical senior member of a data engineering team focused on creating distributed analysis capabilities around a large variety of datasets Take pride in software craftsmanship, apply a deep knowledge of algorithms and data structures to continuously improve and innovate Work with other top-level talent solving a wide range of complex and...

  • Linux Engineer

    7 days ago


    St Louis, Missouri, United States Innovative Data Solutions, Inc. Full time

    Job Summary We are seeking an experienced Linux Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph. Specific Duties and Responsibilities:Develops technical solutions for the management of networks, software, hardware, configurations, and architectures...

  • Linux Engineer

    7 days ago


    St Louis, Missouri, United States Innovative Data Solutions, Inc. Full time

    Job Summary We are seeking an experienced Linux Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph. Specific Duties and Responsibilities: Develops technical solutions for the management of networks, software, hardware, configurations, and architectures...


  • St Louis, Missouri, United States Energizer Holdings Full time

    What you'll love about this job:Hybrid Opportunity | Exemplary 401(k) | Bonus Structure This is Energizer Holdings, Inc:Energizer Holdings responsibly creates products to make lives easier and more enjoyable. To do this, we lean into our culture as an organization – we win together, while serving each other, with a willingness to act boldly, all while...

  • 2 Data Engineers

    1 month ago


    St Louis, Missouri, United States Randstad USA Full time

    job summary: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. Education and...

  • 2 Data Engineers

    3 weeks ago


    St Louis, Missouri, United States Randstad USA Full time

    job summary: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. Education and...


  • St Louis, Missouri, United States Secure Data Technologies Inc Full time

    About the position: If you're pumped up to start making a real difference in a tech company with mad growth potential, this gig as a Professional Services Delivery Network Engineer at Secure Data Technologies is where it's at. You'll be part of a killer squad that's all about creating top-notch experiences for clients. The role of Professional Services...

  • Software Engineer

    7 days ago


    St Louis, Missouri, United States (EDO) Entertainment Data Oracle, Inc. Full time

    Freedom Technology Solutions Group is seeking a Software Engineer to support our client's intelligence analysis products and capabilities. This position involves providing software development capabilities to enhance existing and emerging client capabilities, including design and development, modernization of existing applications and services, and...

  • Windows Engineer

    7 days ago


    St Louis, Missouri, United States Innovative Data Solutions, Inc. Full time

    Job Summary We are seeking an experienced Windows Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires an intimate familiarity with Group Policies (GPOs) and Active Directory (ADUC) with experience in other Microsoft related Administration Tools to perform day-to-day duties. Security requirements are a TS/SCI...


  • St Louis, Missouri, United States NetEffects Full time

    W2 CANDIDATES ONLY PLEASE - C2C IS NOT ALLOWED BY THE CLIENT - VERY LONG TERM CONTRACT WITH BENEFITS AND PTO - FULLY REMOTE Find out more about this role by reading the information below, then apply to be considered. $80-85/hr. W2 plus benefits/PTO Required: Looking for Senior Golang Engineer w Experience in a Microservice Architecture environment , who...

  • Sr. Data Engineer

    7 days ago


    St Louis, Missouri, United States Dunhill Professional Search Full time

    Data Conversion Engineer Have you got what it takes to succeed The following information should be read carefully by all candidates.US Citizenship*St. Louis, MOOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice Their mission is to use technology and ingenuity to help the US...


  • St Louis, Missouri, United States Network and Data Solutions Integrators (NDSI) Full time

    Deliver simple solutions to complex problems as a Systems Engineer (Project Manager) at NDSI. Here, you'll tailor cutting-edge solutions to the unique requirements of our clients. With a career in application development, you'll make the end user's experience your priority and we'll make your career growth ours. At NDSI, people are our differentiator. As a...


  • St Louis, Missouri, United States Diverse Lynx Full time

    Job Title: Data Architect with Data Modelling Exp - Mobile IT Location: REMOTE (St. Louis) Job Description:JOB SCOPEHands on Data Architect with Data Modelling experience will be responsible for end-to-end vision on how a logical design will translate to one or more data repositories and how the data will flow through the stages involved. The architect will...

  • Cyber Data Analyst

    7 days ago


    St Louis, Missouri, United States Abile Group, Inc. Full time

    Overview: Abile Group has an exciting and challenging opportunity for a Cyber Data Analyst supporting an Intelligence Community Customer. The team member shall provide cybersecurity data analysis services, which designs, develops, builds, tests, configures, employs, operates, integrates, sustains, and refreshes the Security Information Events Management...


  • St Louis, Missouri, United States Motion Recruitment Partners LLC Full time

    Outstanding long-term contract opportunity A well-known Financial Services Company is looking for a Software Engineer in Saint Louis, MO (Hybrid).Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that includes a competitive benefit package Our client has been around for over 150...

  • Data Steward

    7 days ago


    St Louis, Missouri, United States Tekwissen Full time

    Overview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. This client is a German multinational Pharmaceutical and biotechnology company and one of the largest pharmaceutical companies in the world, headquartered in Leverkusen, and areas of business include pharmaceuticals; consumer healthcare...

  • Data Steward

    7 days ago


    St Louis, Missouri, United States Experis Full time

    Our client, one of the largest Pharma & Biotech companies in the U.S., is looking for a Data Steward which is located at St. Louis, MO. As a Data Steward, you will be responsible for analyzing datasets across multiple data warehouses, which are based on GCP, Azure and SAP BW platforms and ensuring the quality, and integrity of organizational data. Job...

  • Data Steward

    7 days ago


    St Louis, Missouri, United States Manpower Group Inc. Full time

    Our client, one of the largest Pharma & Biotech companies in the U.S., is looking for a Data Steward which is located at St. Louis, MO . As a Data Steward, you will be responsible for analyzing datasets across multiple data warehouses, which are based on GCP, Azure and SAP BW platforms and ensuring the quality, and integrity of organizational data.Job Title:...

  • Data Analyst

    7 days ago


    St Louis, Missouri, United States ARCO a Family of Construction Companies Full time

    ABOUT YOU: Do you have strong analytical skills? Do you have the ability to harness logic and reasoning to identify complex relationships. Do you thrive in a fast paced environment and are you looking to join a growing and dynamic team? If the answer is, "Yes" then we have an exciting, long-term opportunity for you. Who are we? We are ARCO, a Family of...

  • Senior Data Scientist

    4 weeks ago


    St Louis, Missouri, United States Cognizant Full time

    Sr Data Scientist Qualification: • Post-grad in one of the following fields with strong academic credentials:• Computer Science/IT. • Operations Research/Applied Math. • Engineering. • Statistics. Responsibility: Business:'•Works with the business team to identify the right business problem, gather the requirements and data required to answer...