Data Engineer
4 weeks ago
The Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. The Data Engineer works with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data security and privacy measures. This role is crucial in enabling efficient and effective data-driven decision-making.
Essential Duties & Responsibilities
- Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
- Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs, including understanding data models/schemas and implementing ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination
- Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.
- Proficient in programming languages such as Python and SQL for database querying and manipulation.
- Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
- Knowledge of database design principles and experience with database management systems.
- Experience with data storage technologies like relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
- Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is essential and should be skilled at integrating disparate data sources and ensuring data quality and consistency.
- Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
- Familiarity with IAC such as Terraform, git, and DevOps pipelines.
- Strong analytical thinking and problem-solving abilities are essential to identify and resolve data-related issues effectively, with the ability to analyze complex data sets, identify patterns, and derive actionable insights.
- Awareness of data governance practices, data privacy regulations, and security protocols is crucial, with experience implementing data security measures and ensuring compliance with relevant standards is desirable.
- Bachelor's Degree in Computer Science, related field, or equivalent experience.
- 3+ years of post-Bachelor progressive experience in data engineering.
- Proficient in the following computer languages:
- Python
- SQL
- AWS technologies to include:
- Glue
- S3
- Redshift
- Lambda
- Lake Formation
- DataZone
About Stifel
Stifel is a more than 130 years old and still thinking like a start-up. We are a global wealth management and investment banking firm serious about innovation and fresh ideas. Built on a simple premise of safeguarding our clients’ money as if it were our own, coined by our namesake, Herman Stifel, our success is intimately tied to our commitment to helping families, companies, and municipalities find their own success.
While our headquarters is in St. Louis, we have offices in New York, San Francisco, Baltimore, London, Frankfurt, Toronto, and more than 400 other locations. Stifel is home to approximately 9,000 individuals who are currently building their careers as financial advisors, research analysts, project managers, marketing specialists, developers, bankers, operations associates, among hundreds more. Let’s talk about how you can find your place here at Stifel, where success meets success.
At Stifel we offer an entrepreneurial environment, comprehensive benefits package to include health, dental and vision care, 401k, wellness initiatives, life insurance, and paid time off.
Stifel is an Equal Opportunity Employer.
#LI-tw1
-
Data Engineer
1 month ago
St Louis, United States Envision Full timeData EngineerOnsite in St. Louis, MO, DIRECT HIRE, no C2C, must be a US Citizen.Needs to be a utility player in the data space. Hands on but also able to think, come up with solutions, be self-directed. They are trying to build a new data team so there isn’t a lot of room for people to hide.Qualifications:Heavy on SQL experience5-7 years of experience as a...
-
Data Engineer
1 month ago
St Louis, United States Envision Full timeData EngineerOnsite in St. Louis, MO, DIRECT HIRE, no C2C, must be a US Citizen.Needs to be a utility player in the data space. Hands on but also able to think, come up with solutions, be self-directed. They are trying to build a new data team so there isn’t a lot of room for people to hide.Qualifications:Heavy on SQL experience5-7 years of experience as a...
-
Data Engineer
1 week ago
St. Louis, United States Envision Full timeData EngineerOnsite in St. Louis, MO, DIRECT HIRE, no C2C, must be a US Citizen.Needs to be a utility player in the data space. Hands on but also able to think, come up with solutions, be self-directed. They are trying to build a new data team so there isn’t a lot of room for people to hide.Qualifications:Heavy on SQL experience5-7 years of experience as a...
-
Data Engineer
4 days ago
St Louis, United States ARCO a Family of Construction Companies Full timeABOUT YOU: Are you an expert with SQL? Do you have the ability to harness logic and reasoning to identify complex relationships. Do you thrive in a fast paced environment and are you looking to join a growing and dynamic team? If the answer is, "Yes!" then we have an exciting, long-term opportunity for you. Who are we? We are ARCO, a Family of Construction...
-
Senior Data Engineer
10 hours ago
St Louis, United States Technology Partners Full timeWe are building our core Data Team, as a Data Engineer, you will play a crucial role in building foundational datasets, designing pipelines, and developing the infrastructure to support them. Your work will accelerate decision-making processes for key project and business functions. If you're passionate about analytics, data models, and solving complex data...
-
Associate Manager, Data Engineer
4 days ago
St Louis, United States Energizer Holdings Full timeWhat you'll love about this job: Hybrid Opportunity | Exemplary 401(k) | Bonus Structure This is Energizer Holdings, Inc.: Energizer Holdings responsibly creates products to make lives easier and more enjoyable. To do this, we lean into our culture as an organization we win together, while serving each other, with a willingness to act boldly, all while...
-
2 Data Engineers
4 days ago
St Louis, Missouri, United States Randstad USA Full timejob summary: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. Education and...
-
Data Center Engineer
4 days ago
St Louis, United States Abile Group, Inc. Full timeOverview: Abile Group has an exciting and challenging opportunity for a Data Center Engineer on a 10 year contract providing User Facing and Data Center Services supporting an Intelligence Community customer. All the personnel on the team will work together to support innovative design, engineering, procurement, implementation, operations, sustainment and...
-
Linux Engineer
3 days ago
St Louis, United States Innovative Data Solutions, Inc. Full timeJob SummaryWe are seeking an experienced Linux Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph.Specific Duties and Responsibilities:Develops technical solutions for the management of networks, software, hardware, configurations, and...
-
Linux Engineer
2 days ago
St Louis, United States Innovative Data Solutions, Inc. Full timeJob SummaryWe are seeking an experienced Linux Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph. Specific Duties and Responsibilities: Develops technical solutions for the management of networks, software, hardware, configurations, and...
-
Golang Developer Data Engineer
4 days ago
St Louis, United States NetEffects Full timeW2 CANDIDATES ONLY PLEASE - C2C IS NOT ALLOWED BY THE CLIENT - VERY LONG TERM CONTRACT WITH BENEFITS AND PTO - FULLY REMOTE $80-85/hr. W2 plus benefits/PTO Required: Looking for Senior Golang Engineer w Experience in a Microservice Architecture environment , who would be excited to jump in and work in a Data Warehouse organization. This engineer will help to...
-
Golang Developer Data Engineer
5 days ago
St Louis, United States neteffects Full timeW2 CANDIDATES ONLY PLEASE - C2C IS NOT ALLOWED BY THE CLIENT - VERY LONG TERM CONTRACT WITH BENEFITS AND PTO - FULLY REMOTE$80-85/hr. W2 plus benefits/PTO Required:Looking for Senior Golang Engineer w Experience in a Microservice Architecture environment , who would be excited to jump in and work in a Data Warehouse organization.This engineer will help to...
-
Golang Developer Data Engineer
4 days ago
St Louis, United States neteffects Full timeW2 CANDIDATES ONLY PLEASE - C2C IS NOT ALLOWED BY THE CLIENT - VERY LONG TERM CONTRACT WITH BENEFITS AND PTO - FULLY REMOTE$80-85/hr. W2 plus benefits/PTO Required:Looking for Senior Golang Engineer w Experience in a Microservice Architecture environment , who would be excited to jump in and work in a Data Warehouse organization.This engineer will help to...
-
Linux Engineer
5 days ago
St Louis, United States Innovative Data Solutions, Inc. Full timeJob Summary We are seeking an experienced Linux Engineer to support an IC customer/contract in the St. Louis, MO area. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph. Specific Duties and Responsibilities:Develops technical solutions for the management of networks, software, hardware, configurations, and architectures...
-
Sr. Data Engineer
1 week ago
St. Louis, United States Dunhill Professional Search Full timeData Conversion EngineerUS Citizenship*St. Louis, MOOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies.The Data Conversion Team will be responsible for will be responsible for...
-
Data Conversion Engineer
3 weeks ago
St Louis, United States Dunhill Professional Search & Government Solutions Full timeData Conversion Engineer*Hybrid in San Antonio, TX or St Louis, MO (Relocation assistance offered)*U.S. Citizenship RequiredOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies.The...
-
Data Conversion Engineer
3 weeks ago
St Louis, United States Dunhill Professional Search & Government Solutions Full timeData Conversion Engineer*Hybrid in San Antonio, TX or St Louis, MO (Relocation assistance offered)*U.S. Citizenship RequiredOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies.The...
-
Data Conversion Engineer
3 weeks ago
St. Louis, United States Dunhill Professional Search & Government Solutions Full timeData Conversion Engineer*Hybrid in San Antonio, TX or St Louis, MO (Relocation assistance offered)*U.S. Citizenship RequiredOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies.The...
-
IEC Engineer
3 days ago
St Louis, United States Innovative Data Solutions, Inc. Full timeJob Summary We are seeking an experienced Active Directory Engineer to support an IC customer/contract in the St. Louis, MO area. Security requirements are a TS/SCI clearance and eligibility to obtain a CI polygraph. Specific Duties and Responsibilities: Collaborate and support the Senior Engineering and Project Integration staff in assessing,...
-
Reliability Engineer
3 days ago
St Albans, United States The Chemical Engineer Full timeThe world needs fresh and innovative solutions. We need YOU! Where the chemistry happens… Our team is searching for a Reliability Engineer to work at our Attapulgus, GA site for the BASF Catalyst division which is the world's leading supplier of environmental and process catalysts. The group offers exceptional expertise in the development of technologies...