Data Engineer
Found in: beBee S US - 1 week ago
Summary
The Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. The Data Engineer works with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data security and privacy measures. This role is crucial in enabling efficient and effective data-driven decision-making.
Essential Duties & Responsibilities
- Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
- Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs, including understanding data models/schemas and implementing ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination
- Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.
Qualifications
- Proficient in programming languages such as Python and SQL for database querying and manipulation.
- Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
- Knowledge of database design principles and experience with database management systems.
- Experience with data storage technologies like relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
- Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is essential and should be skilled at integrating disparate data sources and ensuring data quality and consistency.
- Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
- Familiarity with IAC such as Terraform, git, and DevOps pipelines.
- Strong analytical thinking and problem-solving abilities are essential to identify and resolve data-related issues effectively, with the ability to analyze complex data sets, identify patterns, and derive actionable insights.
- Awareness of data governance practices, data privacy regulations, and security protocols is crucial, with experience implementing data security measures and ensuring compliance with relevant standards is desirable.
Education & Experience
- Bachelor's Degree in Computer Science, related field, or equivalent experience.
- 3+ years of post-Bachelor progressive experience in data engineering.
Systems & Technology
- Proficient in the following computer languages:
- Python
- SQL
- AWS technologies to include:
- Glue
- S3
- Redshift
- Lambda
- Lake Formation
- DataZone
About Stifel
Stifel is a more than 130 years old and still thinking like a start-up. We are a global wealth management and investment banking firm serious about innovation and fresh ideas. Built on a simple premise of safeguarding our clients’ money as if it were our own, coined by our namesake, Herman Stifel, our success is intimately tied to our commitment to helping families, companies, and municipalities find their own success.
While our headquarters is in St. Louis, we have offices in New York, San Francisco, Baltimore, London, Frankfurt, Toronto, and more than 400 other locations. Stifel is home to approximately 9,000 individuals who are currently building their careers as financial advisors, research analysts, project managers, marketing specialists, developers, bankers, operations associates, among hundreds more. Let’s talk about how you can find your place here at Stifel, where success meets success.
At Stifel we offer an entrepreneurial environment, comprehensive benefits package to include health, dental and vision care, 401k, wellness initiatives, life insurance, and paid time off.
Stifel is an Equal Opportunity Employer.
#LI-tw1
-
Data Engineer
Found in: Appcast Linkedin GBL C2 - 7 days ago
St Louis, United States Envision Full timeData EngineerOnsite in St. Louis, MO, DIRECT HIRE, no C2C, must be a US Citizen.Needs to be a utility player in the data space. Hands on but also able to think, come up with solutions, be self-directed. They are trying to build a new data team so there isn’t a lot of room for people to hide.Qualifications:Heavy on SQL experience5-7 years of experience as a...
-
Data Engineer
Found in: Appcast US C2 - 7 days ago
St Louis, United States Envision Full timeData EngineerOnsite in St. Louis, MO, DIRECT HIRE, no C2C, must be a US Citizen.Needs to be a utility player in the data space. Hands on but also able to think, come up with solutions, be self-directed. They are trying to build a new data team so there isn’t a lot of room for people to hide.Qualifications:Heavy on SQL experience5-7 years of experience as a...
-
Data Engineer
Found in: beBee jobs US - 2 weeks ago
St Louis, Missouri, United States tapwage Full timeSummaryThe Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. The Data Engineer works with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data...
-
Cloud Data Engineer
7 days ago
St Louis, United States Dunhill Professional Search Full timeOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies. The Cloud Data Engineer will help to build the infrastructure to answer questions with data, using software engineering best...
-
Cloud Data Engineer
Found in: Appcast Linkedin GBL C2 - 3 weeks ago
St Louis, United States Dunhill Professional Search & Government Solutions Full timeOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies. The Cloud Data Engineer will help to build the infrastructure to answer questions with data, using software engineering best...
-
Cloud Data Engineer
Found in: Appcast US C2 - 1 week ago
St Louis, United States Dunhill Professional Search & Government Solutions Full timeOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies. The Cloud Data Engineer will help to build the infrastructure to answer questions with data, using software engineering best...
-
Cloud Data Engineer
1 week ago
St Louis, United States Dunhill Professional Search Full timeOur client is a leader in federal IT consulting and is looking for talented individuals to join their AI & Technology practice! Their mission is to use technology and ingenuity to help the US government across a variety of agencies. The Cloud Data Engineer will help to build the infrastructure to answer questions with data, using software engineering best...
-
Data Infrastructure Engineer
Found in: Appcast US C2 - 3 weeks ago
St Louis, United States Blue Signal Search Full timeJoin an esteemed organization in the financial services sector, recognized for its innovative approach and commitment to excellence in asset management. Our client has established a significant presence in the industry, driven by a passion for delivering value-driven investment solutions. Their approach combines deep market insight with a dedication to...
-
Data Infrastructure Engineer
3 weeks ago
St. Louis, United States Blue Signal Search Full timeJoin an esteemed organization in the financial services sector, recognized for its innovative approach and commitment to excellence in asset management. Our client has established a significant presence in the industry, driven by a passion for delivering value-driven investment solutions. Their approach combines deep market insight with a dedication to...
-
Data Infrastructure Engineer
Found in: Appcast Linkedin GBL C2 - 3 weeks ago
St Louis, United States Blue Signal Search Full timeJoin an esteemed organization in the financial services sector, recognized for its innovative approach and commitment to excellence in asset management. Our client has established a significant presence in the industry, driven by a passion for delivering value-driven investment solutions. Their approach combines deep market insight with a dedication to...
-
Senior Structural Engineer
3 days ago
St Louis, United States Energy Jobline CVL Full timeJob DescriptionOlssons Data Center structural engineers strive to engrain themselves within our clients programs and act as an extension of the clients in-house staff. Our structural staff has over 100 years in combined experience in multiple project types, including, component design, industrial, civic, commercial, educational, healthcare, and of course...
-
Senior Structural Engineer
4 days ago
St Louis, United States Energy Jobline CVL Full timeJob Description Olsson’s Data Center structural engineers strive to engrain themselves within our clients’ programs and act as an extension of the client’s in-house staff. Our structural staff has over 100 years in combined experience in multiple project types, including, component design, industrial, civic, commercial, educational, healthcare, and of...
-
Product Data Management Engineer 4
1 week ago
St Louis, United States CareerBuilder Full timeContract (11 months 30 days) Published 2 days ago Configuration Management Data Management Oversees and leads the development, analysis, management and compliance verification of process and product baselines of highly integrated complex products. Leads the definition and planning of comprehensive sets of product and subsystem level technical design reviews...
-
Data Analyst
1 week ago
St Louis, United States Advanced Hires Full timeTitle: Data analyst Location: St. Louis, MO (Onsite) Duration: Long term contract Job Description: The job involves analyzing and documenting the current SQL scripts flow and assisting in daily support. We are looking for an Expert SQL candidate. Education and Work Experience Requirements: 7+ years with RDBMS, TD (Teradata) and GCP big Query is preferred....
-
RQ151058 - Systems Engineer (Project Manager) - Security Clearance Required
Found in: Talent US A C2 - 2 weeks ago
St. Louis, United States Network and Data Solutions Integrators (NDSI) Full timeDeliver simple solutions to complex problems as a Systems Engineer (Project Manager) at NDSI. Here, you’ll tailor cutting-edge solutions to the unique requirements of our clients. With a career in application development, you’ll make the end user’s experience your priority and we’ll make your career growth ours. At NDSI, people are our...
-
Data Scientist
6 days ago
St. Louis, United States StevenDouglas Full timeHYBRID ONSITE in ST LOUIS MOMUST BE USC OR GC HOLDERPosition Overview: We are seeking a Senior Data Scientist to leverage our extensive data resources in delivering actionable business insights through analytics, predictive modeling, machine learning, and artificial intelligence. The ideal candidate will have a robust technology background with advanced...
-
Data Scientist
Found in: Appcast Linkedin GBL C2 - 6 days ago
St Louis, United States StevenDouglas Full timeHYBRID ONSITE in ST LOUIS MOMUST BE USC OR GC HOLDERPosition Overview: We are seeking a Senior Data Scientist to leverage our extensive data resources in delivering actionable business insights through analytics, predictive modeling, machine learning, and artificial intelligence. The ideal candidate will have a robust technology background with advanced...
-
Data Scientist
Found in: Appcast US C2 - 6 days ago
St Louis, United States StevenDouglas Full timeHYBRID ONSITE in ST LOUIS MOMUST BE USC OR GC HOLDERPosition Overview: We are seeking a Senior Data Scientist to leverage our extensive data resources in delivering actionable business insights through analytics, predictive modeling, machine learning, and artificial intelligence. The ideal candidate will have a robust technology background with advanced...
-
Data Scientist
Found in: beBee jobs US - 2 weeks ago
St Louis, Missouri, United States Equifax Full timeIf you get excited about designing & developing Machine Learning solutions blending science, art & business logic and unlocking the power of data to solve complex business problems, we would love to hear from youAs a Data scientist within the Data & Analytics team at Equifax Canada, you will be essential to driving Data Science forward, working closely with...
-
Data Analyst
1 week ago
St. Louis, United States Envision, LLC Full timeKey Tasks & ResponsibilitiesFocus on the data management and ensure data governance best practices are implemented to manage data domain, data integration, data quality, and data accessCreate processes and metrics to ensure and validate data accuracy and consistency across different data systemsAutomatically manage and consolidate data from various data...