(Big Data) Sr System Reliability Engineer
1 day ago
St Louis, Missouri (Hybrid, Resource is required in St Louis and ready to travel to Missouri office whenever required)
Skillset required: ITSM, Production Support, Hadoop, Hive, Spark, Nifi, Impala,
Secondary Skill: Git/BitBucket, Jenkins, Maven, Artifactory, and Chef
The Role
• Plan, manage, and oversee all aspects of a Production Environment for Big Data Platforms.
• Define strategies for Application Performance Monitoring, Optimization in Prod environment
• Respond to Incidents and improvise platform based on feedback and measure the reduction of incidents over time.
• Ensures that batch production scheduling and process are accurate and timely.
• Able to create and execute queries to big data platform and relational data tables to identify process issues or to perform mass updates, preferred.
• Performs ad hoc requests from users such as data research, file manipulation/transfer, research of process issues, etc.
• Take a holistic approach to problem solving, by connecting the dots during a production event through the various technology stack that makes up the platform, to optimize mean time to recover.
• Engage in and improve the whole lifecycle of services-from inception and design, through deployment, operation and refinement.
• Analyze ITSM activities of the platform and provide feedback loop to development teams on operational gaps or resiliency concerns.
• Support services before they go live through activities such as system design consulting, capacity planning and launch reviews.
• Support the application CI/CD pipeline for promoting software into higher environments through validation and operational gating, and lead Mastercard in DevOps automation and best practices.
• Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
• Scale systems sustainably through mechanisms like automation and evolve systems by pushing for changes that improve reliability and velocity.
• Work with a global team spread across tech hubs in multiple geographies and time zones.
• Ability to share knowledge and explain processes and procedures to others.
Requirements
• Experience in the Big Data technologies (Hadoop, Spark, Nifi, Impala)
• Experience with performing data analysis, data observability, data ingestion and data integration.
• 5+ years of relevant data engineering, data infrastructure, DataOps, DevOps, SRE, or general systems engineering experience.
• 5+ years of Experience in running Big Data production systems.
• 1+ years of Hands-on experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory, and Chef.
• Experience architecting and implementing data governance processes and tooling (such as data catalogs, lineage tools, role-based access control)
• Solid grasp of SQL fundamentals
• Experience with algorithms, data structures, scripting, pipeline management, and software design.
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
• Ability to help debug and optimize code and automate routine tasks.
• Ability to support many different stakeholders. Experience in dealing with difficult situations and making decisions with a sense of urgency is needed.
• Appetite for change and pushing the boundaries of what can be done with automation.
• Experience in working across development, operations, and product teams to prioritize needs and to build relationships is a must.
• Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort is desired.
• Good Handle on Change Management and Release Management aspects of Software.
Additional Remarks: Resource is required in St Louis and ready to travel to Missouri office whenever required
-
Sr System Reliability Engineer
11 hours ago
St Louis, United States Futran Tech Solutions Pvt. Ltd. Full timeWe have one requirement for SRE Bigdata (Hadoop). Location is St. Louis. It will be hybrid mode with one or two days in office every week. Please find the JD below: Sr System Reliability Engineer (Big Data)Location: St. Louis, MO Required Skills: ITSM, Production Support, Hadoop, Hive, Spark, Impala, Automation The Role • Plan, manage, and oversee all...
-
Sr. Data Engineer
3 days ago
St Louis, United States Brilliant Infotech Full timeRole: Sr. Data Engineer / Big Data Engineer Duration: 12Months -24 Months Location: St Louis, Missouri Client : Master Card Prime Vendor : MooFwd Pay Rate to candidate: On W2 Hourly - $60/hour - on Yearly Salary $120K/Year on C2C $70/hour Tax Terms : C2C and W2 Relocation : Okay (but preferred locals) Interview: Video Role • Develop high quality, secure...
-
Big Data Engineering Expert
4 days ago
St Louis, Missouri, United States ShiftCode Analytics Full timeJob Title: Big Data Engineering ExpertWe are seeking an experienced Big Data Engineering Expert to join our team at ShiftCode Analytics. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale big data processing systems. You will work closely with our development team to ensure that our data...
-
Sr. Cloud Data Engineer
1 month ago
St Louis, United States Adaptive Solutions Group Full timeOur top client in the travel/transportation industry is searching for a Sr. Cloud Data Engineer to join their team! Candidates must have 3+ years of experience with CosmosDB and Azure Cloud Workflows for this position. You will be responsible for migrating existing data platform solutions to the cloud, developing new data pipelines, and using Microsoft Azure...
-
Sr. Cloud Data Engineer
1 month ago
st. louis, United States Adaptive Solutions Group Full timeOur top client in the travel/transportation industry is searching for a Sr. Cloud Data Engineer to join their team! Candidates must have 3+ years of experience with CosmosDB and Azure Cloud Workflows for this position. You will be responsible for migrating existing data platform solutions to the cloud, developing new data pipelines, and using Microsoft Azure...
-
Sr System Reliability Engineer
1 day ago
St Louis, United States Futran Tech Solutions Pvt. Ltd. Full timeSr System Reliability Engineer (Automation)Location: St Louis, MO (Hybrid, 2 days onsite/ Week) Duration: Contract Salary/Rate Range: $50-55/hr Primary Skill: ITIL/ITSM, Linux, CI/CD pipeline, Jenkins, Shellscripting, Any Monitoring tool (Preferred Splunk/Dynatrace), Troubleshooting Secondary Skill: REST API, Bitbucket, Maven, SQL Preferubly looking for 5...
-
Sr System Reliability Engineer
1 day ago
Lake St Louis, United States Futran Tech Solutions Pvt. Ltd. Full timeSr System Reliability Engineer (Automation) Location: St Louis, MO (Hybrid, 2 days onsite/ Week) Primary Skill: ITIL/ITSM, Linux, CI/CD pipeline, Jenkins, Shellscripting, Any Monitoring tool (Preferred Splunk/Dynatrace), Troubleshooting Secondary Skill: REST API, Bitbucket, Maven, SQL Preferubly looking for 5 to 7 years of experience candiate The Role ...
-
Sr. Systems Engineer
1 day ago
St Louis, United States Motorola Solutions Full timeCompany Overview At Motorola Solutions, we're guided by a shared purpose - helping people be their best in the moments that matter - and we live up to our purpose every day by solving for safer. Because people can only be their best when they not only feel safe, but are safe. We're solving for safer by building the best possible technologies across every...
-
DevOps Engineer, Sr.
3 weeks ago
St Louis, United States William C Brown Inc Full timeDevOps Engineer, Sr. EOE Statement We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status or any other characteristic protected by law. Description Deliver simple solutions to complex problems...
-
DevOps Engineer, Sr.
1 month ago
St Louis, United States William C Brown Inc Full timeDevOps Engineer, Sr. EOE Statement We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status or any other characteristic protected by law. Description Deliver simple solutions to complex...
-
Sr. Systems Engineer
3 days ago
St Paul, United States Spectraforce Technologies Full timeJob Title: Sr. Systems Engineer Duration: 12 Months Location: St. Paul, MN 55117 Details: As a Sr. Systems Engineer, you will be a critical contributor on our Electrophysiology Systems Engineering team focused on delivering the future in Advanced Mapping technologies. This role will involve a range of responsibilities including but not limited to...
-
Sr. Systems Engineer
3 weeks ago
St Paul, United States Spectraforce Technologies Full timeJob Title: Sr. Systems Engineer Duration: 12 Months Location: St. Paul, MN, 55117 As a Sr. Systems Engineer, you will be a critical contributor on our Electrophysiology Systems Engineering team focused on delivering the future in Advanced Mapping technologies. This role will involve a range of responsibilities including but not limited to collaborating in...
-
Sr. Data Engineer
2 weeks ago
St Petersburg, United States Pitisci & Associates Full timeSenior Data EngineerW2 Contract - USC/GC only - NO THIRD PARTIESSt. Petersburg, FLPREFER LOCAL TO TAMPA BAYHybrid As part of the team, has primary responsibility of building Enterprise Data Integration solutions by analyzing and extracting data from various sources to generate data feeds to external entities. The Data Engineer will be responsible for...
-
Sr. Data Engineer
2 months ago
St. Louis, United States Envision LLC Full timeWhat you will do is why you should join us:• Be a critical senior member of a data engineering team focused on creating distributed analysis capabilities around a large variety of datasets• Take pride in software craftsmanship, apply a deep knowledge of algorithms and data structures to continuously improve and innovate• Work with other top-level...
-
Senior Data Engineer
3 weeks ago
St Louis, United States Daugherty Business Solutions Full timeTitle Senior Data Engineer (Databricks) OverviewThis is a full-time, employee position. Corp-to-Corp or 1099/W2 contract is NOT available for this position. Must be located in one of the following: Atlanta, Chicago, Columbus, Dallas, Minneapolis, New York Area, St. Louis. This position is mostly Remote but there may be certian clients/projects where onsite...
-
Data Engineer
7 months ago
St Louis, United States 1904labs Full timeAbout Us At 1904labs, we are a human-centered technology company that focuses on using modern tools and technologies to solve enterprise organizations' crunchiest challenges. We look for innovative, courageous, intensely curious, and team-minded people. At 1904labs, we are committed to providing each team member with opportunities that will allow personal...
-
Sr. Engineer
1 week ago
St Louis, United States 1975 EMD Millipore Corporation Full timeWork Location: St. Louis, Missouri Shift: No Department: LS-PS-ATA PDS Region 1 Recruiter: Troy Bradley This information is for internals only. Please do not share outside of the organization. Your Role: MilliporeSigma is looking for a Sr. Engineer to join the technical branch of the commercial organization in St. Louis area, supporting process development...
-
Cloud Reliability Engineer
3 weeks ago
St Louis, Missouri, United States Federal Reserve System Full timeAbout the OpportunityWe are seeking a highly skilled Cloud Reliability Engineer to join our team at the Federal Reserve System in Richmond, VA.As a key member of our Cloud Solutions & Services department, you will be responsible for implementing reliability practices using software as means for the cloud foundational product line.The ideal candidate will...
-
Sr. Java Data Engineer
2 weeks ago
St Petersburg, United States Pitisci & Associates Full timeSr. Java Data Engineer (Backend)W2 Contract - No Third PartiesSt. Petersburg, FLHybrid (2-3 days per week in office)MUST HAVE A USC OR GC - NO EXCEPTIONSSummary:We are seeking a Senior Java Data Engineer to model, design and build a consolidated database for consolidated order data across different asset classes. You will collaborate with Enterprise...
-
Sr. Mechanical Engineer
3 weeks ago
St Louis, United States Farnsworth Group Full timePosition: Sr. Mechanical Engineer - HVAC/Building Systems Location: St. Louis, MO Job Id: 2335 # of Openings: 1 Join us and grow your career with a certified Great Place to Work for the last nine years running. We are a team of Engineers, Architects, Surveyors and Scientists committed to making meaningful contributions to the world around us. Our quest...