Senior Data Engineer
4 weeks ago
At Worldpay, we're on a mission to revolutionize the way we work with data. As a Senior Data Engineer - Python Airflow, you'll play a pivotal role in shaping our Cloud Data Platform team's vision and strategy.
Key Responsibilities:- Develop and implement data engineering initiatives using Python, AWS, Airflow, and Snowflake technologies
- Monitor trends in the data engineering industry and stay up-to-date on current technologies
- Build complex data engineering pipelines using Python and Airflow
- Leverage AWS Glue, Step Functions, and other services for orchestrating data workflows
- Integrate code with defined CI/CD framework and AWS services required for building secure data pipelines
- Manage user access and permissions, ensuring data security and compliance with company policies
- Implement and monitor security controls, including encryption, authentication, and network security
- Manage data ingestion and ETL processes
- Automate routine tasks and processes using scripting and automation tools
- Maintain comprehensive documentation for configurations, procedures, and troubleshooting steps
- 5+ years in a pivotal Software/Data Engineering role with deep exposure to modern data stacks, particularly Snowflake, Airflow, DBT, and AWS data services
- Proficiency in cloud platforms such as AWS, Azure, or Google Cloud
- Experience with PySpark/Hadoop and/or AWS Glue ETL and/or Databricks w/ python is preferred. Must have experience on ETL development life cycle, best practices of ETL pipelines, thorough work experience on data warehouse using combination of Python, Snowflake & AWS Services
- Data engineering experience with AWS Services (S3, Lambda, Glue, Lake Formation, EMR), Kafka, Streaming, Databricks is highly preferred
- Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions
- Serving as the Databricks account owner, including security and privacy setup, marketplace plugins and integration with other tools
- Strong experience with Amazon Web Services (AWS) accounts and high-level usage monitoring
- Proficiency in scripting languages such as Python, Bash, or PowerShell
- Familiarity with monitoring and logging tools (e.g., Experience with AWS CLI and Networking
- Experience with developing monitoring architecture and implementing monitoring agents, dashboards, escalations, and alerts
- Knowledge of security controls for the public cloud (encryption of data in motion/rest and key management)
- Demonstrated knowledge and hands-on experience with AWS alerting/monitoring tools
- Python Certification
- Time to support charities and give back to your community
- Parental leave policy
- Global recognition platform
- Global employee assistance program
- Creative environment
We're an equal opportunities employer and welcome applications from all qualified candidates. For more information on how Worldpay protects personal information online, please see the Online Privacy Notice.
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Virtual Full timeJob Title: Senior Data EngineerJob Summary:Virtual is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have experience with enterprise data warehouse, integrations, and reporting visualizations. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities: Heavy on legacy programs, the...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Zodiac Solutions, Inc Full timeAbout Zodiac Solutions, Inc.We are a leading IT recruitment agency connecting talented professionals with exciting opportunities that match their career goals.About the RoleJob Title: Senior Data EngineerLocation: Remote (Columbus, OH preferred)Employment Type: ContractKey Responsibilities:Collaborate with the team to design and implement data platforms and...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Ohio State University Wexner Medical Center Full timeJob SummaryContribute to the development of strategic data initiatives and serve as a top-level technical expert for complex data and analytics projects. Collaborate with cross-functional teams to align IT solutions with business objectives and drive innovation in data-driven solutions.As a Senior Data Engineer, you will be responsible for designing,...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Virtual Full timeJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Virtual. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our enterprise data warehouse. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities:Design and implement ETL...
-
Columbus, Ohio, United States Amazon Data Services, Inc. Full timeAt Amazon Data Services, Inc., we're on a mission to deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. As a key member of our team, you'll collaborate with people across Amazon to help us achieve this vision.Job SummaryWe're seeking a Senior Civil Infrastructure...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Centraprise Full timeJob Overview:Centraprise is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have 14-16 years of experience in big data tools, infrastructure, and related technologies. The successful candidate will be responsible for analyzing and finding impacts of technical changes on migration efforts or business needs, performing...
-
Senior Data Architect
4 weeks ago
Columbus, Ohio, United States Revel IT Full timeJob DescriptionA Senior Data Engineer is needed for a contract-to-hire opportunity with Revel IT. The ideal candidate should have proficiency in data engineering for Azure Data Engineers. Mastery in designing robust, scalable, and secure data solutions on Azure is essential. This includes understanding Azure's data services ecosystem, such as Azure Data...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States altafiber Full timeJob SummaryThe Data Engineer III role is a technical lead position on the Analytics - Insights team at altafiber. This individual will be responsible for designing, building, and maintaining the CBTS Data Lake, as well as leading the data engineering team to build and maintain critical ETL processes that support the CBTS Data Strategy.Key...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Worldpay Full timeAbout The RoleWorldpay is seeking a skilled Senior Data Engineer to join our Cloud Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable workflows and orchestration systems using Astronomer and Airflow. Your expertise in cloud platforms, particularly AWS, and experience with data...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States CapTech Full timeJob DescriptionAt CapTech, we're passionate about empowering our clients to achieve their goals through innovative data engineering solutions. As a Cloud Data Architect, you'll play a crucial role in designing and implementing modern data pipelines that deliver optimal results.Key Responsibilities:Design and implement cloud-based data engineering...
-
Data Center Civil Engineering Manager
4 weeks ago
Columbus, Ohio, United States Amazon Data Services, Inc. Full timeAbout the RoleWe are seeking a highly experienced Civil Engineering Manager to lead our Data Center design team at Amazon Web Services. As a key member of our Americas Design Engineering team, you will be responsible for leading a team of civil engineers in the design of data center critical infrastructure systems.Your primary focus will be on facilitating...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Zodiac Solutions, Inc Full timeAbout Zodiac Solutions, Inc.We are a leading IT staffing agency connecting talented professionals with exciting opportunities that align with their career goals. Currently, we are hiring a Data Engineer for our client, an American multinational finance company.About the RoleWe are seeking a highly skilled Data Engineer with expertise in Python, AWS, and...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States BD (Becton, Dickinson and Company) Full timeJob Description SummarySr. Data Engineer (Databricks)Job DescriptionWe are the makers of possibleBD is one of the largest global medical technology companies in the world. Advancing the world of healthTM is our Purpose, and it's no small feat. It takes the imagination and passion of all of us—from design and engineering to the manufacturing and marketing...
-
Senior Data Architect
4 weeks ago
Columbus, Ohio, United States Revel IT Full timeJob Title: Senior Data ArchitectJob Summary:Revel IT is seeking a highly skilled Senior Data Architect to join our team. As a Senior Data Architect, you will be responsible for designing and implementing robust, scalable, and secure data solutions on Azure. This includes understanding Azure's data services ecosystem, such as Azure Data Lake, Azure Synapse...
-
Senior Data Engineer
1 month ago
Columbus, Ohio, United States Diverse Lynx Full timeJob Role: As a Senior Data Engineer, you will design and implement data pipelines using Python, Spark, and PySpark. You will handle migration to PySpark on AWS, develop and maintain data platforms, and work with AWS and Big Data. You will also produce unit tests for Spark transformations and helper methods, create Scala/Spark jobs for data transformation and...
-
Senior Data Architect
4 weeks ago
Columbus, Ohio, United States Insight Global Full timeJob DescriptionThe Senior Data Engineer is responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. This role collaborates closely with analysts and IT professionals to ensure efficient data modeling, ETL processes, and overall data architecture that supports business needs. The Senior Data...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Diverse Lynx Full timeJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data platforms using Python, Spark, and PySpark. Key Responsibilities: Develop and maintain data platforms using Python, Spark,...
-
Senior Data Product Lead
4 weeks ago
Columbus, Ohio, United States Western Alliance Bank Full timeJob Title: Senior Data Product LeadAbout the Role: As the Senior Data Product Lead at Western Alliance Bank, you will be responsible for leading the continuous delivery teams responsible for the data solutions required by our Regulatory Reporting program.Key Responsibilities:* Facilitate the use of agile best practices and continuous improvement in Product...
-
Senior Data Engineering Manager
4 weeks ago
Columbus, Ohio, United States BJSS Full timeAbout UsBJSS is an award-winning innovative tech consultancy that has been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organizations since 1993.We bring together teams of creative experts with diverse backgrounds and experiences, who enjoy working and learning in our collaborative and open...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States Diverse Lynx Full timeJob Title :Senior Data Engineer - Python Spark AWSLocation :Columbus, OH - non local candidates acceptedJob Responsibilities:Develop and maintain scalable data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement efficient data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations...