Senior Data Engineer
1 day ago
Job Title :
Senior Data Engineer - Python Spark AWS
Location :
Columbus, OH - non local candidates accepted
Job Responsibilities:
Develop and maintain scalable data platforms using Python, Spark, and PySpark on AWS. Handle migration to PySpark and design data pipelines. Work with distributed systems, AWS, and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for code. Optimize Spark queries for performance. Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Skills:
Proficiency in Python, Scala (with a focus on functional programming), and Spark. Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming. Experience working with HDFS, S3, Cassandra, and/or DynamoDB. Deep understanding of distributed systems. Experience with building or maintaining cloud-native applications. Familiarity with serverless approaches using AWS Lambda is a plus.
Company Culture:
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. We promote and support a diverse workforce across all levels in the company.
-
Senior Data Engineer
1 day ago
Columbus, Ohio, United States Vaco Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Vaco. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data warehouses and data lakesDevelop and maintain ETL processes and...
-
Senior Data Engineer
3 weeks ago
Columbus, Ohio, United States g2o Full timeUnlock Your Potential as a Senior Data EngineerAt g2o, we're on a mission to help clients build better relationships with their customers. As a Senior Data Engineer, you'll play a crucial role in executing our clients' digital strategies and driving real business results.Key Responsibilities:Collaborate with technical teams to develop, deploy, and support...
-
Senior Data Engineer
1 day ago
Columbus, Ohio, United States Insight Global Full timeJob SummaryThe Senior Data Engineer is responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. This role collaborates closely with analysts and IT professionals to ensure efficient data modeling, ETL processes, and overall data architecture that supports business needs. The Senior Data Engineer...
-
Data Engineering Senior Analyst
5 days ago
Columbus, Ohio, United States Hispanic Technology Executive Council Full timeJob Title: Data Engineering Senior AnalystWe are seeking a highly skilled Data Engineering Senior Analyst to join our team at the Hispanic Technology Executive Council. As a key member of our organization, you will play a critical role in shaping our data engineering strategy and driving business growth through data-driven insights.About the Role:The Data...
-
Senior Mechanical Engineer
3 weeks ago
Columbus, Ohio, United States Amazon Data Services, Inc. Full timeAbout the RoleWe are seeking a highly skilled Mechanical Engineer to join our team as a Fleet Remediation Project Design Engineer. As a key member of our team, you will be responsible for leading design projects in operational data centers, remediating issues, upgrading existing infrastructure, and adding new services.Key ResponsibilitiesOwn the design for...
-
Senior Data Engineer
2 weeks ago
Columbus, Ohio, United States Worldpay Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Cloud Data Platform team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data engineering pipelines using Python, AWS, and Airflow technologies.About the RoleThe Senior Data Engineer will work closely with...
-
Senior Data Engineer
19 minutes ago
Columbus, Ohio, United States Ohio State University Wexner Medical Center Full timeJob SummaryContribute to the development of strategic data initiatives and serve as a top-level technical expert for complex data and analytics projects. Collaborate with cross-functional teams to align IT solutions with business objectives and drive innovation in data-driven solutions.As a Senior Data Engineer, you will be responsible for designing,...
-
Senior Data Engineer
1 day ago
Columbus, Ohio, United States Virtual Full timeJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Virtual. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our enterprise data warehouse. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities:Design and implement ETL...
-
Senior Data Engineer
1 day ago
Columbus, Ohio, United States Pinnacle Group Full timeJob Summary:As a Senior Data Engineer at Pinnacle Group, you will be responsible for designing and developing data ingestion pipelines using AWS services and Databricks platform. This will enable downstream applications and Tableau Dashboards that drive business value across different parts of Employee Platform functions.Key Responsibilities:- Design and...
-
Senior Snowflake Data Engineer
4 weeks ago
Columbus, Ohio, United States Artmac Soft LLC Full timeJob Title: Senior Snowflake Data EngineerAt Artmac Soft LLC, we are seeking a highly skilled Senior Snowflake Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing Snowpipe to automate and streamline the ingestion of data files from Amazon S3 into Snowflake.Key...
-
Senior Data Engineer
16 hours ago
Columbus, Ohio, United States Centraprise Full timeJob Overview:Centraprise is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have 14-16 years of experience in big data tools, infrastructure, and related technologies. The successful candidate will be responsible for analyzing and finding impacts of technical changes on migration efforts or business needs, performing...
-
Senior Data Protection Engineer
3 weeks ago
Columbus, Ohio, United States Fiserv Full timeJob Title: Senior Data Protection EngineerFiserv is seeking a highly skilled Senior Data Protection Engineer to join our Cybersecurity team. As a key member of our team, you will be responsible for designing and implementing robust security measures to safeguard our technology infrastructure from potential threats.Key Responsibilities:Lead the implementation...
-
Senior Data Protection Engineer
4 weeks ago
Columbus, Ohio, United States Fiserv Full timeJob Title: Senior Data Protection EngineerFiserv is seeking a highly skilled Senior Data Protection Engineer to join our dynamic Cybersecurity team. As a key member of our team, you will be responsible for safeguarding our technology infrastructure from potential threats and developing robust security measures to meet the latest challenges.Key...
-
Senior Data Engineer
3 days ago
Columbus, Ohio, United States Hispanic Technology Executive Council Full timeJob DescriptionWe are the Advanced Technology Centers (ATCs), the engine for reinvention in our clients' transformation journey. With over 255,000 people across 24 countries, we provide seamless access to industry insights and innovative technology solutions.As a Senior Data Engineer, you will be part of a highly collaborative and growing network of...
-
Mechanical Engineer
3 weeks ago
Columbus, Ohio, United States Amazon Data Services, Inc. Full timeAbout the RoleWe are seeking a highly skilled Mechanical Engineer to join our team as a Fleet Remediation Project Design Engineer. In this role, you will lead design projects in operational data centers, remediate issues, upgrade our existing infrastructure, or add new services.You will be the 'go to' engineering resource for these projects and will provide...
-
Senior Data Engineer
5 days ago
Columbus, Ohio, United States Worldpay Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Cloud Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable workflows and orchestration systems using Astronomer and Airflow.Key ResponsibilitiesDevelop and implement strategies for data engineering initiatives...
-
Senior Data Engineer
4 days ago
Columbus, Ohio, United States g2o Full timeUnlock Your Potential as a Cloud Data EngineerAt g2o, we're on a mission to revolutionize the way our clients interact with their customers. As a Senior Data Engineer, you'll play a crucial role in helping us achieve this vision.Key Responsibilities:Collaborate with our technical team to design, develop, and deploy data engineering jobs and pipelines using...
-
Senior Data Engineer
4 days ago
Columbus, Ohio, United States Hispanic Technology Executive Council Full timeUnlock the Power of Data with Our TeamWe are the Hispanic Technology Executive Council, and we are seeking a highly skilled Data Engineer to join our team. As a key member of our Advanced Technology Centers, you will play a critical role in helping our clients transform their businesses through innovative data solutions.About the RoleThis is a unique...
-
Senior Data Engineer
4 weeks ago
Columbus, Ohio, United States BJSS Full timeAbout UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organizations since 1993. Our team of creative problem solvers has a proven track record of finding better, more sustainable ways to solve complex technology challenges.We have a strong presence in the United States, with offices in New York City, Columbus, Ohio,...
-
Senior Data Engineer
3 days ago
Columbus, Ohio, United States Zodiac Solutions, Inc Full timeAbout Zodiac Solutions, Inc.We are a leading IT staffing agency that connects talented professionals with exciting opportunities. Currently, we are hiring a Data Engineer for our client, a multinational finance company.About the RoleJob Title: Data EngineerLocation: Remote (with occasional on-site visits)Employment Type: ContractKey...