Senior Data Engineer
2 months ago
As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance, and security across various platforms. Your expertise will guide best practices in data architecture, ETL/ELT processes, and cloud-based data solutions.
- Design, develop, and maintain scalable and reliable data pipelines that extract, transform, and load (ETL/ELT) data from various data sources.
- Optimize and troubleshoot data workflows for performance, scalability, and cost efficiency.
- Automate and monitor data pipelines to ensure smooth, error-free data flows across environments.
- Design and implement cloud-based or on-premise data architectures to support large-scale data storage and processing.
- Collaborate with architects and engineering teams to ensure data systems are aligned with business objectives and technical requirements.
- Evaluate, select, and integrate new technologies and tools into the data stack (e.g., data lakes, data warehouses, real-time streaming technologies).
- Design and implement complex data models that enable efficient querying and support analytics and reporting needs.
- Build and maintain transformation logic to ensure data consistency, quality, and usability for data science and analytics teams.
- Partner with business stakeholders and analysts to gather requirements and develop high-quality, reusable data sets.
- Establish and maintain best practices for data governance, including data quality controls, privacy, and security.
- Implement data quality checks, validation routines, and monitoring mechanisms to ensure data accuracy and reliability.
- Ensure compliance with data policies and regulatory standards (e.g., GDPR, CCPA).
- Work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure data systems meet the organization's needs.
- Mentor and guide junior engineers in coding standards, data engineering best practices, and career development.
- Contribute to project management and development processes, including Agile methodologies and sprint planning.
Preferred Qualifications
- 5-7 years of experience in data engineering or software development, with a strong focus on building data pipelines and scalable infrastructure.
- Proficiency in programming languages like Python, Scala, Java, or SQL.
- Experience with modern data technologies such as Apache Spark, Kafka, Hadoop, or Flink.
- Strong knowledge of cloud platforms such as AWS, Azure, or Google Cloud, particularly their data services (e.g., AWS Redshift, Azure Data Factory, BigQuery).
- Experience with data warehousing, ETL/ELT processes, and distributed systems.
-
Senior Data Engineer
2 months ago
richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Data Engineer
1 month ago
richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Lead Data Engineer
4 weeks ago
Richmond, California, United States Capital One Full timeAbout the Role:We are seeking a Senior Lead Data Engineer to join our team at Capital One. As a Senior Lead Data Engineer, you will be responsible for leading a team of developers and collaborating with Agile teams to design, develop, and implement technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with and...
-
Senior Data Engineer
4 weeks ago
Richmond, California, United States TechnoGen Full timeJob Title: Senior Data Engineer - ETL/ELT ExpertJob Description: At TechnoGen, we are seeking a highly skilled Senior Data Engineer to lead our data engineering team. The ideal candidate will have expertise in ETL/ELT, Databricks, and Python/Pyspark.Key Responsibilities:* Design and implement data pipelines using ETL/ELT* Develop and maintain data processing...
-
Richmond, California, United States Calibro Corp. Full timeJob Title: Senior Data Engineer and Test Automation SpecialistJob Summary:We are seeking a highly skilled Senior Data Engineer and Test Automation Specialist to join our team at Calibro Corp. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust and efficient data pipelines to ingest, transform,...
-
Senior Manager, Data Engineering
1 week ago
Richmond, United States Capital One Full timeCenter 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data EngineeringDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...
-
Senior Data Engineer
2 days ago
Richmond, United States bRysg270dPdNkn Full timeCenter 1 (19052), United States of America, McLean, VirginiaSenior Data Engineer (Enterprise Platforms Technology)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you‘ll be part of a big group of makers,...
-
Senior Data Engineer
1 month ago
Richmond, California, United States Capital One Full timeAbout the Role:We are seeking a Data Engineer to join our team at Capital One. As a Data Engineer, you will be responsible for designing, developing, and implementing data pipelines and systems to support our business needs.Key Responsibilities:Collaborate with cross-functional teams to design and develop data pipelines and systemsDevelop and maintain data...
-
Senior Manager, Data Engineering
1 month ago
Richmond, United States Capital One Full timeCenter 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data EngineeringDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...
-
Senior Manager, Data Engineer
1 month ago
Richmond, Virginia, United States Capital One Full timeAbout the Role:We are seeking a Senior Manager, Data Engineer to join our team at Capital One. As a key member of our engineering organization, you will be responsible for leading a team of developers in designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.Key...
-
Senior Data Architect
4 weeks ago
Richmond, California, United States SingleStone Full timeJob Title: Senior Data ArchitectAt SingleStone, we're seeking a highly skilled Senior Data Architect to lead our data engineering efforts. As a key member of our team, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning...
-
Senior Data Engineer
2 weeks ago
Richmond, VA, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Data Management Analyst
4 weeks ago
Richmond, Virginia, United States SunPlus Data Group Inc Full timeJob DescriptionThe Senior Data Management Analyst will lead business-focused efforts to implement critical data management tools across SunPlus Data Group Inc, including IBM Knowledge Catalog, Data Stage, Snowflake, Collibra, Safe FME, and ArcGIS Enterprise. This role will focus on managing change initiatives for data program impacting a very large group of...
-
Senior Data Engineer
1 week ago
richmond, United States Strategic Staffing Solutions Full timeData Engineer LeadRichmond VA 12 month contract Financial client looking to hire a Data Engineer with at least 5 years of experience specializing in AWS (fargate), Docker Python ETL and Snowflake
-
Senior Data Engineer
2 weeks ago
Richmond, United States Strategic Staffing Solutions Full timeData Engineer LeadRichmond VA 12 month contract Financial client looking to hire a Data Engineer with at least 5 years of experience specializing in AWS (fargate), Docker Python ETL and Snowflake
-
Senior Data Engineer
2 weeks ago
Richmond, United States Strategic Staffing Solutions Full timeData Engineer LeadRichmond VA 12 month contract Financial client looking to hire a Data Engineer with at least 5 years of experience specializing in AWS (fargate), Docker Python ETL and Snowflake
-
Senior Data Engineer
2 weeks ago
richmond, United States Strategic Staffing Solutions Full timeData Engineer LeadRichmond VA 12 month contract Financial client looking to hire a Data Engineer with at least 5 years of experience specializing in AWS (fargate), Docker Python ETL and Snowflake
-
Senior Data Engineer
4 weeks ago
Richmond, California, United States Capital One Full timeAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will play a key role in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test, implement, and support technical...
-
Senior Data Engineer
2 days ago
Richmond, United States Capital One Full time77 West Wacker Dr (35012), United States of America, Chicago, IllinoisSenior Data Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers,...
-
Senior Data Architect
4 weeks ago
Richmond, California, United States Capital One Full timeAbout the Role:Capital One is seeking a skilled Senior Data Architect to join our Enterprise Platforms Technology team. As a key member of our team, you will be responsible for designing and implementing data architectures that drive business value and innovation.Key Responsibilities:- Collaborate with cross-functional teams to design and implement data...