Senior Data Engineer
2 weeks ago
Senior Data Engineer
Location:
Richmond, VA/ McLean, VA/Hybrid
Duration: 12 months with possible contract to hire/ with possible extension
Description:
Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data.
Must have 4+ years of developing data centric application using Spark/Scala or Python running on EMR or AWS Glue.
Must have data pipeline orchestration experience using self created pipelines or using AWS step functions handling pipeline using Python based AWS Lambda.
Must have 3+ years experience in utilizing AWS cloud service.4+ years of experience in CICD pipeline
Call notes:
Team Info:
EDML Enterprise data - Overall Data Space
n application doing large volume of data transformation
Tech stack is on AWS utilizing Glue, S3, stepfunctions, lambdas, ECS/Fargate, SQL, Scala, Python & Spark
utomation Test suits, Spark based SDKs & Python based Lambdas
Stepfunctions for orchestrations
Lambdas executed by stepfunctions
ECS for elastic services & server hosted
This app is a data centric and software utilizing is for Automation
Team of 4 Engineers
Role Info:
Hands on Sr. Data Engineer roles with strong Spark, Scala, Python, SQL & AWS Background
80% Data Engineering & 20% is on automation side (Python based Behave & Batch side Scala)
Top Skills:
Spark exp is a must
Scala & Python exp is a must
SQL exp is a must
-
Senior Software Engineer
2 weeks ago
Richmond, Virginia, United States StreetLight Data Full timeAbout the Company:StreetLight is a pioneer in utilizing Big Data analytics to provide insights into transportation behaviors, aiding in making informed data-driven decisions about transportation. Acquired by Jacobs as a subsidiary in February 2022, StreetLight continues to innovate and offer digital solutions to enhance transportation, reduce congestion, and...
-
Senior Data Engineer
2 weeks ago
Richmond, Virginia, United States Capital One Financial Corp Full timeWest Creek , United States of America, Richmond, Virginia. Senior Data Engineer. Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterat Data Engineer, Engineer, Senior, Banking, Data
-
Senior Lead Data Engineer
2 weeks ago
Richmond, Virginia, United States Capital One Financial Corp Full timeCenter , United States of America, McLean, Virginia Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...
-
Supplier Quality Engineer
2 weeks ago
Richmond, Virginia, United States Hitachi Data Systems Full timeGeneral Information:Hitachi Energy is seeking a Supplier Quality Engineer within our North American Power Grid – Transformer (PGTR) organization. This position is responsible for pre-qualification of materials/products before installation as well as ensuring inspection and testing in accordance with the Contract Specifications and Quality Control Plans, to...
-
data engineer
2 weeks ago
Richmond, Virginia, United States Mastech Digital Full timeMastech Digital provides digital and mainstream technology staff as well as Digital Transformation Services for all American Corporations. We are currently seeking a Data Engineer for our client in the Consulting domain. We value our professionals, providing comprehensive benefits and the opportunity for growth. This is a Contract position, and the client is...
-
Senior Software Engineer
2 weeks ago
Richmond, Virginia, United States Ampcus Full timeTitle: Senior Software Engineer (JAVA) Location: Mclean, VA/ Richmond, VA - Hybrid Duration: months assignment with the possibility of extension Senior Software Engineer (JAVA) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery...
-
Selenium Automation Engineer
2 weeks ago
Richmond, Virginia, United States Data Concepts Full timeCompany Description Data Concepts specializes in offering deliverable-based, project solutions in the application development space specializing in Microsoft, Java and Mobile technologies. Data Concepts embraces the iterative approach of the Rational Unified Process and Agile Software Development Methodology as frameworks for building robust systems. Over...
-
Data Engineer
2 weeks ago
Richmond, Virginia, United States Nucleusteq Full timeData Engineer Role Info: Hands on BI Data Engineer role with strong Creating KPI Dashboards - Interactive Dashboards using tableau / Quicksight Top Skills: BI Tableau / AWS Quicksight exp is a must AWS (IAM, RDS, S3, Lambda) exp is a must SQL exp is a must Python knowledge is required Nice to have: AWS Certified Solutions Architect About the Company:...
-
Python Data Engineer
2 weeks ago
Richmond, Virginia, United States Pyramid Consulting Full timeImmediate need for a talented Senior Data Engineer (Python) . This is a 12+ Months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:Pay Range: $65-$70/hour. Employee benefits include, but are not limited to, health insurance...
-
Senior Data Analyst
2 weeks ago
Richmond, Virginia, United States UnitedHealth Group Full timeGathering business requirements for the data-warehouse as well as business intelligence reports used by the Virginia DMAS management Analyzing existing design and recommending industry best practice design for optimal performance and maintenance Appl Data Analyst, Business Analyst, Remote, Senior, Analyst, Health, Technology, Healthcare
-
Senior Data Business Analyst
2 weeks ago
Richmond, Virginia, United States Virginia Department of Transportation Full timeTitle: Senior Data Business Analyst (Wage)Agency: VA Dept of Transportation Location: Dept of Transportation Agency Website: Whether it's knowing the work you do makes a difference, having a great work/life balance, working on exciting and challenging projects, leading innovation, and championing change or simply working with a great group of people who are...
-
Senior Data Analyst
2 weeks ago
Richmond, Virginia, United States Diverse Lynx Full timeSkill: Senior Data Analyst Manages, monitors and supports the day to day Test data provisioning requirements in support of Integrated and Independent release testing. Responsible for meeting with projects teams, understand the test data needs and enable them with the knowledge to find test data. This position works closely with internal data teams and...
-
Engineer II, Data
4 weeks ago
Richmond, Virginia, United States CarMax Full time8116 - Midtown Office W. Broad Street, Richmond, Virginia, 23220CarMax, the way your career should be The bulk of the data engineer's work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers (like business/data analysts, data scientists or any...
-
Engineer II, Data
4 weeks ago
Richmond, Virginia, United States CarMax Full time8116 - Midtown Office W. Broad Street, Richmond, Virginia, 23220CarMax, the way your career should be The bulk of the data engineer's work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers (like business/data analysts, data scientists or any...
-
Engineer II, Data
4 days ago
Richmond, Virginia, United States CarMax Full time8116 - Midtown Office W. Broad Street, Richmond, Virginia, 23220CarMax, the way your career should be The bulk of the data engineer's work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers (like business/data analysts, data scientists or any...
-
Systems Engineer, Senior
2 weeks ago
Richmond, Virginia, United States Basic Commerce & Industries, Inc. Full timeJob Description Job Description Basic Commerce and Industries, Inc. (BCI) is seeking to fill one (1) Senior Systems Engineer position to provide Systems Engineering expertise in support of projects at the Naval Surface Warfare Center Dahlgren Division (NSWCDD) for Future Capabilities Planning for the Integrated Combat System and the Aegis Weapons System...
-
Senior IT Data Analyst
2 weeks ago
Richmond, Virginia, United States Smithfield Foods Full timeA great job-and a great future-awaits you at Smithfield Foods. We're an $18 billion U.S. food company with nearly 60,000 employees worldwide. We're looking for motivated people who want to join our team and grow lasting and meaningful careers with us. Join our family today. Apply Now Our team members receive industry-competitive salaries and are eligible for...
-
Senior Data Business Analyst
2 weeks ago
Richmond, Virginia, United States Virginia Jobs Full timeTitle: Senior Data Business Analyst (Wage)State Role Title: Prog Admin Specialist IIIHiring Range: $ $63.57Pay Band: 6Agency: VA Dept of TransportationLocation:Dept of TransportationAgency Website:Recruitment Type: General Public - G Job DutiesWhat motivates you? Whether it's the impact of your work, maintaining a work/life balance, engaging in exciting...
-
DCEO Engineer 3, DCC Communities
2 weeks ago
Richmond, Virginia, United States Amazon Data Services, Inc. Full timeJob Description How would you like to be a part of Earth's most customer-centric company? You would work with teams of front-line responders who support the operations of some of the world's most powerful data centers. Our Data Center Engineering Operations team maintain and operate our critical infrastructure systems so that they are prepared to stand up...
-
Senior Director, Data Sciences COE
4 weeks ago
Richmond, Virginia, United States Stride, Inc. Full timeJob DescriptionThe Senior Director of the Data Sciences Center of Excellence is primarily responsible for driving Stride's strategic transformation to enable Data as a Product via the DataOps methodology. The Sr. Director of the Data Sciences COE will drive the establishment of data usage requirements, data definitions, data presentation standards, and...