Current jobs related to Databricks Cloud Data Engineer - Richmond - Open Systems Technologies
-
Data Engineer
4 weeks ago
Richmond, United States Strategic Staffing Solutions Full timeData Engineer- W2 ONLY Location: Richmond, Virginia, 23238 Must sit onsite in Richmond, VA or McLean, VA hybrid (Mon & Fri/Tue-Thu onsite) Contract: 12 months Pay rate: $75+ • Must have experience: AWS Glu, Spark, Databricks & Python • Nice to have: Go or Java, Splunk, Jira, Github • Tech: Databricks, Python, Spark, AWS (Glue, lambda, RDS,...
-
Data Engineer
6 days ago
Richmond, United States Mindlance Full timeJob Description: Data Engineer Must have experience: AWS Glu, Spark, Databricks & Python Nice to have: Go or Java, Splunk, Jira, Github Tech: Databricks, Python, Spark, AWS (Glue, lambda, RDS, CloudWatch, S3, IAM, Fargate, etc.), Go,RESTful API, Jenkins, Splunk, Github, Jira, Java, Spring Boot Experience : 6 Years Plus Product: Small Business Card -...
-
Senior Cloud AWS Engineer
1 month ago
Richmond, Virginia, United States Cynet Systems Full timeCreate automation services for builds using Terraform, Python, and OS shell scripts.Bachelors degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advance degree preferred.Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous...
-
Data Engineer Consultant
4 weeks ago
Richmond, United States xScion Full timeJob DescriptionJob DescriptionSalary: As an employee, you Turn Change Into Value® - for our clients, our company, your professional growth, and the consumers. We hire the best and brightest who are driven to create lasting value. At xScion, you aren't just another team member; you're impactful. You're empowered. You're driven. You're...
-
Richmond, United States Numero Data Full timeJob requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...
-
Richmond, United States Numero Data Full timeJob requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...
-
Senior Cloud AWS Engineer
1 month ago
Richmond, United States Cynet Systems Full timeCreate automation services for builds using Terraform, Python, and OS shell scripts.Bachelors degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advance degree preferred.Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous...
-
Data Engineer/ Platform Engineer
6 days ago
Richmond, United States Pyramid Consulting Full timeImmediate need for a talented Data Engineer/ Platform Engineer. This is a 12+ Months Contract opportunity with long-term potential and is located in McLean, VA/Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID:24-34210 Pay Range: $50 - $55/hour. Employee benefits include, but are not limited...
-
Sr. Data Engineer
6 days ago
Richmond, United States Ampcus Full timePosition: Sr. Data Engineer Location: Richmond/Mclean, VA. (Hybrid) Duration: 12 Months Contract Responsibilities: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights Build the next generation Distributed Data Pipelines using programming languages like...
-
Richmond, United States Numero Data LLC Full timeJob requirements: 5 years of experience ideal, but flexible EMR in AWS, Hadoop Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and report to...
-
Senior Data
1 month ago
Richmond, Virginia, United States CarMax Full time8116 - Midtown Office W. Broad Street, Richmond, Virginia, 23220CarMax, the way your career should be About this jobAt CarMax, we are industry disruptors. At the heart of our innovation is new digital products. Working on many different aspects of the customer experience, our Engineers research and discover new opportunities and shape products to fulfill...
-
Data Engineer Consultant
7 days ago
Richmond, United States xScion Full timeJob DescriptionJob DescriptionSalary: As an employee, you Turn Change Into Value® - for our clients, our company, your professional growth, and the consumers. We hire the best and brightest who are driven to create lasting value. At xScion, you aren't just another team member; you're impactful. You're empowered. You're driven. You're...
-
Data Engineer Consultant
12 hours ago
Richmond, United States xScion Full timeJob DescriptionJob DescriptionSalary: As an employee, you Turn Change Into Value® - for our clients, our company, your professional growth, and the consumers. We hire the best and brightest who are driven to create lasting value. At xScion, you aren't just another team member; you're impactful. You're empowered. You're driven. You're...
-
Cloud/Data Engineer
1 week ago
Richmond, United States Pyramid Consulting, Inc Full timeImmediate need for a talented Cloud/Data Engineer. This is a 04+months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38601 Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance (medical,...
-
Cloud/Data Engineer
1 week ago
Richmond, United States Pyramid Consulting, Inc Full timeImmediate need for a talented Cloud/Data Engineer. This is a 04+months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38601 Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance (medical,...
-
Azure Cloud Technical Lead
3 weeks ago
Richmond, United States Saransh Inc Full timeJob DescriptionJob DescriptionRole: Azure Cloud Technical LeadLocation: Richmond, VA (Onsite)Job Type: ContractRole:As a technical lead, you will be primarily responsible for leading the data engineering solutions in Azure and/or any other ancillary cloud technologies.This role is a very engaging mix of hands-on technical work and opportunities to showcase...
-
Azure Cloud Technical Lead
2 weeks ago
Richmond, United States Saransh Inc Full timeRole: Azure Cloud Technical LeadLocation: Richmond, VA (Onsite)Job Type: ContractRole:As a technical lead, you will be primarily responsible for leading the data engineering solutions in Azure and/or any other ancillary cloud technologies.This role is a very engaging mix of hands-on technical work and opportunities to showcase leadership skills.Assist in...
-
Azure Cloud Technical Lead
2 weeks ago
Richmond, United States Saransh Inc Full timeRole: Azure Cloud Technical LeadLocation: Richmond, VA (Onsite)Job Type: ContractRole:As a technical lead, you will be primarily responsible for leading the data engineering solutions in Azure and/or any other ancillary cloud technologies.This role is a very engaging mix of hands-on technical work and opportunities to showcase leadership skills.Assist in...
-
Lead Azure Cloud Solutions Architect
7 days ago
Richmond, Virginia, United States Saransh Inc Full timeJob OverviewPosition: Azure Cloud Technical LeadLocation: Richmond, VA (Onsite)Employment Type: ContractKey Responsibilities:In the capacity of a technical lead, you will spearhead the development of data engineering solutions utilizing Azure and other relevant cloud technologies.This position offers a dynamic blend of practical technical engagement and...
-
Data Analyst/Cloud ETL Developer
1 month ago
Richmond, United States CapLeo Global Full timeJob Title: Data Analyst / SR Cloud ETL Developer. Job Location: Richmond VA Duration: 12 Months HybridJob Description: Customer (Customer)Information Technology Division (ITD) is seeking a Master Data Analyst with demonstrated experience in data analytics to work as a key member of Enterprise Data Asset team. This analyst will support teams working in Agile...
Databricks Cloud Data Engineer
2 months ago
A financial firm is looking for a Databricks Cloud Data Engineer to join their team in Richmond, VA or Remote.
Pay: $85-90/hr
Responsibilities:
- Understand technology vision and strategic direction of business needs
- Understand our current data model and infrastructure, proactively identify gaps, areas for improvement, and prescribe architectural recommendations with a focus on performance and accessibility.
- Partner across engineering teams to design, build, and support the next generation of our analytics systems.
- Partner with business and analytics teams to understand specific requirements for data systems to support both development and deployment of data workloads ranging from Tableau reports to ad hoc analyses.
- Own and develop architecture supporting the translation of analytical questions into effective reports that drive business action.
- Automate and optimize existing data processing workloads by recognizing patterns of data and technology usage and implementing solutions.
- Solid grasp of the intersection between analytics and engineering while maintaining a proactive approach to assure solutions demonstrate high levels of performance, privacy, security, scalability, and reliability upon deployment.
- Provide guidance to partners on effective use of the database management systems (DBMS) platform through collaboration, documentation, and associated standard methodologies.
- Design and build end to end automation to support and maintain software currency
- Create automation services for builds using Terraform, Python, and OS shell scripts.
- Develop validation and certification process through automation tools
- Design integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for products
- Participate in developing solutions by incorporating cloud native and 3rd party vendor products
- Participate in research and perform POCs (proofs of concept) with emerging technologies and adopt industry best practices in the data space for advancing the cloud data platform.
- Develop data streaming, migration and replication solutions
- Demonstrate leadership, collaboration, exceptional communication, negotiation, strategic and influencing skills to gain consensus and produce the best solutions.
- Engage with Senior leadership, business leaders at Client and the Board to share the business value.
Qualifications:
- Demonstrates mutual respect, embraces diversity, and acts with authenticity
- Bachelor's degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advance degree preferred
- Seven or more years of experience in designing and building large-scale solutions in an enterprise setting in both
- Three years in designing and building solutions in the cloud
- Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures
- Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures
- Expertise in Cloud Data Warehouses in Redshift, BigQuery or analogous architectures a plus
- Deep SQL expertise, data modeling, and experience with data governance in relational databases Experience with the practical application of data warehousing concepts, methodologies, and frameworks using traditional (Vertica, Teradata, etc.) and current (SparkSQL, Hadoop, Kafka) distributed technologies
- Refined skills using one or more scripting languages (e.g., Python, bash, etc.)
- Experience using ETL/ELT tools and technologies such as Talend, Informatic plus
- Embrace data platform thinking, design and develop data pipelines keeping security, scale, uptime and reliability in mind
- Expertise in relational and dimensional data modeling UNIX admin and general server administration experience required
- Presto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience a plus
- Experience using Spark, Kafka, Hadoop, or similar distributed data technologies a plus
- Able to expertly express the benefits and constraints of technology solutions to technology partners, business partners, and team members
- Experience with leveraging CI/CD pipelines
- Experience with Agile methodologies and able to work in an Agile manner is preferred
- One or more cloud certifications
