Data Engineer

5 days ago


Charlottesville, Virginia, United States Virginia Jobs Full time
Job Title: Data Engineer

We are seeking a highly skilled and motivated Data Engineer to join our Strategic IT Data & Analytics team at the University of Virginia Darden School of Business.

Job Summary:

The Data Engineer will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading, and transformation (ELT) of data from various sources into our cloud data environments.

Responsibilities:
  • Develop and implement efficient and scalable metadata-driven data pipelines using cloud-based ELT pipelines to support our data processing and analytics needs.
  • Collaborate with cross-functional teams to understand data requirements and ensure the smooth integration of data sources.
  • Build models, data integration workflows, and data transformation processes to support data analysis, reporting, and visualization.
  • Develop, orchestrate, and maintain data pipelines and data processing workflows, ensuring data quality, reliability, and performance.
  • Develop and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering artifacts.
  • Identify and address performance bottlenecks and data quality issues in collaboration with the data operations team.
  • Monitor and troubleshoot data pipelines to ensure high availability, scalability, and optimal performance.
  • Develop and maintain integrations between the cloud data platform and the enterprise data governance platform.
  • Assist in implementing data governance and security measures to ensure compliance with data protection regulations and industry best practices.
Requirements:
  • Bachelor's degree in Computer Science, MIS, Computer Engineering, Business Administration, or related discipline.
  • At least five years of professional work experience in data engineering or a related field.
  • Certification as Databricks Data Engineer Associate or Professional, or demonstrated progress to complete certification within six months of joining.
  • Strong proficiency in working with Databricks and Unit.
  • Experience with metadata-driven ELT processes and data lakehouse architecture.
  • Demonstrated experience with programming languages, including SQL and Python for data ingestion, transformation, wrangling, modeling, and automation.
  • Demonstrated knowledge and experience working with APIs and web services for data acquisition.
  • Experience with the Microsoft Azure platform and services.
  • Experience integrating Databricks and Unity Catalog with data governance tools, such as Microsoft Purview.
Preferred Qualifications:
  • Experience with development of artificial intelligence and machine learning workflows.
  • Experience with Microsoft Power BI and Microsoft Fabric.
How to Apply:

Apply online using the following link: https://uva.wd1.myworkdayjobs.com/UVAJobs

Internal applicants must apply through their UVA Workday profile. Complete the application and upload the required materials, including a resume and cover letter detailing your interest in the position.


  • Data Engineer

    17 hours ago


    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Job SummaryThe University of Virginia Darden School of Business seeks a highly skilled Data Engineer to join its Strategic IT Data & Analytics team. As a Data Engineer, you will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading, and transformation of data from various sources into our cloud...

  • Senior Data Engineer

    4 weeks ago


    Charlottesville, Virginia, United States Harnham Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a Senior Data Engineer, you will play a critical role in designing and maintaining scalable data pipelines using AWS, Spark, Python, and SQL.Key Responsibilities:Design and implement data pipelines in AWS using Spark, Python, and SQL.Lead the migration of...


  • Charlottesville, Virginia, United States Capital One Full time

    Job Title: Senior Lead Data EngineerCapital One is seeking a Senior Lead Data Engineer to join our team. As a Senior Lead Data Engineer, you will be responsible for leading a team of data engineers in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Lead a team of data engineers...


  • Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Senior Data Visualization EngineerThe Analytics and Reporting team of the University of Virginia Health System is seeking a highly skilled data visualization expert to contribute to our team's mission.The successful candidate will be responsible for developing and deploying novel visualizations, as well as collaborating with data science and healthcare...

  • Data Systems Engineer

    11 hours ago


    Charlottesville, Virginia, United States Prescient Edge Full time

    Job SummaryPrescient Edge is seeking a highly skilled Data Systems Engineer to support a federal government client. The ideal candidate will have a strong background in designing, implementing, and operating data management systems for intelligence needs.Key Responsibilities Design and implement data management systems to meet intelligence requirements...

  • Lead Data Engineer

    4 days ago


    Charlottesville, Virginia, United States Capital One Full time

    Job Title: Lead Data EngineerCapital One is seeking a Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design and develop technical...


  • Charlottesville, Virginia, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.About the Role:Collaborate with Agile teams to design, develop, test, implement, and support...


  • Charlottesville, Virginia, United States University of Virginia Full time

    Job Title: Senior Data EngineerThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to contribute to the development and deployment of innovative visualizations and data products.The ideal candidate will have a strong background in data engineering, data visualization, and business intelligence, with...

  • Data Scientist

    3 days ago


    Charlottesville, Virginia, United States Rivanna Medical, Inc. Full time

    Job Title: Data ScientistRivanna Medical, Inc. is seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be responsible for analyzing large datasets generated from ultrasound imaging to identify trends, patterns, and insights to drive product development decision-making.Key Responsibilities:Analyze and interpret large...


  • Charlottesville, Virginia, United States Capital One Full time

    Senior Data EngineerWe're seeking a seasoned Senior Data Engineer to drive a major transformation within Capital One. As a key member of our data engineering team, you'll design, develop, and implement technical solutions that marry data with emerging technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test, implement, and...


  • Charlottesville, Virginia, United States The Bison Group Full time

    About the Role:We are seeking a highly skilled Data Scientist to join our team at The Bison Group. As a Data Scientist, you will be responsible for conducting data analytics, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis to enable more informed analytic decisions.You will proactively retrieve information...


  • Charlottesville, Virginia, United States University of Virginia Full time

    Senior Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to collaborate with our team of data science and healthcare experts. The successful candidate will leverage technical skills and creative vision to develop and deploy innovative visualizations that meet the business...


  • Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Principal Data Visualization DesignerThe University of Virginia seeks a highly skilled Principal Data Visualization Designer to lead the design and creation of data products at the UVA Health System.This key role will be responsible for helping the Analytics and Reporting team communicate actionable insights to clinical and business leaders through effective...


  • Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    The Rector & Visitors of the University of Virginia seek a highly skilled Data Visualization Expert to enhance our Analytics and Reporting team.The ideal candidate will possess a strong background in data visualization and be able to develop and deploy novel visualizations, as well as collaborate with cross-functional teams to design and develop...


  • Charlottesville, Virginia, United States University of Virginia Full time

    Job Title: Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a skilled data visualization expert to collaborate with our team of data science and healthcare experts.The ideal candidate will have a strong background in data visualization, data analysis, and business intelligence, with experience in developing and...


  • Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Senior Data Visualization ExpertThe Analytics and Reporting team of the UVA Health System is seeking a highly skilled data visualization expert to contribute to our team's mission.The successful candidate will be responsible for developing and deploying novel visualizations, as well as collaborating with our team of data science and healthcare experts to...


  • Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Job SummaryThe Principal Data Visualization Designer is a key leader in the design and creation of data products at the UVA Health System.Key ResponsibilitiesDevelop and deploy data visualizations to effectively communicate insights to clinical and business leaders.Distill qualitative and quantitative insights to create compelling stories and drive business...


  • Charlottesville, Virginia, United States University of Virginia Full time

    Senior Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to contribute to the development and deployment of innovative visualizations and data products.Key Responsibilities:Design and develop novel visualizations to meet business requirementsCollaborate with...

  • Data Scientist

    2 weeks ago


    Charlottesville, Virginia, United States BTS Software Solutions Full time

    Job Title: Data ScientistBTS Software Solutions is seeking a highly skilled Data Scientist to join our OSINT team with our military customer.The ideal candidate will have a strong background in Open-Source and be able to apply advanced statistical analysis techniques, develop complex algorithms, and plan and execute research projects.Key...


  • Charlottesville, Virginia, United States Commonwealth of Virginia Full time

    Job SummaryThe Commonwealth of Virginia is seeking a highly skilled AML Mapping Specialist to join our team. As a key member of our organization, you will be responsible for administering the approved statewide Abandoned Mine Land Program.Key ResponsibilitiesConduct AML inventory fieldwork, including data collection and analysisDevelop and maintain spatial...