Data Engineer

17 hours ago

Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time
Job Summary

The University of Virginia Darden School of Business seeks a highly skilled Data Engineer to join its Strategic IT Data & Analytics team. As a Data Engineer, you will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading, and transformation of data from various sources into our cloud data environments.

Key Responsibilities
  • Develop and implement efficient and scalable metadata-driven data pipelines using cloud-based ELT pipelines to support our data processing and analytics needs.
  • Collaborate with cross-functional teams to understand data requirements and ensure the smooth integration of data sources.
  • Build models, data integration workflows, and data transformation processes to support data analysis, reporting, and visualization.
  • Develop, orchestrate, and maintain data pipelines and data processing workflows, ensuring data quality, reliability, and performance.
  • Develop and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering artifacts.
  • Identify and address performance bottlenecks and data quality issues in collaboration with the data operations team.
  • Monitor and troubleshoot data pipelines to ensure high availability, scalability, and optimal performance.
  • Develop and maintain integrations between the cloud data platform and the enterprise data governance platform.
  • Assist in implementing data governance and security measures to ensure compliance with data protection regulations and industry best practices.
  • Stay current with emerging trends, design patterns, and technologies in data engineering and cloud-based data processing to drive continuous improvement and innovation within the organization.
Requirements
  • Bachelor's degree in Computer Science, MIS, Computer Engineering, Business Administration, or a related discipline, with at least five years of professional work experience.
  • Relevant experience may be considered in lieu of a degree.
  • Certification as Databricks Data Engineer Associate or Professional, or demonstrated progress to complete certification within six months of joining.
  • Proven work experience as a Data Engineer or in a similar role, with a focus on developing and implementing data pipelines and ETL/ELT processes.
  • Strong proficiency in working with Databricks and Unit.
  • Experience with metadata-driven ELT processes and data lakehouse architecture.
  • Demonstrated experience with programming languages, including SQL and Python for data ingestion, transformation, wrangling, modeling, and automation.
  • Demonstrated knowledge and experience working with APIs and web services for data acquisition.
  • Experience with the Microsoft Azure platform and services, with AZ-900 certification preferred.
  • Experience integrating Databricks and Unity Catalog with data governance tools, such as Microsoft Purview, and familiarity with data governance, data security, and privacy practices.
  • Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques.
  • Familiarity with continuous integration/continuous deployment (CI/CD) development practices for data engineering workflows.
  • Strong analytical and problem-solving skills, with the ability to work with large and complex datasets.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
  • Experience with development of artificial intelligence and machine learning workflows is a plus.
  • Experience with Microsoft Power BI and Microsoft Fabric is a plus.

This position will remain open until filled. Questions regarding the application process should be directed to Marcus Rozier, Academic Recruiter, at https://www.virginia.edu/hr/jobs/academic-recruiter.

The University of Virginia is an equal opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to age, color, disability, gender identity or expression, marital status, national or ethnic origin, political affiliation, race, religion, sex, pregnancy, sexual orientation, veteran or military status, and family medical or genetic information.

  • Data Engineer

    5 days ago

    Charlottesville, Virginia, United States Virginia Jobs Full time

    Job Title: Data EngineerWe are seeking a highly skilled and motivated Data Engineer to join our Strategic IT Data & Analytics team at the University of Virginia Darden School of Business.Job Summary:The Data Engineer will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading, and transformation...

  • Senior Data Engineer

    4 weeks ago

    Charlottesville, Virginia, United States Harnham Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a Senior Data Engineer, you will play a critical role in designing and maintaining scalable data pipelines using AWS, Spark, Python, and SQL.Key Responsibilities:Design and implement data pipelines in AWS using Spark, Python, and SQL.Lead the migration of...

  • Senior Lead Data Engineer

    4 days ago

    Charlottesville, Virginia, United States Capital One Full time

    Job Title: Senior Lead Data EngineerCapital One is seeking a Senior Lead Data Engineer to join our team. As a Senior Lead Data Engineer, you will be responsible for leading a team of data engineers in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Lead a team of data engineers...

  • Senior Data Visualization Engineer

    4 weeks ago

    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Senior Data Visualization EngineerThe Analytics and Reporting team of the University of Virginia Health System is seeking a highly skilled data visualization expert to contribute to our team's mission.The successful candidate will be responsible for developing and deploying novel visualizations, as well as collaborating with data science and healthcare...

  • Data Systems Engineer

    11 hours ago

    Charlottesville, Virginia, United States Prescient Edge Full time

    Job SummaryPrescient Edge is seeking a highly skilled Data Systems Engineer to support a federal government client. The ideal candidate will have a strong background in designing, implementing, and operating data management systems for intelligence needs.Key Responsibilities Design and implement data management systems to meet intelligence requirements...

  • Lead Data Engineer

    4 days ago

    Charlottesville, Virginia, United States Capital One Full time

    Job Title: Lead Data EngineerCapital One is seeking a Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design and develop technical...

  • Senior Data Engineer

    4 days ago

    Charlottesville, Virginia, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.About the Role:Collaborate with Agile teams to design, develop, test, implement, and support...

  • Data Visualization Expert

    4 weeks ago

    Charlottesville, Virginia, United States University of Virginia Full time

    Job Title: Senior Data EngineerThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to contribute to the development and deployment of innovative visualizations and data products.The ideal candidate will have a strong background in data engineering, data visualization, and business intelligence, with...

  • Data Scientist

    3 days ago

    Charlottesville, Virginia, United States Rivanna Medical, Inc. Full time

    Job Title: Data ScientistRivanna Medical, Inc. is seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be responsible for analyzing large datasets generated from ultrasound imaging to identify trends, patterns, and insights to drive product development decision-making.Key Responsibilities:Analyze and interpret large...

  • Senior Data Architect

    1 week ago

    Charlottesville, Virginia, United States Capital One Full time

    Senior Data EngineerWe're seeking a seasoned Senior Data Engineer to drive a major transformation within Capital One. As a key member of our data engineering team, you'll design, develop, and implement technical solutions that marry data with emerging technologies.Key Responsibilities:Collaborate with Agile teams to design, develop, test, implement, and...

  • Senior Data Scientist

    3 days ago

    Charlottesville, Virginia, United States The Bison Group Full time

    About the Role:We are seeking a highly skilled Data Scientist to join our team at The Bison Group. As a Data Scientist, you will be responsible for conducting data analytics, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis to enable more informed analytic decisions.You will proactively retrieve information...

  • Data Visualization Expert

    2 weeks ago

    Charlottesville, Virginia, United States University of Virginia Full time

    Senior Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to collaborate with our team of data science and healthcare experts. The successful candidate will leverage technical skills and creative vision to develop and deploy innovative visualizations that meet the business...

  • Data Visualization Lead

    3 weeks ago

    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Principal Data Visualization DesignerThe University of Virginia seeks a highly skilled Principal Data Visualization Designer to lead the design and creation of data products at the UVA Health System.This key role will be responsible for helping the Analytics and Reporting team communicate actionable insights to clinical and business leaders through effective...

  • Data Visualization Expert

    5 hours ago

    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    The Rector & Visitors of the University of Virginia seek a highly skilled Data Visualization Expert to enhance our Analytics and Reporting team.The ideal candidate will possess a strong background in data visualization and be able to develop and deploy novel visualizations, as well as collaborate with cross-functional teams to design and develop...

  • Data Visualization Expert

    4 days ago

    Charlottesville, Virginia, United States University of Virginia Full time

    Job Title: Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a skilled data visualization expert to collaborate with our team of data science and healthcare experts.The ideal candidate will have a strong background in data visualization, data analysis, and business intelligence, with experience in developing and...

  • Data Visualization Expert

    3 weeks ago

    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Senior Data Visualization ExpertThe Analytics and Reporting team of the UVA Health System is seeking a highly skilled data visualization expert to contribute to our team's mission.The successful candidate will be responsible for developing and deploying novel visualizations, as well as collaborating with our team of data science and healthcare experts to...

  • Data Visualization Lead

    3 weeks ago

    Charlottesville, Virginia, United States The Rector & Visitors of the University of Virginia Full time

    Job SummaryThe Principal Data Visualization Designer is a key leader in the design and creation of data products at the UVA Health System.Key ResponsibilitiesDevelop and deploy data visualizations to effectively communicate insights to clinical and business leaders.Distill qualitative and quantitative insights to create compelling stories and drive business...

  • Data Visualization Expert

    1 month ago

    Charlottesville, Virginia, United States University of Virginia Full time

    Senior Data Visualization ExpertThe University of Virginia's Analytics and Reporting team is seeking a highly skilled data visualization expert to contribute to the development and deployment of innovative visualizations and data products.Key Responsibilities:Design and develop novel visualizations to meet business requirementsCollaborate with...

  • Data Scientist

    2 weeks ago

    Charlottesville, Virginia, United States BTS Software Solutions Full time

    Job Title: Data ScientistBTS Software Solutions is seeking a highly skilled Data Scientist to join our OSINT team with our military customer.The ideal candidate will have a strong background in Open-Source and be able to apply advanced statistical analysis techniques, develop complex algorithms, and plan and execute research projects.Key...

  • Geospatial Data Analyst

    1 month ago

    Charlottesville, Virginia, United States Commonwealth of Virginia Full time

    Job SummaryThe Commonwealth of Virginia is seeking a highly skilled AML Mapping Specialist to join our team. As a key member of our organization, you will be responsible for administering the approved statewide Abandoned Mine Land Program.Key ResponsibilitiesConduct AML inventory fieldwork, including data collection and analysisDevelop and maintain spatial...