Data Engineer

2 months ago

Boston, United States Boston VA Research Institute, Inc. (BVARI) Full time

Data Engineer


Boston VA Research Institute, Inc. (BVARI)


We are a Boston-based epidemiology and biomedical research organization. We are actively engaged in several clinical trials, pharmacoepidemiology, chronic disease epidemiology, genetic epidemiology, biostatistical and genomics research. Our research team oversees study data related activities and Quality improvement activities to improve the way translational research is conducted and clinical care is delivered. The multi-disciplinary center consists of a highly talented group of biomedical researchers, clinicians, epidemiologists, biostatisticians, data analysts/programmers, project coordinators, and informatics team with academic affiliations to Harvard Medical School and Boston University. We are looking for candidates with a service-oriented mentality, high sense of ownership of the assigned tasks and ability to solve problems presented by data.


Project Background:


Our research group has a full-time Data Engineer opening for individuals who love working with data and want to use their data engineering skills to help researchers conduct high-impact research that expands our understanding of human health and improves healthcare outcomes for Veterans. You will work with a strong, collegial, diverse, and talented team of computer scientists, statisticians, and clinicians at BVARI, the VA Boston Healthcare System, Harvard Medical School, and the Boston University School of Medicine.


Why should a Data Engineer work at a VA-associated research institute? The VA has the largest integrated medical records database in the United States, with comprehensive clinical information on over 22 million patients (2 trillion+ rows, 22,000+ columns of data), including large amounts of both structured and unstructured data. The VA also has large databases of genomic and imaging data. Working with our group offers the opportunity to execute high-impact projects with large-scale real-world healthcare data that is unavailable at most other institutions.


Essential Duties and Responsibilities:


  • Develop complex, dynamic queries (CTEs, subqueries, window functions, etc.)
  • Query optimization and performance tuning
  • Implement views, stored procedures, and functions
  • Planning, creating, and optimizing indexes (RDBMS theory B-Tree, index, Column Stored index)
  • Data modeling (ERD) and ensuring data integrity
  • Administrating and securing a multi-terabyte (medical) data warehouse
  • Manage version control - Github
  • Use of SQL Server System Catalog
  • Manage SQL SSIS



Qualifications and Entrance Requirements:

  • Expert-level SQL Server programming and administration skills, experience working with relational databases using SQL or willingness to learn
  • Knowledge of Python and/or R is a plus
  • SQL FTI and Free-Text Search is a plus
  • Knowledge of VB and/or C# is a plus
  • Experience with healthcare data is a plus
  • Data analysis experience is a plus


Please note we are unable to provide work authorization and/or visa sponsorship.


Work Environment

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. The candidate must reside in Massachusetts.


Physical Demands

The physical demands described in this job description are representative of those that must be met by an employee to successfully perform the essential functions of this job.


While performing the duties of this job, the employee frequently is required to stand; walk; use hands; and reach with hands and arms.


Selective Service

If you are male application born after December 31, 1959, you must certify that you have registered with the Selective Service System or are exempt from having to do so under the Selective Service Law.


This position requires the ability to occasionally lift office products and supplies, up to 20 pounds.


Position Type/Expected Hours of Work

This is a full-time position, and hours of work and days are Monday through Friday, 8:30 a.m. to 5 p.m.


Travel

No travel is required for this position. Optional travel to scientific meetings may occur from time to time.


Work Authorization/Security Clearance

An employee in this position must complete all appropriate background checks at the time of hire and periodic reappointment.


Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.


Equal Opportunity Employer

Boston VA Research Institute provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, transfer, leaves of absences, compensation, and training.

  • Sr Data Engineer

    3 weeks ago

    Boston, United States NTT DATA Services Full time

    Req ID: 300069 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Boston, Massachusetts (US-MA), United States (US).Job Duties:...

  • Sr Data Engineer

    2 weeks ago

    Boston, United States NTT DATA Services Full time

    Req ID: 300069 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Boston, Massachusetts (US-MA), United States (US).Job Duties:...

  • Senior Data Engineer

    4 weeks ago

    Boston, Massachusetts, United States NTT DATA Group Corporation Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team at NTT DATA Group Corporation. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures that support our Life and Annuity business.Key Responsibilities:Partner with business stakeholders to...

  • Data & AnalySr Data Engineer (Life and Annuity)tics Consulting Manager

    2 weeks ago

    Boston, United States NTT DATA, Inc. Full time

    Data & Analytics Consulting ManagerCompany: NTT DATA Services Job Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional and non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery,...

  • Data & AnalySr Data Engineer (Life and Annuity)tics Consulting Manager

    2 weeks ago

    Boston, United States NTT DATA, Inc. Full time

    Data & Analytics Consulting ManagerJob Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...

  • Data & AnalySr Data Engineer (Life and Annuity)tics Consulting Manager

    2 weeks ago

    Boston, United States NTT DATA, Inc. Full time

    Data & Analytics Consulting Manager (Life and Annuity)Company: NTT DATA ServicesJob Duties:Create and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet functional/non-functional business requirements.Identify, design, and implement system internal process improvements: automating manual processes, optimizing data...

  • Senior Software Engineer

    7 days ago

    Boston, United States Zing Data Full time

    You’ll help implement and bring to market core features on Zing Data’s platform for GenAI business intelligence that is collaborative, easy, and works on iOS, Android, and the web. You’ll be working on interesting features on our query intelligence and distribution engine that help our users get near-instant response times. You'll work with the latest...

  • Data Engineer

    16 hours ago

    Boston, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity in the data engineering field, based in Boston, Massachusetts. This role will be focused on developing and maintaining data structures and systems, utilizing skills such as Apache Kafka, Apache Spark, Cloud Technologies, Data Visualization, Analytics, Apache Hadoop, API Development, AWS...

  • Data Engineer

    1 month ago

    boston, United States Realtime Recruitment Full time

    Data EngineerBoston - Fully Remote 6- 12 months Contract : W2 OnlyThis position is not open for sponsorship We are dedicated to leveraging data to drive innovative solutions and empower our clients. We are seeking a skilled Data Engineer to join our dynamic team and help shape our data initiatives.Key Responsibilities:Data Journey Consultation: Assist...

  • Data & AnalySr Data Engineer (Life and Annuity)tics Consulting Manager

    2 weeks ago

    Boston, MA, United States NTT DATA, Inc. Full time

    Location - US/BostonJob Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability,...

  • Data Engineer

    5 days ago

    Boston, United States Harvard Medical School and BIDMC Full time

    Job descriptionThe Clinical Data Animation Center (CDAC) at Massachusetts General Hospital (MGH) and the MGH McCance Center for Brain Health and MGH Neurology Department is The Beth Israel Deaconess Medical Center (BIDMC) Neurology Department, part of Harvard Medical School, is seeking a big data software engineer to join the Clinical Data Animation Center...

  • Senior Data Engineer

    4 weeks ago

    Boston, Massachusetts, United States Saviance Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Saviance. As a Senior Data Engineer, you will be responsible for designing and implementing robust, scalable, and high-performance data pipelines to support the organization's data needs.Key Responsibilities: Design and implement data...

  • Data Engineer

    1 month ago

    Boston, United States firstPRO, Inc Full time

    firstPRO is now accepting resumes for a Data Engineer in Boston, MA. This is a direct hire role with a hybrid workstyle.Some of the day-to-day responsibilities of this role include:Developing processes and pipelines for cleaning, validating, and uploading data to tabular formats ex: SQL Server, Azure Databricks, or PowerBI, in collaboration with IT and...

  • Data Engineer

    1 month ago

    boston, United States firstPRO, Inc Full time

    FirstPro is now accepting resumes for a Data Engineer position based in Boston, MA. This role will focus on researching and implementing new tools, communicating with external clients, and creating reproducible scripts to clean, process, or analyze data. This is a permanent, direct-hire role that can offer benefits, annual bonus and a hybrid working...

  • Data Engineer

    1 month ago

    Boston, United States firstPRO, Inc Full time

    FirstPro is now accepting resumes for a Data Engineer position based in Boston, MA. This role will focus on researching and implementing new tools, communicating with external clients, and creating reproducible scripts to clean, process, or analyze data. This is a permanent, direct-hire role that can offer benefits, annual bonus and a hybrid working...

  • Senior Data Engineer

    1 month ago

    Boston, Massachusetts, United States Motion Recruitment Full time

    Job Title: Senior Data EngineerWe're seeking a highly skilled Senior Data Engineer to join our team at Motion Recruitment. As a key member of our Data Team, you will play a critical role in developing new platforms to store and process massive amounts of customer data, providing actionable insights to improve the customer experience.Responsibilities:* Build...

  • Data Engineer

    1 week ago

    Boston, United States Planet Technology Full time

    Planet Technology has partnered with a northern Boston firm to locate a data engineer for a full-time role. The position will be hybrid onsite 2-3 days a week.This role will be responsible for collaborating across teams to meet business needs, manage key vendor relationships, and uphold data compliance standards. This is a unique opportunity to make a...

  • Data Engineer

    1 month ago

    boston, United States Boston VA Research Institute, Inc. (BVARI) Full time

    Data EngineerBoston VA Research Institute, Inc. (BVARI)We are a Boston-based epidemiology and biomedical research organization. We are actively engaged in several clinical trials, pharmacoepidemiology, chronic disease epidemiology, genetic epidemiology, biostatistical and genomics research. Our research team oversees study data related activities and Quality...

  • Senior Data Engineer

    1 month ago

    Boston, Massachusetts, United States Diverse Lynx Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience with development/design in Azure Databricks (language: Scala) and strong experience in data warehousing, data lakes, and delta tables concepts. Additionally, the candidate should have experience in...

  • Data Center Engineer

    4 weeks ago

    Boston, Massachusetts, United States Omni Inclusive Full time

    Data Center Engineer Job DescriptionOmni Inclusive is seeking a highly skilled Data Center Engineer to join our team. As a Data Center Engineer, you will be responsible for ensuring the smooth operation of our data center facilities. This includes managing the physical infrastructure, troubleshooting technical issues, and collaborating with cross-functional...