Data Engineer

2 weeks ago

Springfield, United States Health New England Full time
Purpose

Contributes to the overall success of the IT Department ensuring specific individual goals, plans, initiatives are executed / delivered in support of the teams business strategies and objectives. Ensures all activities conducted are in compliance with governing regulations, internal policies and procedures.

The Data Engineer will be responsible for expanding and optimizing data, data pipeline architecture, and data flows. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up in a hybrid, multi-cloud environment. This individual will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. This individual will be a crucial contributor to data governance activities in ensuring data standards, semantics, structures, and models are employed during data ingestion, transformation, processing, and consumption. This individual will collaborate with data governance stakeholders such as data stewards, data custodians, and data subject area experts to ensure existing data standards are kept up-to-date and new standards are incorporated through governance process.

Accountabilities

  • Champions a customer focused culture to deepen client relationships and leverage broader Health New Englands relationships, systems and knowledge.
  • Create and maintain optimal data pipeline architecture
  • Identify, design, and implement internal process improvements: automating processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Design and develop stored procedures, functions, views and triggers to be used during the ETL/ELT processes using Microsoft SQL Server and Azure data stack.
  • Builds data transformations including importing data from files, moving data from one database platform to another, other data stores including Azure data storage and file systems, using technologies such as Azure Data Factory, MS SSIS, Databricks, Spark, and Synapse Data Flows.
  • Incorporate security and access controls preserving privacy, integrity, and confidentiality of the data in transit and at rest
  • Analyze and develop strategies and approaches to import and transfer data between source, staging, and destinations using medallion architecture (bronze, silver, and gold data levels).
  • Test and prepare ETL processes for deployment to production and non-production environments
  • Support system and acceptance testing including the development or refinement of test plans.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies
  • Participate and contribute to data governance by collaborating with business data stewards, data custodians, and other SME in ensuring that data policies and standards are enforced and cataloged.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
  • Work with data and analytics experts to strive for greater functionality in our data systems
  • Understand how Health New Englands culture and the CX Promise should be considered in day-to-day activities and decisions.
  • Actively pursues effective and efficient operations of their respective areas in accordance with Health New Englands Values, its Code of Conduct and the Associate Handbook, while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to operational, compliance, and conduct
  • Champions a high performance environment and contributes to an inclusive work environment.
Position: Data Engineer/IT Data Management

Reporting Relationships (Job Titles only)

Primary Manager:

(include secondary Manager if applicable)
  • IT Manager Data Management
Direct Reports:
  • NA
Shared Reports (solid/dotted if applicable):
  • NA
External/Internal Contacts

Internal

External

Education / Experience / Other Information (include only those that are specific to the role)

Bachelors degree in Computer Science, Statistics, Informatics, Information Systems or related field with a minimum of 2 + years experience in Data Engineer or ETL Engineer role or an equivalent combination of education and experience. Preferred experience using the following software/tools:
  • 2+ years Experience with relational SQL database such as MS SQL Server, Azure SQL, MySQL.
  • Familiarity with non-relational data stores such as file stores, columnar, key-value, and document stores.
  • Experience with any of the data pipeline and workflow management tools such as MS SSIS or Azure Data Factory.
  • Familiarity with cloud services such as managed service for SQL Server
  • Familiarity with batch and stream processing
  • Experience with scripting languages such as Python Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Health Insurance data domain familiarity would be a plus
  • Experience building and optimizing data pipelines, architectures and data sets using technologies such as MS SSIS, Azure Data Factory, or a similar technology
  • Experience performing analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
  • Strong analysis, processing, and wrangling skills working with structured, semi-structured, and unstructured datasets
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Working knowledge of message queuing, stream processing, and highly scalable big data data stores
  • Ability to work both independently and as part of a collaborative team
  • Strong experience in software engineering best practices
  • Excellent communication skills, both verbal and written
  • Customer-service mindset with the desire to add value to the company
  • Fast learner who seeks to understand not only the data, but what the data means to the business
  • Comfortable leading meetings and conducting training sessions as needed
  • Self-driven with ability to manage workload with minimal supervision
  • Strong time management, planning, and prioritization experience

  • Data Center Engineer

    1 month ago

    Springfield, United States Network and Data Solutions Integrators Full time

    RQ176153 - Data Center Engineer August 14, 2024 Location:   Springfield, VA/Arnold, MO  Position ID:   RQ176153  Deliver simple solutions to complex problems as a Data Center Engineer at NDSI. Here, youll tailor cutting-edge solutions to the unique requirements of our clients. With a career in application development, youll make...

  • Cybersecurity Engineer for Data Centers

    5 days ago

    Springfield, Illinois, United States Network and Data Solutions Integrators (NDSI) Full time

    About the RoleWe are seeking a highly skilled Data Center Engineer to join our team at Network and Data Solutions Integrators (NDSI). As a Data Center Engineer, you will play a critical role in ensuring the security and integrity of our data centers.Key ResponsibilitiesDevelop Computer Systems Specifications: You will develop computer systems specifications...

  • Data Automation Engineer

    6 days ago

    Springfield, United States Innovative Data Solutions LLC Full time

    Job DescriptionJob DescriptionJob SummaryWe are seeking a Senior Data Automation Engineer to support a newly awarded 10 year contract in Springfield, VA. This position requires a TS/SCI clearance and eligibility to obtain a CI polygraph.  Specific Duties and Responsibilities:Design and implement automation solutions to enhance data capture, data...

  • Data Automation Engineer

    16 hours ago

    Springfield, Illinois, United States Network and Data Solutions Integrators (NDSI) Full time

    About the RoleAs a Data Automation Engineer at Network and Data Solutions Integrators (NDSI), you will play a critical role in transforming technology into opportunity. Our team is dedicated to connecting and enhancing the systems that matter most, and we are seeking a skilled professional to join our ranks.Key ResponsibilitiesSupport the Geospatial Services...

  • Data Center Engineer

    20 hours ago

    Springfield, Illinois, United States Network and Data Solutions Integrators (NDSI) Full time

    Job SummaryWe are seeking a highly skilled Data Center Engineer to join our team at Network and Data Solutions Integrators (NDSI). As a Data Center Engineer, you will play a critical role in ensuring the security and integrity of our clients' data.Key ResponsibilitiesDevelop computer systems specifications that align with government system architecture...

  • RQ182989 - Data Automation Engineer - Security Clearance Required

    4 weeks ago

    Springfield, United States Network and Data Solutions Integrators (NDSI) Full time

    Transform technology into opportunity as a Data Automation Engineer with NDSI. A career in enterprise IT means connecting and enhancing the systems that matter most. At NDSI you'll be at the forefront of innovation and play a meaningful part in improving how agencies operate.At NDSI, people are our differentiator. As a Data Automation Engineer you will help...

  • RQ176153 - Data Center Engineer - Security Clearance Required

    4 weeks ago

    Springfield, United States Network and Data Solutions Integrators (NDSI) Full time

    Deliver simple solutions to complex problems as a Data Center Engineer at NDSI. Here, you’ll tailor cutting-edge solutions to the unique requirements of our clients. With a career in application development, you’ll make the end user’s experience your priority and we’ll make your career growth ours. At NDSI, people are our differentiator. As a Data...

  • Data Engineer

    3 months ago

    Springfield, United States Health New England Full time

    Job DescriptionJob DescriptionPurposeContributes to the overall success of the IT Department ensuring specific individual goals, plans, initiatives are executed / delivered in support of the team’s business strategies and objectives. Ensures all activities conducted are in compliance with governing regulations, internal policies and procedures. The Data...

  • Data Engineer

    2 months ago

    Springfield, United States iT Resource Solutions.net,inc Full time

    Required Skills/Qualifications:MUST HAVE Current and active TS/SCI.● 6 Years of Data/Systems engineering experience● Bachelor's degree in Systems Engineering or in related technical or scientific fields suchas engineering, physics, mathematics, operations research, engineering management,Computer Science, Information Technology, Business, Management...

  • Data Engineer

    2 months ago

    Springfield, United States iT Resource Solutions.net,inc Full time

    Required Skills/Qualifications:MUST HAVE Current and active TS/SCI.● 6 Years of Data/Systems engineering experience● Bachelor's degree in Systems Engineering or in related technical or scientific fields suchas engineering, physics, mathematics, operations research, engineering management,Computer Science, Information Technology, Business, Management...

  • Network and Data Solutions Integrators

    5 days ago

    Springfield, Illinois, United States Network and Data Solutions Integrators (NDSI) Full time

    About the RoleWe are seeking a highly skilled Senior Systems Engineer to join our team at Network and Data Solutions Integrators (NDSI). As an IEC Engineer, you will play a critical role in delivering cutting-edge solutions to our clients.Key ResponsibilitiesCollaborate with the Senior Engineering and Project Integration staff to assess, document, and track...

  • Data Science Engineer

    2 months ago

    Springfield, United States Base-2 Solutions, LLC Full time

    Base-2 Solutions is seeking a motivated Junior Data Science Analyst/Engineer to join our Program working with the Data Engineering Team responsible for building the Metadata Application Profile (MAP) that aligns attributes from various Data Stores into a Search & Retrieval System, enabling discovery of imagery and data for analysis. This position focuses on...

  • Data Storage and Security Expert

    5 days ago

    Springfield, Illinois, United States Network and Data Solutions Integrators (NDSI) Full time

    About the RoleAt Network and Data Solutions Integrators (NDSI), we're seeking a highly skilled Storage Engineer to join our team. As a Storage Engineer, you will play a critical role in designing, architecting, configuring, deploying, upgrading, and supporting various storage and backup platforms and associated management tools.Key ResponsibilitiesDesign and...

  • Data Automation Engineer

    2 weeks ago

    Springfield, United States ALTA IT Services Full time $140,000 - $165,000

    Job DescriptionJob DescriptionData Automation EngineerLocation: Springfield, VACustomer: NGAClearance Required: Top Secret/SCI EligibilityHow You’ll Make an Impact as a Data Automation Engineer:Primary Responsibilities:Enhance Data Processes: Design and implement automation solutions to improve data capture, refinement, and processes.Interface with device...

  • Data Engineer III

    12 hours ago

    Springfield, Illinois, United States Absolute Business Solutions Corp (ABSC) Full time

    About the RoleWe are seeking an experienced Data Engineer III to join our team at Absolute Business Solutions Corp (ABSC). As a senior member of our data engineering team, you will be responsible for designing and implementing large-scale data systems that meet the needs of our clients in the Intelligence, Defense, Health, and Safety areas.Key...

  • LEAD DATA ENGINEER

    3 weeks ago

    Springfield, United States Capital One Full time

    314 Main Street (21020), United States of America, Cambridge, MassachusettsLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • IT Systems Engineer

    1 week ago

    Springfield, Virginia, United States Innovative Data Solutions LLC Full time

    Job OverviewPosition SummaryWe are in search of a skilled IT Systems Engineer to provide support for a long-term contract. This role necessitates a TS/SCI clearance and the ability to obtain a CI polygraph.As an IT Systems Engineer, you will collaborate with both on-site and remote personnel to manage site visits and upgrades, deliver on-site and remote...

  • Storage Engineer

    1 month ago

    Springfield, United States Innovative Data Solutions LLC Full time

    Job DescriptionJob DescriptionJob SummaryWe are seeking an experienced Storage Engineer to support an IC customer/contract in Springfield, VA. This position requires one to design, architect, configure, deploy, upgrade and support various storage and backup platforms and associated management tools. Security requirements are a TS/SCI clearance...

  • Data Architect

    1 day ago

    Springfield, Virginia, United States Raytheon Full time

    About the RoleWe are seeking a highly motivated Data Architect to join our Systems Engineering and Integration program at Raytheon. As a Data Architect, you will play a critical role in developing and analyzing data relationships and schemas, interpreting various repository systems, and concisely reporting on data holdings.Key ResponsibilitiesCollaborate...

  • Systems Engineer, Mid

    1 month ago

    Springfield, United States Network and Data Solutions Integrators Full time

    RQ182210 - Systems Engineer, Mid August 14, 2024 Location:   Springfield, VA/St. Louis, MO  Position ID:   RQ182210  At NDSI, people are our differentiator. As a Systems Engineer, Mid you will help ensure today is safe and tomorrow is smarter. Here, you'll tailor cutting-edge solutions to the unique requirements of our clients. Our...