Senior Data Engineer

5 days ago

Charlotte, United States TTX Full time
Job Description

JOB SUMMARY

The Senior Data Engineer is an interdisciplinary individual on the Data Analytics team who collaborates closely with multiple stakeholders, across the enterprise and Information Technology (IT), to ensure the most important data is accessible and well-understood.

A Senior Data Engineer designs, develops, implements, and supports new and existing highly efficient ELT/ETL processes and data sets. Other responsibilities include working closely with data consumers, solution architects, and security and governance teams to implement solutions to answer complex questions and drive business decisions. Apply your proven communication skills, problem-solving skills, and knowledge of best practices in designing, developing, and deploying data and analytic solutions.

Senior Data Engineers need to be adept in several technical and business skills. These include working with diverse datasets, parsing and understanding data, working with domain experts, data scientists, and analysts in framing business problems, and provisioning integrated data quickly across multiple environments. Senior Data Engineers need to be inquisitive and motivated to learn modern technologies and capabilities that could benefit the organization and lead the effort in evaluating the technology for acceptance at TTX. Senior Data Engineers also assist the business data science efforts with source data, building data sets, helping evaluate models, and integrating analytics and data science model outputs into business processes.

RESPONSIBILITIES
  • Hybrid cloud environment: the Senior Data Engineer works in a hybrid cloud ecosystem, composed of Azure, Oracle, and on-premises technologies, building and supporting data and analytics solutions. The Senior Data Engineer will need to learn the data, tools, and capabilities resident in this hybrid ecosystem, such as Synapse, Data Lakes, Dedicated Pool, Azure ML, SQL Server, SSIS, and SSAS.
  • Build data pipelines: Managed data pipelines consist of a series of stages through which data flows. Designing, building, and maintaining data pipelines, in Azure and the on-premises ecosystems, will be the primary responsibility of the data engineer.
  • Drive data-centric decision-making. Assists with enhancing the data and metadata management infrastructure to ensure data quality, accessibility, and security.
  • Collaborate across departments: Collaborates with business data consumers, of various skill levels, in refining their requirements for various data and analytics initiatives. This collaboration can lead to building enterprise data products, enabling data-driven decision-making.
  • Lead, educate, and train: Be curious and knowledgeable about innovative technologies and data initiatives. Research and propose data ingestion, preparation, integration, and operationalization tools or techniques to aid these initiatives. Train team members, data consumers, data scientists, and data analysts in these technologies and preparation techniques.
  • Participate in ensuring compliance and governance during data use: Data engineers work with data governance teams (and information stewards within these teams) in building, vetting, and promoting content, that adheres to data governance and compliance initiatives.
  • Become a data and analytics evangelist: TTX considers the Senior Data Engineer a blend of data and analytics "evangelist," "guru" and "fixer." This role promotes the available data and analytics capabilities and expertise to business unit leaders educating them in leveraging these capabilities in achieving their business goals.
QUALIFICATIONS

Education and Training
  • A bachelor's in computer science, statistics, applied mathematics, data management, information systems, information science or a related quantitative field [or equivalent work experience] is required.
  • An advanced degree in computer science (MS), statistics, information science (MIS), data management, information systems, information science (post-graduation diploma or related) or a related quantitative field [or equivalent work experience] is preferred.
  • The ideal candidate will have a combination of IT, data governance, analytics, and communication skills.
  • Previous Experience
  • At least 5 years or more of work experience in data management disciplines including data integration, modeling, optimization, data quality and/or other areas directly relevant to data engineering responsibilities and tasks.
  • At least 5 years of experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative.
Technical [and Business] Knowledge/Skills
  • Strong experience with various languages and advanced analytics tools such as SQL, Python, PowerBI, Microsoft SSIS/SSAS, Azure Synapse, and others.
  • Strong ability to design, build, and manage data structures and pipelines for encompassing data transformation, data models, schemas, metadata, and workload management. Work with both IT and business in integrating analytics and data science output into business processes and workflows.
  • Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures, and integrated datasets using data integration technologies, including ETL/ELT, data replication/CDC, message-oriented data movement, API design, and development.

PHYSICAL JOB REQUIREMENTS

The physical demands and work environment characteristics described here are representative of those needed to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform the essential functions.

General office environment with limited physical demands and travel. While performing the duties of this job, the employee is regularly required to communicate using hands and fingers, handle, feel, and reach. The employee frequently is required to remain stationary within work area and occasionally move about. The employee must occasionally transport up to 10 pounds. Correctable vision and hearing required.

The above job description is intended to describe the general content of and requirements for the performance of this job. It is not to be construed as an exhaustive statement of duties, responsibilities or requirements.

About Us

TTX Company is a leading provider of railcars and related freight car management services to the North American rail industry. TTX's pool of railcars is ideal for supporting shippers in the intermodal, automotive, paper & forest, metals, machinery, wind energy and other markets where flatcars, boxcars and gondolas are required.

TTX's generous Total Rewards package includes Paid Time Off, Health, Dental and Vision benefits, and 401(k) with company match. This position participates in Railroad Retirement.

TTX Company is an Equal Employment Opportunity Employer.

  • Lead Data Engineer

    22 hours ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    About Pantheon DataWe are a private, small business based in the Washington, DC, area. Our service offerings have grown over the years to include infrastructure resiliency, contact center operations, information technology, software engineering, program management, strategic communications, engineering, and cybersecurity. We have expanded our customer base...

  • Senior Data Solutions Architect

    24 hours ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job SummaryPantheon Data is seeking a Technical Solutions/Engineering Team Lead with a strong background in data-driven solution architecture and development to serve as a leader of a growing team of engineers. This role requires U.S. Citizenship and the ability to obtain/maintain Secret clearance.About UsPantheon Data is a private, small business based in...

  • Senior Data Solutions Architect

    3 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data is a private, small business based in the Washington, DC area.We are seeking a skilled Data Engineer with expertise in designing data-centric technical solutions.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipelines.Analyze customer technology landscapes, business processes, and...

  • Cloud Engineer

    7 days ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job DescriptionPantheon Data is seeking a skilled Data Engineer to develop data pre-processing and analytics code using Python, R, and similar languages. The successful candidate will contribute to ETL pipeline solutions that ingest and process data from multiple sources and create cloud-based data warehouse(s) that provide inputs to predictive models.The...

  • Senior Data Engineering Lead

    2 days ago

    Charlotte, North Carolina, United States Veracity Full time

    Job Title: Senior Data Engineering LeadIn our effort to build a robust and scalable data platform at Veracity, we are seeking a highly skilled Senior Data Engineering Lead. This role will play a crucial part in designing and implementing automated spark-based framework to facilitate data ingestion, transformation and consumption. You will be responsible for...

  • Senior Data Engineer Position

    2 days ago

    Charlotte, North Carolina, United States American Red Cross Full time

    Senior Data Engineer Position at American Red CrossThe Enterprise Data & Analytics Team is building out a team of well-rounded, full-stack Data Warehouse Engineers to support mission-transforming work through data at the American Red Cross. As a Senior Data Engineer, you will be responsible for developing, testing, maintaining and supporting an enterprise...

  • Senior Data Engineer

    3 weeks ago

    Charlotte, United States Array Full time

    Position: Senior Data EngineerLocation: Charlotte, NCPay: $80,000 to $100,000/year + Bonus! Experience: At least three (3) years of related experience.Education: Bachelor's degree. Master's degree (preferred not required).Array Corporation is seeking a Senior Data Engineer to join a growing and dynamic team! Job Description: Develop clean, reusable, and...

  • Senior Deep Learning Engineer for Intelligent Document Processing

    3 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    At Pantheon Data, we are seeking a seasoned Senior Deep Learning Engineer to join our team of innovators in the field of Intelligent Document Processing (IDP). As a key member of our engineering team, you will be responsible for developing and implementing cutting-edge solutions that leverage Optical Character Recognition (OCR), Natural Language Processing...

  • Chief Data Systems Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data, a private company based in the Washington, DC area, is seeking an experienced Chief Data Systems Engineer.We are looking for someone to design and develop software applications that drive our business forward. Our ideal candidate will have experience working with embedded systems, data warehouses, and ETL...

  • Senior Data Engineer with PySpark

    3 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer with PySparkJob Description:We are seeking a highly experienced Senior Data Engineer with expertise in PySpark to lead our data engineering team. The ideal candidate will have a strong background in designing and implementing large-scale data architectures, including data lakes, data warehouses, and data marts....

  • Senior Data Engineer

    1 month ago

    Charlotte, United States Array Full time

    Position: Senior Data EngineerLocation: Charlotte, NCPay: $80,000 to $100,000/year + Bonus! Experience: At least three (3) years of related experience.Education: Bachelor's degree. Master's degree (preferred not required). Array Corporation is seeking a Senior Data Engineer to join a growing and dynamic team! Job Description: Develop clean, reusable, and...

  • Senior Data Engineering Manager

    3 weeks ago

    Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Senior Data Engineering ManagerJob Summary:We are seeking a Senior Data Engineering Manager to lead our data engineering team at TechnoGen. The ideal candidate will have 12+ years of experience in data engineering and a strong background in SQL, Python, and Spark programming languages.Key Responsibilities:Lead multiple teams and drive technical...

  • Senior Database Engineer

    2 days ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    At Pantheon Data, we are committed to attracting and retaining top talent in the industry. As a Data Engineer, you will be responsible for designing and developing technical solutions for our customers, working collaboratively with other engineers and project managers to ensure successful outcomes. Key responsibilities include data profiling on RDBMS...

  • Senior Data Engineering Specialist

    3 weeks ago

    Charlotte, North Carolina, United States Randstad Digital Full time

    We are Randstad Digital, a leading provider of digital solutions. We are seeking a highly skilled Senior Data Engineer to join our team.Estimated Salary: $140,000 - $180,000 per yearJob Description:As a Senior Data Engineer at Randstad Digital, you will play a critical role in designing, developing, and implementing new features to our existing framework...

  • Senior Data Engineer

    6 days ago

    Charlotte, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Senior Big Data Engineer

    7 days ago

    Charlotte, North Carolina, United States The Hartford Full time

    About The RoleThe Hartford is seeking a highly experienced Senior Big Data Engineer to join its team. As a Senior Big Data Engineer, you will design and implement large-scale data products that meet the company's needs.This is an exciting opportunity for individuals who want to shape the future of data engineering and drive innovation. You will work closely...

  • Senior Data Engineer

    1 month ago

    Charlotte, United States Kellton Full time

    Position: Sr. Data EngineerWork Location: Remote (working CST or EST) and able to travel quarterly for PI planning Duration: 6 Month (Contract-to-Hire)Manager Notes:Sr. Data EngineerExperience on several DE projects, hands onStrong snowflake expertise - administrations Advanced SQL and Python skills Extracting data from APIs ETL processes, data ingestion AWS...

  • Cloud Data Engineer Position for Experienced Professionals

    3 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Cloud Data EngineerAbout Us:Pantheon Data is a private company based in the Washington, DC area. Founded in 2011, we have grown to offer various services including infrastructure resiliency, contact center operations, and software engineering. Our customer base includes commercial clients and federal agencies.Position Overview:We are seeking an...

  • MAX - Senior Data Engineer

    2 weeks ago

    Charlotte, United States Lighthouse Technology Services Full time

    *Remote Contract-to-Hire Opportunity* Lighthouse Technology Services is partnering with our client to fill their Senior Data Engineer position! This is a 6+ month contract-to-hire opportunity. This role can be remote within the United States, with quarterly travel to Charlotte, NC. This role will be a W2 employee of Lighthouse Technology Services. ...

  • Senior Data Analyst/Data Engineer

    2 weeks ago

    Charlotte, United States Collabera Full time

    Description Home Search Jobs Job Description Senior Data Analyst/Data Engineer Contract: Charlotte, North Carolina, US Salary: $70.00 Per Hour Job Code: 356707 End Date: 2025-01-09 Days Left: 29 days, 2 hours left Apply About Collabera: Collabera is a leading global technology services and solutions provider committed to delivering high-quality,...