Senior Data Engineer

2 weeks ago


Texas City, United States Resource Logistics Full time

Position Summary:

The Senior Data Engineer will be responsible for the design, development, implementation, and support of the Data Initiatives throughout Gallagher, to ensure that optimal data delivery Clienthitecture is consistent throughout ongoing projects. You will engage in supporting the data analysts and data scientists, and data needs of multiple teams, systems and products. Do you find the prospect of optimizing or even re-designing our company's integration and data Clienthitecture to support our next generation of products and data initiatives most exciting? We really should explore together.

Essential Duties and Responsibilities

  • Drive requirements, scope, and technical design of the integration workflows, to make sure the build is conducted accurately and according to spec. Develop and maintain requirements, design documentation and test plans.
  • Seek out, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Coordinate with BI Engineers, Financial Applications and Oracle HR teams around data management including schemas, failure conditions, reconciliation, test data set up, etc.
  • Build the infrastructure required for optimal ETL/ELT pipelines to ingest data from a wide variety of data sources using Microsoft Clienture technologies such as Clienture Data Factory and Databricks.
  • Construct and maintain of enterprise level integrations using the Snowflake platform, Clienture Synapse, Clienture SQL and SQL Server.
  • Create data tools for data analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
  • Design analytics tools that utilize the data pipeline to deliver actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Troubleshoot issues helping to drive root-cause analysis, and work with infrastructure teams to resolve incidents and arrive to a permanent resolution.
  • Partner with data and analytics teams to strive for greater functionality in our data systems.
  • Provide direction and coordination for development, and support teams, including globally located resources.
  • Understand the layout and working of existing integrations that send and receive data between Oracle, Concur, JDE, Corporate Data Platform and other systems.
Required:
  • A relevant technical BS Degree in Information Technology
  • 5+ years writing SQL queries against any RDBMS with query optimization.
  • 5 years of data engineering experience leveraging technologies such as Snowflake, Clienture Data Factory, ADLS Gen 2, Logic Apps, Clienture Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server
  • Experience with scripting tools such as Power Shell, Python, Scala, Java and XML
  • Understanding the pros and cons, and best practices of implementing Data Lake, using Microsoft Clienture Data Lake Storage
  • Experience structuring Data Lake for the reliability, security and performance.
  • Experience implementing ETL for Data Warehouse and Business intelligence solutions.
  • Skills to read and write effective, modular, dynamic, parameterized and robust code, establish and follow already established code standards, and ETL framework.
  • Strong analytical, problem solving, and troubleshooting abilities.
  • Good understanding of unit testing, software change management, and software release management
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as Code fundamentals
  • Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience working within an agile team.
  • Excellent communication skills


  • Texas City, United States OPT Nation Full time

    Position OverviewAs a senior software engineer for data security on the SingleStore engineering team you will have the unique benefit of building systems software in a rapid production environment with a small and collaborative team. Your duties will include overseeing the direction design and development of key security features for the SingleStore...


  • Oklahoma City, United States Data Axle Inc. Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging proprietary...


  • Austin, Texas, United States Central Health Full time

    Overview: The Senior Data Systems Engineer is responsible and accountable for development and implementation of database changes, as well as creation of operational data stores, and data models. This role will work to automate the import and export processes for Enterprise system data, collaborating with all internal and external Enterprise partners to...


  • Austin, Texas, United States Central Health Full time

    Overview: The Senior Data Systems Engineer is responsible and accountable for development and implementation of database changes, as well as creation of operational data stores, and data models. This role will work to automate the import and export processes for Enterprise system data, collaborating with all internal and external Enterprise partners to...


  • San Antonio, Texas, United States H-E-B Full time

    Responsibilities: H-E-B Digital is seeking new team members (Partners)! Since our inception, we've been investing heavily in our customers' digital experience, reinventing how they find inspiration from food, how they make food decisions, and how they ultimately get food into their homes. This is an exciting time to join H-E-B Digital, and we're hiring...


  • Oklahoma City, United States Corvus Insurance Full time

    We’re united by a mission: to make the world a safer place. Corvus Insurance uses novel data and artificial intelligence/machine learning to achieve better insights into commercial insurance risk. Our software empowers brokers and policyholders to better predict and prevent complex claims through data-driven tools and Smart Commercial Insurance policies....

  • Engineer V

    2 weeks ago


    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionMUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT AGENCIES.Senior Level (12+ years experience)Acquired Data Solutions, Inc. is a test and engineering company that is seeking an Onsite Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel...

  • Senior Data Scientist

    1 month ago


    Texas City, United States ragns Full time

    Job descriptionPurpose Overall Relevance for the OrganizationData engineer builds and optimizes the systems that allow perform proper analytics. They are responsible for the accuracy of the data as well as making it accessible to individuals who need to work with it. The data engineer ensures that any data is properly received transformed stored and made...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States Fannie Mae Full time

    Job Description As a valued colleague on our team, you will collaborate with team in designing, producing, testing, or implementing moderately complex software, technology, or processes, as well as create and maintain IT architecture, large scale data stores, and cloud-based systems. THE IMPACT YOU WILL MAKE The Corporate Functions Technology - Software...

  • Jr. Data Engineer

    1 month ago


    Texas City, United States Dash techology Full time

    Dash technology Job OverviewWe are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data...


  • Texas City, United States SelekIT Full time

    About the job Senior Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to design, build, and maintain scalable machine learning models and systems. You will work with data scientists and software engineers to ensure the accuracy, reliability, and efficiency of machine learning models. Requirements: - Bachelor's or Master's...


  • Richardson, Texas, United States Crash Champions Full time

    Champions Do More: At Crash Champions, We Believe the Difference is Trust. Crash Champions is the one of the fastest growing and most exciting brands in the collision repair industry. The company is the largest founder-led multi-shop operator (MSO) of high-quality collision repair service in the U.S., serving customers and business partners at more than 600...

  • Big Data Engineer

    2 weeks ago


    Texas City, United States VTal Technology Solutions Full time

    Our client who is into a leading innovation in cloud and data engineering, is seeking a Big Data Engineer at Irving, TXRequired details:- 2-7 years of experience with Big Data technologies such as Hadoop and related eco system Practical experience and in depth understanding of Map reduce Should have a good programming background with expertise in Java OR...

  • Data Engineer-W2

    2 weeks ago


    Texas City, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionOverview:The Data Engineer plays a crucial role in our organization, responsible for designing, developing, and maintaining scalable data pipelines and infrastructure. This role will have a significant impact on our ability to efficiently and effectively process and analyze large volumes of data, enabling data-driven...

  • Senior Data Engineer

    2 weeks ago


    Arizona City, United States Saxon Global Full time

    UnitedHealth Group, Inc. (UHG) is looking for a Senior Data Engineer to work 100% remote (will work 9am-5pm either AZ time zone or EST time zone) to design, develop, test, and maintain pipelines ingesting critical real-time claims data sets into OnePaaS (Cloud). Project Initiative: There is need to ingest critical claims datasets (real time) into the cloud...


  • Austin, Texas, United States Procore Technologies Full time

    Job Description What if you could use your technology skills to develop a product that impacts the way communities’ hospitals, homes, sports stadiums, and schools across the world are built? Construction impacts the lives of nearly everyone in the world, and yet it’s also one of the world’s least digitized industries. That’s why we’re looking for...

  • Senior Data Engineer

    21 hours ago


    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Lead Data BSA

    2 weeks ago


    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Lead Data BSA

    5 days ago


    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...


  • Arlington, Texas, United States Sarnova HC, LLC Full time

    Company Overview: Sarnova is the leading national specialty distributor of health care products in Emergency Medical Services (EMS) and Respiratory Markets and is the industry leader in Revenue Cycle Management within Emergency Medical Services (EMS).  The company operates through several market-leading companies including Tri-anim Health Services, the...