Data Engineer

2 weeks ago


Baton Rouge, United States GovServicesHub Full time

Job Location:  Available to work Remote, Baton Rouge, LA.

 

Note: 13 Years+ Needed with any state experience  CST time zone candidates preferred

 

Job Description:


  • Create and manage the systems and pipelines that enable efficient and reliable flow of data, including ingestion, processing, and storage.
  • Collect data from various sources, transforming and cleaning it to ensure accuracy and consistency. Load data into storage systems or data warehouses.
  • Optimize data pipelines, infrastructure, and workflows for performance and scalability.
  • Monitor data pipelines and systems for performance issues, errors, and anomalies, and implement solutions to address them.
  • Implement security measures to protect sensitive information.
  • Collaborate with data scientists, analysts, and other partners to understand their data needs and requirements, and to ensure that the data infrastructure supports the organization's goals and objectives.
  • Collaborate with cross-functional teams to understand data requirements and design scalable solutions that meet business needs.
  • Implement and maintain ETL processes to ensure the accuracy, completeness, and consistency of data.
  • Design and manage data storage systems, including relational databases, NoSQL databases, and data warehouses.
  • Knowledgeable about industry trends, best practices, and emerging technologies in data engineering, and incorporating the trends into the organization's data infrastructure.
  • Provide technical guidance to other staff.
  • Communicate effectively with partners at all levels of the organization to gather requirements, provide updates, and present findings

Requirements

Skills Set:

 

Skill

Required /Desired

Experience

experience as a Backend Data Engineer or in a similar role and strong understanding of ETL processes and data warehousing concepts

Required

5 + years

Proven experience with Python and related data engineering libraries (e.g., pandas, NumPy, Spark) and hands-on experience with Apache Airflow for managing data pipelines and workflows

Required

-

Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL. Resource must be able to implement data automations within existing frameworks as opposed to writing one off scripts

Required

-

Experience with big data technologies and frameworks like Hadoop, Spark, Kafka, and Flink

Required

-

Strong understanding of database systems, including relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)

Required

-

Experience regarding engineering best practices such as source control, automated testing, continuous integration and deployment, and peer review

Required

-

Experience with cloud computing platforms

Required

-

Familiarity with agile development methodologies, software design patterns, and best practices

Required

-

Strong analytical thinking and problem-solving abilities

Required

-

Excellent verbal and written communication skills, including the ability to convey technical concepts to non-technical partners effectively

Required

-

Flexibility to adapt to evolving project requirements and priorities

Required

-

Outstanding interpersonal and teamwork skills; and the ability to develop productive working relationships with colleagues and partners.

Required

-

Experience working in a virtual environment with remote partners and teams

Required

-

Proficiency in Microsoft Office

Required

-

Bachelor’s degree in computer science, Information Technology, or a related field

Required

-




  • Data Engineer

    2 weeks ago


    Baton Rouge, United States Rose International Full time

    Date Posted: 11/08/2024Hiring Organization: Rose InternationalPosition Number: 474093Job Title: Data EngineerJob Location: Baton Rouge, LA, USA, 70801Work Model: HybridEmployment Type: TemporaryEstimated Duration (In months): 25Min Hourly Rate($): 60.00Max Hourly Rate($): 65.00Must Have Skills/Attributes: Apache, Data Engineer, ETL, Hadoop, Kafka,...

  • Data Engineer

    2 weeks ago


    baton rouge, United States Rose International Full time

    Date Posted: 11/08/2024Hiring Organization: Rose InternationalPosition Number: 474093Job Title: Data EngineerJob Location: Baton Rouge, LA, USA, 70801Work Model: HybridEmployment Type: TemporaryEstimated Duration (In months): 25Min Hourly Rate($): 60.00Max Hourly Rate($): 65.00Must Have Skills/Attributes: Apache, Data Engineer, ETL, Hadoop, Kafka,...

  • Data Engineer

    4 weeks ago


    Baton Rouge, United States Utility Associates, Inc. Full time

    Job DescriptionJob DescriptionOUR MISSION IS TO ENSURE THE SAFETY OF LAW ENFORCEMENT OFFICERS ANDCOMMUNITIES.At KOLOGIK, we are passionate about enhancing public safety by creating new data-sharing technologiesthat turn ideas into solutions. KOLOGIK technology creates scalable public safety systems that securelyshare private information with unfiltered...

  • Data Systems Engineer

    4 weeks ago


    Baton Rouge, Louisiana, United States PVI Holdings, Inc. Full time

    Job Summary:We are seeking a skilled Data Systems Engineer to support our organization's analytics and data processing needs. This position will collaborate with the Applications System Manager to develop solutions that meet business requirements.Key Responsibilities: Manage system administration support for all Dynamics 365 environments Monitor system...


  • Baton Rouge, Louisiana, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Data Engineer to join our team at Oracle. As a key member of our engineering team, you will be responsible for designing and building high-scale, cloud-based data processing systems that can handle massive amounts of data with low latency.ResponsibilitiesImplement distributed, scalable, and...


  • Baton Rouge, Louisiana, United States Lincoln Financial Group Full time

    About the RoleWe are seeking a highly skilled Sr. Performance and Test Data Engineer to join our team at Lincoln Financial Group. As a key member of our retail solutions organization, you will play a crucial role in harnessing the power of data to drive business decisions.Key ResponsibilitiesWork closely with agile teams and business stakeholders to gather...

  • Crypto Data Scientist

    3 weeks ago


    Baton Rouge, United States Asterix Communications Full time

    We are seeking a highly skilled Crypto Data Scientist with expertise in machine learning to join our dynamic team. In this role, you will leverage your analytical skills to analyze cryptocurrency data, develop predictive models, and provide actionable insights that drive strategic decisions. You will work closely with cross-functional teams to enhance our...


  • Baton Rouge, Louisiana, United States Oracle Full time

    Job SummaryWe are seeking a highly skilled Data Integration Specialist to join our team at Oracle. As a key member of our implementation engineering team, you will play a critical role in helping our utility partners integrate with our energy efficiency platform.About the RoleYou will work closely with our utility partners' technical teams to integrate their...


  • baton rouge, United States Hamlyn Williams Full time

    Job Summary: My client is seeking a dynamic and experienced Senior Process Engineer to join my clients growing team. In this role, you will be instrumental in designing and developing cutting-edge products and systems. Your primary responsibility will be to utilize your expertise in engineering and process simulations.Job Responsibilities:Work closely with...


  • Baton Rouge, United States Hamlyn Williams Full time

    Job Summary: My client is seeking a dynamic and experienced Senior Process Engineer to join my clients growing team. In this role, you will be instrumental in designing and developing cutting-edge products and systems. Your primary responsibility will be to utilize your expertise in engineering and process simulations.Job Responsibilities:Work closely with...


  • Baton Rouge, Louisiana, United States Hunt-Guillot & Associates Full time

    Job SummaryThe Mechanical Engineer position at Hunt-Guillot & Associates is a direct-hire opportunity in our Baton Rouge, LA office. This role is responsible for assisting in the development and execution of mechanical engineering for assigned projects. Key responsibilities include preparing and reviewing calculations, design drawings, and other project...

  • Engineering Intern

    4 weeks ago


    Baton Rouge, Louisiana, United States Power Engineers Incorporated Full time

    **Job Title:** Engineering Intern**Job Summary:** POWER Engineers Incorporated is seeking a talented civil, electrical, or mechanical engineering student for a summer internship. The selected intern will be involved in all aspects of utility distribution design, including data collection and assisting senior engineers and designers with performing...


  • Baton Rouge, Louisiana, United States Power Engineers Incorporated Full time

    Job SummaryPOWER Engineers Incorporated is seeking a talented civil, electrical, or mechanical engineering student for a summer internship. As an Engineering Intern, you will be involved in all aspects of utility distribution design, including data collection, assisting senior engineers and designers, and performing engineering consulting services. You will...


  • Baton Rouge, United States Hamlyn Williams Full time

    Job Summary: My client is seeking a dynamic and experienced Senior Process Simulations Engineer to join my clients growing team. In this role, you will be instrumental in designing and developing cutting-edge products and systems. Your primary responsibility will be to utilize your expertise in engineering and process simulations to transform product...


  • baton rouge, United States Hamlyn Williams Full time

    Job Summary: My client is seeking a dynamic and experienced Senior Process Simulations Engineer to join my clients growing team. In this role, you will be instrumental in designing and developing cutting-edge products and systems. Your primary responsibility will be to utilize your expertise in engineering and process simulations to transform product...


  • baton rouge, United States Hamlyn Williams Full time

    Job Summary: My client is seeking a dynamic and experienced Senior Process Simulations Engineer to join my clients growing team. In this role, you will be instrumental in designing and developing cutting-edge products and systems. Your primary responsibility will be to utilize your expertise in engineering and process simulations to transform product...


  • Baton Rouge, Louisiana, United States TEKsystems Full time

    The NetSuite Engineer will be the key resource for the architecture, implementation, training, support, documentation, management, and providing technical and functional assistance with NetSuite ERP.Key Responsibilities:Configure out of the box / support for ERP, including Financials, Order/Inventory Management, Supply Chain, and Manufacturing.Ability to...


  • Baton Rouge, Louisiana, United States SMX Corporation Full time

    Job Summary:SMX Corporation is seeking an experienced Electrical Engineer to support the Airborne Strategic Command, Control and Communications Program Office (PMA-271). The successful candidate will deliver engineering artifacts, including drawings, circuit diagrams, and airframe harnesses, to support the fabrication and installation of military...


  • Baton Rouge, Louisiana, United States Oracle Full time

    About the Role:We are seeking a highly skilled Senior Data Integration Specialist to join our team at Oracle. As a key member of our implementation engineering team, you will play a critical role in integrating our utility partners' data with our platform and configuring our applications to meet their program requirements.Responsibilities:Work with utility...


  • Baton Rouge, Louisiana, United States Kiewit Full time

    Job Summary: We are seeking a highly motivated and detail-oriented Entry Level Engineer to join our team at Kiewit Foundations Co. As a Field/Office Engineer, you will play a crucial role in supporting project and estimating work, working closely with our experienced engineers and project managers. Key Responsibilities: Assist in interpretation of drawings...