Data Engineer
4 weeks ago
HR Professionals is currently seeking candidates to fill various positions for Business Intelligence Developer candidates that are interested in working throughout the State of Louisiana or are interested in Remote opportunities. These positions will require the experiences outlined below.
Job Summary
The Data Engineer will be responsible for operationalizing data and analytics initiatives for the company. They will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, data architects, and data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
Minimum Requirements
A bachelor's or master's degree in computer science, statistics, applied mathematics, data management, information systems, information science or a related quantitative field or equivalent work experience
At least five years or more of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks
At least three years of experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative
Knowledge and/or familiarity of the midstream services industry and data generated in support of business activities related to the gathering, compressing, treating, processing, and selling natural gas, NGLs and NGL products, and crude oil will be strongly preferred
Strong experience with advanced analytics tools for Object-oriented/object function scripting using languages such as R, Python, Java, C++, Scala, and others
Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata, and workload management
The ability to work with both IT and business in integrating analytics and data science output into business processes and workflows
Strong experience with database programming languages including SQL, PL/SQL, and others for relational databases, and knowledge and/or certifications on upcoming NoSQL/Hadoop-oriented databases like MongoDB, Cassandra, and others for nonrelational databases
Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies.
Knowledge and/or experience in working with SQL on Hadoop tools and technologies including HIVE, Impala, Presto, others from an open source perspective and Hortonworks Data Flow (HDF), Dremio, Informatica, Talend, others from a commercial vendor perspective
Experience in working with both open-source and commercial message queuing technologies such as Kafka, JMS, Azure Service Bus, Amazon Simple Queuing Service, others, stream data integration technologies such as Apache Nifi, Apache Beam, Apache Kafka Streams, Amazon Kinesis, and others
Basic experience working with popular data discovery, analytics, and BI software tools like Tableau, Qlik, PowerBI and others for semantic-layer-based data discovery
Strong experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms
Basic experience in working with data governance/data quality and data security teams and specifically data stewards and security resources in moving data pipelines into production with appropriate data quality, governance and security standards and certification
Demonstrated ability to work across multiple deployment environments including cloud, on-premises and hybrid, multiple operating systems and through containerization techniques such as Docker, Kubernetes, AWS Elastic Container Service and others
Familiarity with agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines to improve the communication, integration, reuse and automation of data flows between data managers and consumers across an organization
Strong written and verbal communication skills with an aptitude for problem-solving
Must be able to independently resolve issues and efficiently self-direct work activities based on the ability to capture, organize, and analyze information
Experience troubleshooting complicated issues across multiple systems and driving solutions
Experience providing technical solutions to non-technical individuals
Demonstrated team-building skills
Ability to deal with internal employees and external business contacts while conveying a positive, service-oriented attitude
Summary of Essential Functions
Develop, construct, test, and maintain data architectures or data pipelines
Ensure data architecture will support the requirements of the business
Discover opportunities for data acquisition
Develop data set processes for data modeling, mining, and production
Employ a variety of languages and tools to marry systems together
Recommend ways to improve data reliability, efficiency, and quality
Leverage large volumes of data from internal and external sources to answer business demands
Employ sophisticated analytics programs, machine learning, and statistical methods to prepare data for use in predictive and prescriptive modeling while exploring and examining data to find hidden patterns
Drive automation through effective metadata management using innovative and modern tools, techniques, and architectures to partially or completely automate the most common, repeatable, and tedious data preparation and integration tasks to minimize manual and error-prone processes and improve productivity
Propose appropriate (and innovative) data ingestion, preparation, integration, and operationalization techniques in optimally addressing data requirements
Ensure that the data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives
Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals
Powered by JazzHR
#J-18808-Ljbffr
-
Data Engineer
4 weeks ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
5 days ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
1 month ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
1 month ago
Los Angeles, California, United States VISART Full timeResponsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data architecture....
-
Data Engineer
4 weeks ago
Los Angeles, United States VISART Full timeResponsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data...
-
Data Engineer II
1 week ago
Los Angeles, California, United States Riot Games Full timeData Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...
-
Lead Data Engineer
9 hours ago
Los Angeles, United States SoLo Funds Full timeSoLo Funds is on a mission to help the millions of Americans that live paycheck to paycheck and can’t survive a money crunch. Launched in 2018 as a unique and proprietary lending marketplace, today SoLo is the leading alternative financial solution providing the fastest loans available for borrowers and the opportunity for lenders to earn significant...
-
Principal Data Engineer
4 weeks ago
Los Angeles, California, United States Riot Games Full timeData Engineers at Riot bring deep knowledge of data management so we can synthesize data within and across data domains. Our engineers are player and Rioter focused and aim to find solutions that make players excited to experience our games, and Rioters excited to deliver on our mission. Principal Engineers, at Riot, are often called on to help with the...
-
Data Engineer, Analytics
10 hours ago
Los Angeles, United States Meta Full timeMeta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...
-
Sr. Data Engineer
11 hours ago
Los Angeles, United States Motion Recruitment Full timeWe are a quantitatively driven, independent Investment Advisory that helps clients who are frustrated with Wall Street’s high expenses, excessive risks, and conflicts of interest. By bringing aboard top talent in computer science and finance, and investing heavily in technology infrastructure, we have created an innovative platform to provide...
-
Sr Data Engineer
4 weeks ago
Los Angeles, United States wipros Full timeResponsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard...
-
Sr Data Engineer
4 weeks ago
Los Angeles, California, United States wipros Full timeResponsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard code....
-
Staff Data Engineer
4 weeks ago
Los Angeles, United States Metropolis Full timeJob DescriptionJob DescriptionLocation: Santa Monica, CA, Seattle, WA, Chicago, IL, Nashville, TN or New York City, NY (Hybrid) The CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in...
-
Data Engineer II
1 week ago
Los Angeles, United States Riot Games Full timeData Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...
-
Senior Data Engineer
2 days ago
Los Angeles, United States Keeling Labs Full timeJob DescriptionJob DescriptionOur MissionFounded in 2022, Keeling Labs was started as a place to develop and apply machine learning to solve the world's biggest problem—climate change. Our current priority is getting the grid to run on 100% clean energy, which is currently limited by battery storage (specifically, the algorithms that control...
-
Senior Data Engineer
10 hours ago
Los Angeles, United States Motion Recruitment Full timeA fintech -based automated investment company that handles billions in client funds is hiring a Senior Data Engineer to join the team. In this role you will excel if you have a software background and can develop APIs with python while building out new ETL pipelines to support key trading and portfolio investment systems. The main tech stack for this role...
-
Senior Machine Learning Data Engineer
4 weeks ago
Los Angeles, United States Metropolis Full timeJob DescriptionJob DescriptionThe CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We're building the digital pipes through which the future of mobile commerce will...
-
Senior Data Engineer/Developer
3 weeks ago
Los Angeles, United States Tri-Force Consulting Services, Inc. Full timeJob DescriptionJob DescriptionTitle : Senior Data Engineer/Developer Location : Superior Court of California, County of Los Angeles`Client : Superior Court of CaliforniaNote : This is a remote position; however, they may have to travel on site or to other courts or conferences on rare occasions.Job Description : The Los Angeles Superior Court is seeking a...
-
Data Engineering System Administrator
1 day ago
Los Angeles, United States Brxio Inc Full time************** Please only Citizen or GC applicants only **************** ************** 10+ years exp in maintaining and support for Analytical software, RStudio, Stata, MATLAB, R **************** The Data Engineering System Administrator primary responsibility includes supporting, maintaining, administering, and upgrading the database appliances,...
-
Senior ETL DEV
4 weeks ago
Los Angeles, United States Gold Coast Health Plan Full timeSenior ETL DEV-Data Engineer Requisition ID: 1493 Salary Range: $100,406.00 To 167,344.00 Annually ( Mid-Range: $133,875 ) CA salary range posted. Please note: Salary range will vary for out of state remote work. The pay range above represents the minimum and maximum rate for this position in California. Factors that may be used to determine where newly...
