Remote Lead Data Engineer
1 week ago
About the job Remote Lead Data Engineer
Remote Lead Data Engineer needs 7+ years experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
Advanced knowledge one of language: Java, Scala, Python, C#
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with:
Data mining/programming tools (e.g. SAS, SQL, R, Python)
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Data visualization (e.g. Tableau, Looker, MicroStrategy)
Comfortable learning about and deploying new technologies and tools.
Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
Good written and oral communication skills and ability to present results to non-technical audiences
Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
AWS certification
Spark Streaming
Kafka Streaming / Kafka Connect
ELK Stack
Cassandra / MongoDB
CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
Create and manage cloud resources in AWS
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
Data processing/transformation using various technologies such as Spark and Cloud Services.
Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
-
Data Engineer
1 week ago
Dallas, United States IT Vision Group Full timeJob DescriptionJob DescriptionTitle : Data EngineerLocation: RemoteDuration: 12 Months+ We are looking for an onshore Data engineer with the following requirement to start ASAP:Must have: SQL, data profiling, data cleansing, and data modeling experience; comfortable working with raw data and converting them into insightful outcomes; comfortable...
-
Remote - Senior Data Engineer
1 week ago
Dallas, United States Resource Informatics Group Inc Full timeJob DescriptionJob DescriptionRole: Senior Data EngineerLocation: Dallas, TX – Remote Duration: 12 months Senior Data Engineer will be responsible for leading data engineering and ETL projects, mentoring team members, and architecting and developing ETL solutions. Also, should ensure development standards are maintained and must be able to collaborate...
-
Need Data Engineer or Data Architect
1 week ago
Dallas, United States IT Vision Group Full timeJob DescriptionJob DescriptionTitle : Data Engineer or Data ArchitectLocation: RemoteDuration: 12 Months+Client: TCS/Prudential Job Description : Data Engineer or Data Architect with Azure.
-
Cloud Data Engineer
2 days ago
Dallas, United States Resource Informatics Group Inc Full timeJob DescriptionJob DescriptionTitle: Cloud Data Engineer / AWS -- Remote role Start Date: 07/01/2019 End Date: 12/31/2019 (EXTENDABLE) # of Openings: Location: REMOTERate $market All InclusiveDescription: 5+ years’ experience with cloud-based big data storage, processing, ETL/ELT, and ingest tools such as S3, AWS Glue, and Apache Spark 3+ years’...
-
Cloud Data Engineer
1 week ago
Dallas, United States Resource Informatics Group Inc Full timeJob DescriptionJob DescriptionTitle: Cloud Data Engineer / AWS -- Remote role Start Date: 07/01/2019 End Date: 12/31/2019 (EXTENDABLE) # of Openings: Location: REMOTERate $market All InclusiveDescription: 5+ years’ experience with cloud-based big data storage, processing, ETL/ELT, and ingest tools such as S3, AWS Glue, and Apache Spark 3+ years’...
-
Azure Data Engineer, Tech Lead
1 week ago
Dallas, United States tlnt Full timeJob DescriptionJob DescriptionThe Role& We are seeking a highly experienced Senior Data Engineer with 10+ years of expertise in Azure data engineering. This role is responsible for the development and management of data pipelines, data modeling, and supporting organizational data analytics and insights initiatives. The ideal candidate will be proficient in...
-
Lead Data Engineer
1 day ago
Dallas, United States Infovision Full timeTitle: Lead ETL Support Engineer(ADF, SSIS, PowerBI) Need Local in Dallas, TX Qualifications: 12+ years of experience in ETL & Data Warehousing Should have excellent leadership & communication skills Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI Should have worked on data sources such as SAP and Salesforce Should have...
-
Data Engineer
1 week ago
Dallas, United States Leap Metrics Full timeOverviewWe are accepting applications for the Data Engineer positions to work on a product that helps improve the health of our population.Do you enjoy working with leading-edge technologies?Be part of a fast-moving, fast-growing, innovative technology team.Directly improve the daily lives of tens of thousands of our neighbors?If so, please contact us!Who We...
-
Lead Data Engineer
7 days ago
Dallas, United States Infovision Full timeTitle: Lead ETL Support Engineer(ADF, SSIS, PowerBI) Increase your chances of an interview by reading the following overview of this role before making an application. Need Local in Dallas, TX Qualifications: · 12+ years of experience in ETL & Data Warehousing · Should have excellent leadership & communication skills · Should have in depth knowledge on...
-
Lead Data Engineer
6 days ago
Dallas, United States Infovision Full timeTitle: Lead ETL Support Engineer(ADF, SSIS, PowerBI) Need Local in Dallas, TX Qualifications: 12+ years of experience in ETL & Data Warehousing Should have excellent leadership & communication skills Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI Should have worked on data sources such as SAP and Salesforce ...
-
Azure Data Engineer
1 week ago
Dallas, United States Resource Logistics Full timeTitle Clienture Data Engineer Location Remote ( Anywhere in USA) Should be willing to work in EST / CST time zone. Primary Skills Apache Spark, Hadoop, Scala, Clienture Synapse, Clienture Databricks Secondary Skills Data Warehousing, Unix Full time Job Title: Clienture Synapse Data Engineer This role is not eligible for Visa Sponsorship Designing Synapse...
-
Azure Databricks
Found in: Appcast Linkedin GBL C2 - 3 weeks ago
Dallas, United States Tredence Inc. Full timeAbout Tredence:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....
-
Azure Databricks
Found in: Appcast US C2 - 1 week ago
Dallas, United States Tredence Inc. Full timeAbout Tredence:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....
-
Azure Databricks
1 week ago
Dallas, United States Tredence Full timeAbout Tredence: Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale empowering end users to improve decision making....
-
Lead Software Engineer
Found in: beBee S US - 7 days ago
Dallas, United States JPMorgan Chase Full timeJob Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Sector, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure,...
-
Data Discovery
Found in: Appcast Linkedin GBL C2 - 3 weeks ago
Dallas, United States Pinnacle Group, Inc. Full timeJob DescriptionWhy you'll love this jobThe Data Discovery (BigID) engineer will work as part of the Cyber Risk Governance team to roll out BigID.This individual will work to deploy the BigID remote scanners in Azure Kubernetes (AKS) and on-prem Kubernetes environments.Engineer will extensively work with Data Discovery analysts,Data Governance and Data...
-
Data Discovery
1 week ago
Dallas, United States Pinnacle Group, Inc. Full timeJob DescriptionWhy you'll love this jobThe Data Discovery (BigID) engineer will work as part of the Cyber Risk Governance team to roll out BigID.This individual will work to deploy the BigID remote scanners in Azure Kubernetes (AKS) and on-prem Kubernetes environments.Engineer will extensively work with Data Discovery analysts,Data Governance and Data...
-
Data Discovery
Found in: Appcast US C2 - 1 week ago
Dallas, United States Pinnacle Group, Inc. Full timeJob DescriptionWhy you'll love this jobThe Data Discovery (BigID) engineer will work as part of the Cyber Risk Governance team to roll out BigID.This individual will work to deploy the BigID remote scanners in Azure Kubernetes (AKS) and on-prem Kubernetes environments.Engineer will extensively work with Data Discovery analysts,Data Governance and Data...
-
Principal Data Engineer
Found in: beBee jobs US - 1 week ago
Dallas, Texas, United States TXU Energy Full timeJob SummaryWe are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. You will provide technical leadership, drive innovation, and...
-
Data Engineer
Found in: Appcast Linkedin GBL C2 - 3 hours ago
Dallas, United States Apex Systems Full timePosition: Data EngineerLocation: Hybrid in Plano, Texas (3 days a week onsite)Duration: 6 months contract to hirePay Rate: Starting at $65/HRContract Type: W2 Only (No C2C at this time)Role:This position is responsible for Data Engineering and Security... this role covers jobs which develop database architectures to address business needs, ensuring system...