Spark (data engineer) Lead

Total 9+ yrs of experience spark Scala programming spark real time streaming - Kafka,Kudu,Impala,HBase spark scala batch pipelines GCP ,AWS - data pipelines Oozie , Airlfow, composer - scheduling tools CICD Jenkins basic java/springboot, This is TEAM LEAD Position, Lead Experience is highly Preferred. Job Description Experience in data engineer , Data...

Scala ,Python, PySpark, Kudo ,Kafka and Data Engineering background "Experience in data engineer , Data Analytics; Big Data Technologies Expert in Python. (Developer level Expertise expected), Programming experience in Python, R programming , Algorithms Spark, Kafka Good experience in the Data Models for Client; Reporting, Dash boarding; Client tools H2O,...

Required Skills & Experience 5+ Years of application development experience Strong experience in Apache Spark Development Proficient in server side development with Java and J2EE Experience with Hadoop Ecosystem (HDFS HIVE HBASE etc.) Knowledge of Kafka Streaming including topics producers consumers Well versed in Linux Environment Familiarity with...

Required Skills & Experience 5+ Years of application development experience Strong experience in Apache Spark Development Proficient in server side development with Java and J2EE Experience with Hadoop Ecosystem (HDFS HIVE HBASE etc.) Knowledge of Kafka Streaming including topics producers consumers Well versed in Linux Environment Familiarity with In-memory...

Job Title: Cloud Engineer - Senior / Big Data Location: McLean, VA / Dallas, TX (hybrid role) Duration: 6+ Months (possibility of extension or conversion) Experience: - 5 - 8 years Job Description 5+ Years of exp needed. Will be working in AWS environment. Product - Data Lake Platform in AWS This Developer will be working on Glue, DynamoDB, S3, Lambda...

Direct client Location: Irving, TXRole: Big Data EngineerSPECIFIC KNOWLEDGE AND SKILLS:5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix.2+ years experience with Apache Spark and Data bricks cloud tool sets (AWS or Azure).1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/ Azure...

Direct client Location: Irving, TXRole: Big Data EngineerSPECIFIC KNOWLEDGE AND SKILLS:5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix.2+ years experience with Apache Spark and Data bricks cloud tool sets (AWS or Azure).1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/ Azure...

Direct client Location: Irving, TXRole: Big Data EngineerSPECIFIC KNOWLEDGE AND SKILLS:5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix.2+ years experience with Apache Spark and Data bricks cloud tool sets (AWS or Azure).1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/ Azure...

Steer Health transforms healthcare with the industry's most widely adopted Al-fueled patient experience and growth. At Steer Health, we're creating next-generation consumer engagement experiences with solutions spanning care communication, patient engagement, scheduling, smart notifications, and more. We're growing rapidly and are seeking a highly motivated,...

4+ years of hands-on experience in designing, building, testing and deploying data pipelines in Teradata and Hadoop platform with experience in, HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie etc. Good experience in Scala, Java or Python programming Good experience in Cloud data engineering, preferably Google Cloud with Big Query Experience with...

Data Engineer Irving, TX Onsite Required Skills Technical Skills- ,Python,BigQuery,Cloud Dataproc Domain Skills- ,Payer Nice to have skills Techincal Skills- ,Cloud Composer Domain Skills- Technology Data Management Roles & Responsibilities Work with implementation teams from concept to operations, providing deep technical subject matter...

Role: Spark Lead Location: Irving Tx(Day one onsite role) Experience: 8+ Year Job Type: Full Time Note: Visa sponsorship not workable. Job Description : Strong understanding of SRE concept and practices with automation implementation. Spark Architecture and different critical components and services Strong hands-on experience in shell/python scripting...

Job Summary:Our client is seeking a Data Engineer who is highly enthusiastic and has experience in Python and Databricks. They will create, tune, maintain, and build reporting Big Data platforms that drive business. Duties:Perform systems integration design and development in cloud architecture design Build sizing and cost models for Cloud Services Review...

Job Summary:Our client is seeking a Data Engineer who is highly enthusiastic and has experience in Python and Databricks. They will create, tune, maintain, and build reporting Big Data platforms that drive business. Duties:Perform systems integration design and development in cloud architecture design Build sizing and cost models for Cloud Services Review...

Position: Data Engineer Location: 100% Remote Duration: 6+ Months Experience: - 8+ YearsTechnologies We Use: AWS Serverless Services Stack (S3, Athena, Lambda, SQS, SNS, Step Functions, Redshift, Glue, etc.), Python SQL Bitbucket/Github MSSQL Server Salesforce. Your Role: Execute on a shared technical architectural direction, long-term vision, and guiding...

Sr Data Engineer Lead Onsite - Irving, TX Perform the Data Engineer activities Experience 10to14Yrs 4.Required Skills , Hive, PySpark, Cloud Dataproc, Unix Shell Scripting, GCP Roles & Responsibilities Analyzes complex data structures from disparate data sources and design large scale data engineering pipeline Develops large scale data structures and...

Big Data Testing on Hadoop Hive etc. using HiveQL MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket Jenkins etc. Implementing Test Automation Frameworks for back-end validation including RDBMS file Kafka sources and Big Data targets Working in an Agile environment on Jira ALM Confluence...

Big Data Testing on Hadoop Hive etc. using HiveQL MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket Jenkins etc. Implementing Test Automation Frameworks for back-end validation including RDBMS file Kafka sources and Big Data targets Working in an Agile environment on Jira ALM Confluence etc. Big...

• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL Hive queries APIs to extract data from the store• Work closely with data Scientists to ensure the source data is aggregated and cleansed•...

Analyze and understand data sources & APIs Design and Develop methods to connect & collect data from different data sources Design and Develop methods to filter/cleanse the data Design and Develop SQL Hive queries APIs to extract data from the store Work closely with data Scientists to ensure the source data is aggregated and cleansed Work with product...