Senior Data Engineer
4 days ago
Details:
Senior Data Engineer
Location: Remote
Duration: 6 months CTH
Position Summary:
The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.
Minimum Qualifications:
- 8+ Years overall IT experience with minimum 5 years of work experience in below tech skills
- Strong experience in Python Scripting and PySpark for data processing
- Proficiency in SQL, dealing with big data over Informatica ETL
- Proven experience in Data quality and data optimization of data lake in Iceberg format, with strong understanding of architecture
- Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event bridge)
- Expertise in BASH/Shell scripting
- Experience in Data Build Tool (DBT) or similar data transformation tools
- Experience in Mulesoft API
- Nice to have: Kafka, Tableau
- Strong understanding of healthcare data systems and experience leading data engineering teams
- Experience in Agile environments.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills.
- Leads development of data pipelines and architectures that handle large-scale data sets.
- Designs, constructs, and tests data architecture aligned with business requirements.
- Provides technical leadership for data projects, ensuring best practices and high-quality data solutions.
- Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
- Work with DBT (Data Build Tool) for transforming raw data into actionable insights.
- Oversees development of data solutions that enable predictive and prescriptive analytics.
- Ensures the technical quality of solutions, managing data as it moves across environments.
- Aligns data architecture to Healthfirst solution architecture.
-
Senior Data Engineer
6 days ago
Jersey City, NJ, United States Apex Informatics Full timeSenior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses on projects itself, not the summary Interviews - 2 rounds focused on technical - Scala, Spark, write code, answer design...
-
Senior Data Engineer
2 weeks ago
Jersey City, NJ, United States Apex Informatics Full timeSenior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses on projects itself, not the summary Interviews - 2 rounds focused on technical - Scala, Spark, write code, answer design...
-
Senior Data Engineer
1 week ago
Jersey City, NJ, United States Apex Informatics Full timeSenior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses on projects itself, not the summary Interviews - 2 rounds focused on technical - Scala, Spark, write code, answer design...
-
Senior Data Engineer
2 weeks ago
Jersey City, NJ, United States Apex Informatics Full timeSenior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses on projects itself, not the summary Interviews - 2 rounds focused on technical - Scala, Spark, write code, answer design...
-
Senior Big Data Engineer- US
1 week ago
Jersey City, NJ, United States Zortech Solutions Full timeRole: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months Job Description: Please submit someone who can go for in person interview, travel expenses will be taken care by client Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a...
-
Senior Big Data Engineer- US
2 days ago
Jersey City, NJ, United States Zortech Solutions Full timeRole: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months Job Description: Please submit someone who can go for in person interview, travel expenses will be taken care by client Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a...
-
Senior Big Data Engineer- US
16 hours ago
Jersey City, NJ, United States Zortech Solutions Full timeRole: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months Job Description: Please submit someone who can go for in person interview, travel expenses will be taken care by client Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a...
-
Senior Big Data Engineer- US
5 days ago
Jersey City, NJ, United States Zortech Solutions Full timeRole: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months Job Description: Please submit someone who can go for in person interview, travel expenses will be taken care by client Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a...
-
Senior Data Engineer
1 week ago
Jersey City, NJ, United States Inizio Partners Full timeAbout the job Senior Data Engineer Role Overview: Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience in database management Develop and maintain data models, data warehouses, and data marts in Snowflake Automation, build...
-
Senior Data Engineer
1 week ago
Jersey City, NJ, United States Inizio Partners Full timeAbout the job Senior Data Engineer Role Overview: Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience in database management Develop and maintain data models, data warehouses, and data marts in Snowflake Automation, build...
