Lead Data Engineer

5 days ago

Jersey City, NJ, United States Inizio Partners Full time

About the job Lead Data Engineer

  • Job Title: Lead Data Engineer
  • No of Positions:2
  • Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week)
  • Experience: 10+ years specifically
  • Key Skills: Snowflake, SQL, Python, Spark, AWS-Glue, Big Data Concepts
Responsibilities:
  • Lead the design, development, and implementation of data solutions using AWS and Snowflake.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines, ensuring data quality, integrity, and security.
  • Optimize data storage and retrieval processes to support data warehousing and analytics.
  • Provide technical leadership and mentorship to junior data engineers.
  • Work closely with stakeholders to gather requirements and deliver data-driven insights.
  • Ensure compliance with industry standards and best practices in data engineering.
  • Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.
Must have:
  • Snowflake expertise (hands-on & architectural understanding), challenging situation in the project (most common question) this must be data related, or implementation related only
  • ETL/Data Management proficiency, mastery in: Query optimization, data quality, performance tuning, big data problems, RBAC, row/column-level security, CDC, Incremental vs Batch, Unix commands, job scheduling, CI/CD pipeline
  • Team leadership (8-10+ members), End-to-end project implementation with clarity, complex challenges in the project, describe the specific problem and its solution
  • Excellent communication skills
  • Stakeholder management & cross-functional collaboration (knowledge on data quality checks, profiling, STTM, data integration from multiple sources, reusable framework)
  • Release planning, change management, training, KT, L2/L3 support
  • Apache Iceberg + AWS glue
  • 10+ years of relevant experience in Data Engineering and delivery.
  • 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
  • Strong experience with SQL, python, and PySpark
  • Good understanding of Data ingestion and data processing frameworks
  • Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
  • Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
  • Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
  • Experience working in Agile Methodology
Requirements:
  • Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
  • Strong understanding of data warehousing concepts and best practices.
  • Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Experience in the insurance industry, preferably with knowledge of claims and loss processes.
  • Proficiency in SQL, Python, and other relevant programming languages.
  • Strong problem-solving skills and attention to detail.
  • Ability to work independently and as part of a team in a fast-paced environment.


Package Details

  • Lead Data Engineer

    2 weeks ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Position: Lead Data Engineer Location: Jersey City, NJ (Hybrid) Type: Fulltime Responsibilities for lead data engineer Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies Write and tune...

  • Lead Azure Data Engineer

    5 days ago

    Jersey City, NJ, United States Zencon Group Full time

    Job Title: Lead Azure Data Engineer Location: Jersey City, NJ/ New York - 4 days onsite role Long Term Role Required Skills & Qualifications: • Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Azure Stream Analytics. • Design and maintain data models, warehouses, and lakes that support BI and advanced analytics. ...

  • Lead Azure Data Engineer

    1 week ago

    Jersey City, NJ, United States Zencon Group Full time

    Job Title: Lead Azure Data Engineer Location: Jersey City, NJ/ New York - 4 days onsite role Long Term Role Required Skills & Qualifications: • Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Azure Stream Analytics. • Design and maintain data models, warehouses, and lakes that support BI and advanced analytics. ...

  • Lead Azure Data Enginer

    3 days ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Title: Sr. Data Engineer Location : NYC Job Description :- Required Skills: • 1.Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java) • 2. Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm) • 3. Proficiency in atleast one cloud data...

  • Sr. Data Lead

    3 days ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Tittle: Sr. Data Lead /Architect Location: Jersey City, New Jersey Duration: 12+ Months Job Type: Long Term Contract Job Description: Overall 10+ Years of experience Looking for a seasoned Sr. Data Lead /Architect to guide a team of 6 Data Engineers in designing and implementing robust data architecture solutions. This role emphasizes building a common...

  • Sr. Data Lead

    7 days ago

    Jersey City, NJ, United States Diverse Lynx Full time

    Job Tittle: Sr. Data Lead /Architect Location: Jersey City, New Jersey Duration: 12+ Months Job Type: Long Term Contract Job Description: Overall 10+ Years of experience Looking for a seasoned Sr. Data Lead /Architect to guide a team of 6 Data Engineers in designing and implementing robust data architecture solutions. This role emphasizes building a common...

  • Data Engineer

    3 days ago

    Jersey City, NJ, United States Pinnacle Group Full time

    Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job ID: 172543 Job Overview: As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key member of an agile team. Your role will involve designing and delivering reliable data collection, storage,...

  • Data Engineer

    5 days ago

    Jersey City, NJ, United States Pinnacle Group Full time

    THIS JOB DESCRIPTION WAS CREATED BY AI, REVIEW BEFORE POSTING Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job ID: 172543 Job Overview: As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key member of an agile team. Your role will involve...

  • Associate Principal

    2 weeks ago

    Jersey City, NJ, United States LTIMindtree Full time

    Role descriptionJob Title: Principal Data Modeler / Data Architecture Lead - Capital Markets Work Location Jersey City, NJ (Onsite, 5 days / week) Job Description: We are seeking a highly experienced Principal Data Modeler / Data Architecture Lead to reverse engineer an existing logical data model supporting all major lines of business in the capital...

  • Sr. Data Engineer

    7 days ago

    Jersey City, NJ, United States Verisk Analytics Full time

    Job Description The hire will be responsible for expanding and optimizing our data pipeline architecture. The ideal candidate is an experienced data pipeline builder and data wrangler with strong experience in handling data at scale. The Data Engineer will support our software developers, data analysts and data scientists on various data initiatives. This is...