Principal Data Engineer

4 weeks ago

Jersey City, United States Tiger Analytics Full time
Job DescriptionJob Description

Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore, including a
substantial remote global workforce.

We’re Great Place to Work-Certified™. Working at Tiger Analytics, you’ll be at the heart of an AI revolution. You’ll work with teams that push the boundaries of what is possible and build solutions that energize and inspire.


Requirements

Curious about the role? What your typical day would look like?

As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling. You will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.

● Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)

● Conceptualize and execute high-performance data processing for structured and unstructured data, and data
harmonization

● Schedule, orchestrate, and validate pipelines

● Design exception handling and log monitoring for debugging

● Ideate with your peers to make tech stack and tools-related decisions

● Interact and collaborate with multiple teams (Consulting/Data Science & App Dev) and various stakeholders to meet deadlines, to bring Analytical Solutions to life.

What do we expect?

● Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,

Azure SQL Database

● A comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming
Analytics, Cosmos DB, and Purview

● A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging
skills in SQL, Python, or Scala/Java).

● Enthuse to collaborate with various stakeholders across the organization and take complete ownership of
deliverables.

● Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search

● Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV

● Good knowledge of building and designing REST APIs with real-time experience working on Data Lake or
Lakehouse projects.

● Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner

● Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are
valuable addition.

Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.

Job Requirement

  • Mandatory: Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
  • Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.
  • Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.
  • Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic
    Search.
  • Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV.
  • Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps.
  • Good to have:
  • Experience of working on Data Lake & Lakehouse projects
  • Experience of building REST services and implementing service-oriented architectures.
  • Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner.
  • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE)

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

  • Principal Data Engineer

    1 month ago

    Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive,...

  • Principal Data Engineer

    1 month ago

    Jersey City, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive,...

  • Principal Data Engineer

    3 months ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...

  • Snowflake Data Engineer

    1 month ago

    Jersey City, United States Data Piper Full time

    Job Description Job Description: Please note : We cannot sponsor visa and C2C Design develop test deploy and maintain enterprise level applications using the Snowflake platform Work with a variety of stakeholders to understand requirements and deliver solutions Take ownership of a project and see it through to completion Experience with the Snowflake...

  • Snowflake Data Engineer

    1 month ago

    Jersey City, New Jersey, United States Data Piper Full time

    Job DescriptionJob Description: Please note : We cannot sponsor visa and C2CDesign develop test deploy and maintain enterprise level applications using the Snowflake platformWork with a variety of stakeholders to understand requirements and deliver solutionsTake ownership of a project and see it through to completionExperience with the Snowflake...

  • Principal Software Engineer

    6 days ago

    Jersey City, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONBring your Senior Lead Software Engineering and management skills to the next level and become an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Principal Software Engineer at JPMorgan Chase within Corporate Investment Bank Data...

  • Principal Software Engineer

    2 days ago

    jersey city, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONIf you are looking for a game-changing career, working for one of the world's leading financial institutions, you’ve come to the right place.As a Principal Software Engineer at JPMorgan Chase within the Corporate Technology team, you provide expertise and engineering excellence as an integral part of an agile team to enhance,...

  • Principal Software Engineer

    5 days ago

    Jersey City, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONIf you are looking for a game-changing career, working for one of the world's leading financial institutions, you’ve come to the right place.As a Principal Software Engineer at JPMorgan Chase within the Corporate Technology team, you provide expertise and engineering excellence as an integral part of an agile team to...

  • Principal Software Engineer

    1 day ago

    jersey city, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONIf you are looking for a game-changing career, working for one of the world's leading financial institutions, you’ve come to the right place.As a Principal Software Engineer at JPMorgan Chase within the Corporate Technology team, you provide expertise and engineering excellence as an integral part of an agile team to enhance,...

  • Data Engineer

    4 weeks ago

    Jersey City, United States Glocomms Full time

    The Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...

  • Data Engineer

    4 weeks ago

    Jersey City, United States Glocomms Full time

    The Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...

  • Data Engineer

    4 weeks ago

    Jersey City, United States Princeton IT Services Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer / Data ArchitectLocation: Jersey city,NJExperience: 10+ Years Expert levelJob Type: Full-Time contract (W2 preferred)Job Summary: We are seeking an experienced Data Engineer/ Architect with expertise in Python, PySpark, and Databricks to join our dynamic team. You will be responsible for designing,...

  • Data Engineer

    3 days ago

    Jersey City, New Jersey, United States SoftPathTechnologies Full time

    Job DescriptionJob Type: Full-timeCompany: SoftPathTechnologiesJob Summary:We are seeking a highly skilled Databricks Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on the Databricks platform.Key Responsibilities:Design and implement data pipelines...

  • Principal Software Engineer

    2 months ago

    Redwood City, California, United States Informatica Full time

    Job Number: 37377Position Title: Principal Software EngineerExternal Description:DescriptionInformatica is currently looking for a Principal Software Engineer with experience in software design and architecture to join our team in Redwood City, CA.Job Summary As a Principal Engineer, you will be responsible for delivering an extensible, reliable , scalable,...

  • Data Engineer

    5 days ago

    Jersey City, United States VDart Inc Full time

    Job DescriptionJob DescriptionRole: Data EngineerDuratoin: 0-6 monthLocation: Jersey City NJ Job Descriptions:Ensures data is structured for accurate and efficient retrieval, storage, and analysis.Ability to create and optimize data models for integration, reporting, and analytics.Expertise in developing and maintaining taxonomies, metadata schemas, and data...

  • Sr. Data Engineer

    3 months ago

    Jersey City, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionOur client is expanding their Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a Sr. Data Engineer on our Data Engineering team, you will also...

  • Senior Data Engineer

    4 weeks ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Senior Data Engineer

    3 months ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Staff Data Engineering

    1 month ago

    Jersey City, United States Kavyos Consulting Full time

    As a technical leader of our data engineering team, reporting to our Director of Business Intelligence, you'll play a pivotal role in defining the foundation crucial for various types of analysis. Your work will encompass heavy cross-channel analysis of media interaction logs, optimizing paid media, distilling purchase data to better understand our...

  • Staff Data Engineer

    4 weeks ago

    Jersey City, United States Kavyos Consulting Full time

    As a technical leader of our data engineering team, reporting to our Director of Business Intelligence, you'll play a pivotal role in defining the foundation crucial for various types of analysis. Your work will encompass heavy cross-channel analysis of media interaction logs, optimizing paid media, distilling purchase data to better understand our...