Principal Data Engineer

2 weeks ago

Jersey City, United States Tiger Analytics Full time
Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore, including a

substantial remote global workforce.

We're Great Place to Work-Certified™. Working at Tiger Analytics, you'll be at the heart of an AI revolution. You'll work with teams that push the boundaries of what is possible and build solutions that energize and inspire.

Requirements

Curious about the role? What your typical day would look like?

As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling. You will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.

  • Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)
  • Conceptualize and execute high-performance data processing for structured and unstructured data, and data

harmonization

  • Schedule, orchestrate, and validate pipelines
  • Design exception handling and log monitoring for debugging
  • Ideate with your peers to make tech stack and tools-related decisions
  • Interact and collaborate with multiple teams (Consulting/Data Science & App Dev) and various stakeholders to meet deadlines, to bring Analytical Solutions to life

What do we expect?

  • Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,

Azure SQL Database

  • A comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming

Analytics, Cosmos DB, and Purview

  • A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging

skills in SQL, Python, or Scala/Java).

  • Enthuse to collaborate with various stakeholders across the organization and take complete ownership of

deliverables.

  • Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search
  • Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV
  • Good knowledge of building and designing REST APIs with real-time experience working on Data Lake or

Lakehouse projects.

  • Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner
  • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are

valuable addition.

Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.

Job Requirement

  • Mandatory: Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
  • Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview
  • Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java
  • Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search
  • Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV
  • Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps
  • Good to have:
  • Experience of working on Data Lake & Lakehouse projects
  • Experience of building REST services and implementing service-oriented architectures
  • Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner
  • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE)

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

  • Principal Data Engineer

    2 weeks ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...

  • Principal Data Engineer

    2 weeks ago

    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe...

  • Principal Full Stack Engineer

    5 days ago

    Jersey City, United States City National Bank Full time

    Principal Full Stack Engineer WHAT IS THE OPPORTUNITY? As a member of the Operations Technologies Group, the Full Stack Principal Engineer is responsible for designing, developing and maintaining legacy and "Cloud First" applications written primarily in C# and focused on .Net Core and Azure cloud platform. The group is continuously working to improve our...

  • Principal Full Stack Engineer

    5 days ago

    Jersey City, United States City National Bank Full time

    Principal Full Stack Engineer WHAT IS THE OPPORTUNITY? As a member of the Operations Technologies Group, the Full Stack Principal Engineer is responsible for designing, developing and maintaining legacy and "Cloud First" applications written primarily in C# and focused on .Net Core and Azure cloud platform. The group is continuously working to improve our...

  • Principal Data Engineer with Apache Flink

    5 days ago

    California City, United States Codebase Full time

    Job Title : Principal Data Engineer with Apache Flink/Apache Spark Location California based team) Duration : Long-term Job Description What were looking for: Youre a talented, creative, and motivated engineer who loves developing powerful, stable, and intuitive apps and youre excited to work with a team of individuals with that same passion. Youve...

  • Principal Database Engineer

    2 weeks ago

    Jersey City, United States The Depository Trust & Clearing Corporation Full time

    Job Tittle: Principal Database Engineer (DB2)Duration: Full-timeLocation: FL/NJ/MA/VA (Hybrid 3 days onsite, Rest days remote) About this Opportunity: The impact you will have in this role: The Database Engineering team is responsible for managing DTCCs public and private cloud databases and responsible for the design, build, and operational aspects...

  • Senior Principal Engineer- Remote with Travel

    1 month ago

    Jersey City, United States Georgia IT Inc Full time

    Senior Principal Engineer Location: Location : Remote work with travel to Either Philly or Jersey City Duration: 3-6 months CTH Job description As a Principal Software Engineer on our team, you'll play a key role in supporting our digital transformation journey by leading a team of developers to build and implement large scale applications involving APIs...

  • Systems Engineer Principal

    1 week ago

    Oklahoma City, United States Science Applications International Corporation Full time

    SAIC is looking to hire a Systems Engineer Principal in Midwest City, OK. The candidate selected will perform Systems Engineering activities related to Aircraft software including: requirements definition, analysis and engineering, system architectin Systems Engineer, Systems, Engineer, Principal, Software, Data Architect

  • Principal Engineer, Platform Engineering

    5 days ago

    Jersey City, United States The Judge Group Full time

    Location: Jersey City, NJ Salary: Negotiable Description: Our client is currently seeking a Principal Engineer, Platform Engineering (Automation) As a Principal Engineer on the team, you will be responsible for leading the architecture, design, development and launch of some of the core product features. You will have significant influence on our overall...

  • Principal Data Architect

    3 days ago

    Jersey City, United States JPMorgan Chase & Co. Full time

    Your unmatched expertise and unrelenting quest for outcomes are the driving forces for transformation that inspire high-quality solutions - you are a crucial member of a diverse team of thought leaders committed to leaving a positive mark on the industry. As a Principal Data Architect within JPMorgan Chase Community and Consumer Banking Division, you will...

  • Principal/Lead Software Engineer

    6 days ago

    Jersey City, New Jersey, United States Kforce Inc Full time

    RESPONSIBILITIES:Kforce's client, a highly regarded and growing financial firm offering a generous benefits package and flexible work schedule, is seeking to hire a Principal/Lead Software Engineer (Java, FinTech) in Jersey City, New Jersey. Summary: The Principal/Lead Software Engineer (Java, FinTech) will play a key role in building a new low-latency...

  • Principal Data Architect

    20 hours ago

    Jersey City, United States JPMorgan Chase & Co Full time

    **JOB DESCRIPTION** Your unmatched expertise and unrelenting quest for outcomes are the driving forces for transformation that inspire high-quality solutions - you are a crucial member of a diverse team of thought leaders committed to leaving a positive mark on the industry. As a Principal Data Architect within JPMorgan Chase Community and Consumer Banking...

  • Principal Software Engineer

    2 days ago

    Jersey City, United States Dtcc Full time

    Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We're committed to helping our employees grow and succeed. We believe that you...

  • Data Engineer

    1 week ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    1 week ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    1 week ago

    Jersey City, United States YASH Technologies Full time

    Hi,We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume.Requirement Details: Location: Jersey City, NJ Work Authorizations: Citizen, GC EAD, Green Card, H4 EADPosition Type: Contract Job Title: Data Engineer Primary Skills: • Oracle • Mongo DB • Data engineer • NO SQL data...

  • Data Engineer

    19 hours ago

    Jersey City, United States Jarvis Walker Full time

    Data EngineerWe are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lines of business, as well as enhance our existing product line.Key...

  • Principal/Lead Software Engineer

    5 days ago

    Jersey City, United States Kforce Inc Full time

    RESPONSIBILITIES:Kforce's client, a highly regarded and growing financial firm offering a generous benefits package and flexible work schedule, is seeking to hire a Principal/Lead Software Engineer (Java, FinTech) in Jersey City, New Jersey. Summary: The Principal/Lead Software Engineer (Java, FinTech) will play a key role in building a new low-latency...

  • Data Engineer

    5 days ago

    Jersey City, United States YASH Technologies Full time

    Looking for 10+ yrs Senior ResourceMandatory Skills· Oracle· Mongo DB· Data Engineer· NO SQL database· Data ModelingThe Senior Database Engineer(MongoDB) will lead complex or critical database management initiatives that typically involve multiple disciplines and business groupsSupporting MongoDB databases / Supporting MongoDB Shards with Pearl and/or...

  • Senior Data Engineer

    2 weeks ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...