Principal Data Engineer

4 days ago

Richardson, United States Tiger Analytics Full time
Job DescriptionJob Description

Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore, including a
substantial remote global workforce.

We’re Great Place to Work-Certified™. Working at Tiger Analytics, you’ll be at the heart of an AI revolution. You’ll work with teams that push the boundaries of what is possible and build solutions that energize and inspire.


Requirements

Curious about the role? What your typical day would look like?

As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling. You will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.

● Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)

● Conceptualize and execute high-performance data processing for structured and unstructured data, and data
harmonization

● Schedule, orchestrate, and validate pipelines

● Design exception handling and log monitoring for debugging

● Ideate with your peers to make tech stack and tools-related decisions

● Interact and collaborate with multiple teams (Consulting/Data Science & App Dev) and various stakeholders to meet deadlines, to bring Analytical Solutions to life.

What do we expect?

● Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,

Azure SQL Database

● A comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming
Analytics, Cosmos DB, and Purview

● A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging
skills in SQL, Python, or Scala/Java).

● Enthuse to collaborate with various stakeholders across the organization and take complete ownership of
deliverables.

● Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search

● Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV

● Good knowledge of building and designing REST APIs with real-time experience working on Data Lake or
Lakehouse projects.

● Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner

● Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are
valuable addition.

Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.

Job Requirement

  • Mandatory: Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
  • Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.
  • Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.
  • Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic
    Search.
  • Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV.
  • Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps.
  • Good to have:
  • Experience of working on Data Lake & Lakehouse projects
  • Experience of building REST services and implementing service-oriented architectures.
  • Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner.
  • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE)

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

  • Principal Systems Engineer

    4 days ago

    Richardson, United States Smart Synergies Full time

    Client is looking for a Principal Systems Engineer to join our systems engineering team. Our Engineers support technical direction and design to software agile development teams, and other Engineering personnel. They perform technical analyses and define how the system works creating use cases, system capability and feature designs, defining system...

  • Principal Systems Engineer with Security Clearance

    4 days ago

    Richardson, United States Solidus Technical Solutions Full time

    Solidus is looking for a Principal Systems Engineer to join our systems engineering team. Our Engineers support technical direction and design to software agile development teams, and other Engineering personnel. They perform technical analyses and define how the system works creating use cases, system capability and feature designs, defining system...

  • Principal Systems Engineer

    4 days ago

    Richardson, United States RTX Full time

    Date Posted: 2024-10-04 Country: United States of America Location: TX233: Richardson 1737 CityLine 1737 East CityLine Drive Building C37, Richardson, TX, 75082 USA Position Role Type: Onsite At Raytheon, the foundation of everything we do is rooted in our values and a higher calling to help our nation and allies defend freedoms and deter aggression....

  • Principal Systems Engineer

    3 days ago

    Richardson, United States Raytheon Full time

    Date Posted: To be considered for an interview, please make sure your application is full in line with the job specs as found below.2024-10-04 Country: United States of America Location: TX233: Richardson 1737 CityLine 1737 East CityLine Drive Building C37, Richardson, TX, 75082 USA Position Role Type: Onsite At Raytheon, the foundation of everything we do...

  • Principal Software Engineer

    3 days ago

    Richardson, United States Smart Synergies Full time

    Client is hiring a Principal Java Software Engineer to support their team in Richardson, Texas. You will have the opportunity to directly impact the world around you and contribute to classified programs and technologies you are passionate about. In this role, you will use your solid foundation in Java and experience working in a Linux environment to...

  • Principal Software Engineer, Yahoo Search

    1 week ago

    Richardson, United States Yahoo Holdings Inc. Full time

    Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results. A Little About Us: Yahoo is a global media and tech company that...

  • Principal Systems Engineer with Security Clearance

    4 days ago

    Richardson, United States RTX Corporation Full time

    Date Posted:2024-10-04Country:United States of AmericaLocation:TX233: Richardson 1737 CityLine 1737 East CityLine Drive Building C37, Richardson, TX, 75082 USAPosition Role Type:Onsite At Raytheon, the foundation of everything we do is rooted in our values and a higher calling to help our nation and allies defend freedoms and deter aggression. We bring the...

  • Principal Software Engineer

    6 days ago

    Richardson, Texas, United States RTX Full time

    Job OverviewWe are seeking a highly skilled Senior Software Infrastructure Engineer to join our team developing cutting-edge systems for the US Department of Defense (DoD) and Intelligence Community (IC).The ideal candidate will have a strong background in DevSecOps engineering, with experience designing and implementing complex information systems from data...

  • Principal Engineer, High-Speed Digital Design

    7 days ago

    Richardson, Texas, United States Celestica Inc. Full time

    Job Description:The Principal Engineer, High-Speed Digital Design at Celestica Inc. will be responsible for developing and implementing high-speed digital design solutions for our customers. This includes designing and implementing signal integrity and power integrity solutions, as well as collaborating with cross-functional teams to ensure robust and...

  • Principal Product Designer

    3 days ago

    Richardson, United States Yahoo Holdings Inc. in Full time

    Principal Product Designer - Search Commerce (Finance) Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results. Yahoo is seeking...

  • Principal Application Developer Role

    6 days ago

    Richardson, Texas, United States CBRE Full time

    Job OverviewWe are seeking a highly experienced Sr Software Engineer to join our team. As a principal application developer, you will be responsible for designing, developing, and maintaining high-complexity client systems.Key ResponsibilitiesDesign, develop, and maintain high-complexity client systemsEvaluate and implement new features and...

  • Principal Software Engineer

    4 days ago

    Richardson, United States Smart Synergies Full time

    Client is hiring a Principal Java Software Engineer to support their team in Richardson, Texas. You will have the opportunity to directly impact the world around you and contribute to classified programs and technologies you are passionate about. In this role, you will use your solid foundation in Java and experience working in a Linux environment to...

  • Principal Operations Support Engineer

    18 hours ago

    Richardson, United States Raytheon Full time

    Principal Operations Support Engineer at Raytheon summary: The Principal Operations Support Engineer at Raytheon is responsible for providing Tier 3 support for production systems running web-based applications on Linux. This role involves troubleshooting, verifying requirement fulfillment, and collaborating with engineering teams to resolve issues and...

  • Principal Systems Architect

    6 days ago

    Richardson, Texas, United States Apex Systems Full time

    Company OverviewApex Systems is a world-class IT services company that serves thousands of clients across the globe.Job DescriptionWe are seeking a skilled Principal Systems Architect to join our systems engineering team. As a key member of our team, you will support technical direction and design to software agile development teams, and other Engineering...

  • Principal Systems Safety Engineer

    17 hours ago

    Richardson, Texas, United States RTX Full time

    Job SummaryWe are seeking a highly skilled Principal Systems Safety Engineer to join our team in Richardson, TX. As a key member of our Mission Systems team, you will be responsible for developing, assessing, and verifying system safety related requirements for mission-critical systems.Our ideal candidate will have a strong background in system safety...

  • Principal Engineer I

    1 week ago

    Richardson, United States CVS Health Full time

    Bring your heart to CVS Health. Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced human-centric health care for a rapidly changing world. Anchored in our brand — with heart at its center — our purpose sends a personal message that how we...

  • Principal Operations Support Engineer

    1 day ago

    Richardson, United States Raytheon Full time

    Principal Operations Support Engineer at Raytheon summary: The Principal Operations Support Engineer at Raytheon is responsible for providing Tier 3 support for production systems running web-based applications on Linux. This role involves troubleshooting, verifying requirement fulfillment, and collaborating with engineering teams to resolve issues and...

  • Senior Data Engineer

    4 days ago

    Richardson, United States Dynatron Software Full time

    Job DescriptionJob DescriptionAt Dynatron Software, we help automotive service departments increase revenue and profitability with our suite of services. We strive to be a people-first company where employees enjoy coming to work, the people they work with, and are given the autonomy to succeed. Our company culture is built on a foundation of our 5 Core...

  • Senior Data Engineer

    1 day ago

    Richardson, United States Dynatron Software Full time

    Job DescriptionJob DescriptionAt Dynatron Software, we help automotive service departments increase revenue and profitability with our suite of services. We strive to be a people-first company where employees enjoy coming to work, the people they work with, and are given the autonomy to succeed. Our company culture is built on a foundation of our 5 Core...

  • GCP Data Engineer

    5 days ago

    Richardson, United States Galent Full time

    Role: GCP Data EngineerLocation: Richardson, TX / Woonsocket, RI(Onsite)Job Type: FulltimeInfosys is seeking an GCP Lead Developer with experience working in a Big Data ecosystem. The position will primarily be responsible for interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle...