Current jobs related to Big Data Engineer - Chicago, Illinois - Tiger Analytics

  • Big Data Engineer

    2 weeks ago

    Chicago, Illinois, United States Collabera Full time

    Job DescriptionJob Title: Big Data EngineerCompany: CollaberaLocation: Remote/HybridJob Type: Full-timeJob Category: EngineeringAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key...

  • Big Data Engineer

    2 weeks ago

    Chicago, Illinois, United States Collabera Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key ResponsibilitiesData Ingestion and Processing: Design and implement data ingestion pipelines to collect and...

  • Big Data Engineer

    6 days ago

    Chicago, Illinois, United States Collabera Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Collabera. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Kafka, Pyspark, and real-time data processing techniquesDevelop...

  • Big Data Architect

    3 weeks ago

    Chicago, Illinois, United States Tiger Analytics Full time

    Job OverviewTiger Analytics, a leading advanced analytics consulting firm, is seeking a highly skilled Big Data Engineer to join our team. Our company provides expert analytics services to Fortune 500 companies, helping them unlock business value from data.The ideal candidate will have a strong background in traditional and modern Big Data technologies,...

  • Big Data Engineer

    3 weeks ago

    Chicago, Illinois, United States RSN GINFO SOLUTIONS LLC Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at RSN GINFO SOLUTIONS LLC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark, Spark, and SQL.Key Responsibilities:Design and implement data pipelines using PySpark and SparkDevelop...

  • Big Data Developer

    2 weeks ago

    Chicago, Illinois, United States Collabera Full time

    About the RoleWe are seeking a highly skilled Big Data Developer to join our team at Collabera. As a Big Data Developer, you will play a key role in designing and developing large-scale data processing systems.Key ResponsibilitiesDesign and develop data processing systems using Python and PysparkWork on individual modules and come up with design for a...

  • Lead Data Engineer

    10 hours ago

    Chicago, Illinois, United States Epsilon Full time

    Job Title: Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Epsilon. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable, cloud-based software solutions.Key Responsibilities:Technical Expertise:Design and develop scalable, cloud-based software solutions...

  • Software Development Lead

    2 weeks ago

    Chicago, Illinois, United States Epsilon Data Interactive, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Epsilon Data Interactive, Inc. as an AI/ML Expert. In this role, you will collaborate with decision scientists and cross-functional teams to develop innovative AI and machine learning applications using Spark and Scala.Key ResponsibilitiesCollaborate with decision...

  • Data Pipeline Engineer

    2 weeks ago

    Chicago, Illinois, United States Jobot Full time

    About the RoleWe are seeking a highly skilled Data Pipeline Engineer to join our team at Jobot. As a key member of our data infrastructure team, you will be responsible for designing, building, and deploying ETL and ELT flows for consuming data from disparate sources.Key ResponsibilitiesCreate and deploy ETL and ELT flows for consuming data from various...

  • Data Engineer

    1 week ago

    Chicago, Illinois, United States Capital One Full time

    About the RoleCapital One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, developing, and implementing technical solutions that drive business value.Key ResponsibilitiesCollaborate with cross-functional teams to design and develop scalable data architecturesDevelop and maintain...

  • Data Engineer

    2 weeks ago

    Chicago, Illinois, United States McDonald's Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Global Technology – Data & Analytics team at McDonald's. As a Data Engineer, you will play a critical role in building scalable and efficient data solutions to support our company's data products and analytics initiatives.Key ResponsibilitiesDesign and Develop Data Pipelines: Develop...

  • Azure Data Engineer With Medallion

    2 weeks ago

    Chicago, Illinois, United States Magicforce Full time

    About This RoleWe are seeking a highly skilled Azure Data Engineer with expertise in Medallion Architecture to join our team at Magicforce.Key ResponsibilitiesData Platform Architecture: Design and implement large-scale data and analytics platforms on Azure, leveraging Medallion Architecture to drive business growth.Data Integration and Governance: Develop...

  • Data Engineer

    3 weeks ago

    Chicago, Illinois, United States United Airlines Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at United Airlines. As a Data Engineer, you will be responsible for designing and building scalable and reliable data infrastructure and pipelines to support data for measurement and reporting across our digital platforms.Key ResponsibilitiesDesign and build data infrastructure and...

  • AWS Data Engineer

    10 hours ago

    Chicago, Illinois, United States Epsilon Full time

    Job Title: Sr. AWS Data EngineerWe are seeking a highly skilled Sr. AWS Data Engineer to join our team at Epsilon. As a key member of our interdisciplinary team, you will be responsible for designing, developing, and implementing cloud-based data solutions that drive business growth and customer engagement.Job Responsibilities:80% of time spent on actual...

  • Senior Data Reliability Engineer

    3 weeks ago

    Chicago, Illinois, United States CME Group Full time

    Job OverviewA critical role in CME Group's Cloud data transformation, the Data SRE will be aligned to data product pods ensuring the firm's data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.Key ResponsibilitiesOptimize data pipelines to ensure efficient data processing and reduce latency.Ensure data integrity...

  • Lead Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Foursquare Full time

    About FoursquareFoursquare is a leading independent location technology and data cloud platform, dedicated to building meaningful bridges between digital spaces and physical places. Our proprietary technology unlocks the most accurate, trustworthy location data in the world, empowering businesses to answer key questions, uncover hidden insights, improve...

  • Senior Data Engineer

    3 weeks ago

    Chicago, Illinois, United States United Airlines Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at United Airlines. As a Data Engineer, you will play a critical role in designing and building scalable and reliable data infrastructure and pipelines to support data for measurement and reporting across our digital platforms.Key ResponsibilitiesDesign and build scalable and reliable...

  • Senior Software Engineer

    2 weeks ago

    Chicago, Illinois, United States Epsilon Data Interactive, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Epsilon Data Interactive, Inc. as an AI/ML Expert. In this role, you will collaborate with decision scientists and cross-functional teams to develop innovative AI and machine learning applications using Spark and Scala.Key Responsibilities:Collaborate with decision...

  • Machine Learning Engineer

    2 weeks ago

    Chicago, Illinois, United States minden Full time

    About UsMinden is a technology venture that redefines the engagement between brands and consumers in Southeast Asia. We are a strategic partnership between Temasek, DFI Retail Group, and coalition partners.Our CultureWe value diversity, inclusivity, and collaboration. Our team is built on respect, authenticity, and transparency. We prioritize agility,...

  • Data Scientist

    4 days ago

    Chicago, Illinois, United States Lorven technologies Full time

    Job DescriptionPosition: Data EngineerLocation: Chicago, ILDuration: ContractSkills: ETL concepts, GCP and its services, Big Query, Python, AirflowJob Requirements12+ Years of Overall IT ExperienceDesign and development of data ingestion and transformation processesProficiency in Python, BigQuery, DataProc, Cloud Storage and other GCP ServicesData Migration...

Big Data Engineer

3 months ago

Chicago, Illinois, United States Tiger Analytics Full time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

The Big Data Azure Engineer will be responsible for architecting, designing, and implementing advanced analytics capabilities. These capabilities include batch and streaming analytics, machine learning models, natural language generation, and other emerging technologies in the field of advanced analytics.

Requirements

  • Bachelors degree in Computer Science or similar field
  • 4+ years of experience in traditional and modern Big Data technologies (HDFS, Hadoop, Hive, Pig, Sqoop, Kafka, Apache Spark, hBase, Oozie, No SQL databases)
  • Experience in Java/Python/Scala
  • Experience extracting/querying/joining large data sets at scale
  • Experience building data platforms using Azure stack
  • Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data
  • Strong knowledge on Azure Storage schematics such as Gen1 and Gen2
  • Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
  • Knowledge of Azure networking, security, key vaults, etc.
  • Experience in data wrangling, advanced analytic modeling, and AI/ML capabilities is preferred
  • Experience utilizing Snowflake to build data marts with the data residing in Azure storage is a plus
  • Strong communication and organizational skills
Benefits This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.