Pyspark Databricks Lead

1 month ago


Chicago, United States Cognizant Full time

This hybrid position is open to any qualified applicant in the United States. This position is hybrid in Chicago, Illinois. A qualified applicant must be local to this area or be open to relocation. Practice - AIA - Artificial Intelligence and Analytics About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future—a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models Cognizant’s AIA practice takes insights that are buried in data and provide businesses with a clear way to transform how they source, interpret, and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence. Job Duties and Responsibilities: Job Title: Pyspark Databricks Lead (Hybrid) Job Summary: We are seeking a highly skilled Technical Lead with 10 to 12 years of experience to join our team as an Architect - Technology. The ideal candidate will have extensive experience in PySpark Spark Pyspark Databricks Databricks Workflows and Databricks SQL. Additionally expertise in the Issuer and Issuer Processor domain is mandatory. This role involves leading technical projects ensuring high-quality deliverables and driving innovation within the team. Qualifications · Possess a strong background in PySpark and Spark with hands-on experience in designing and implementing data processing solutions. · Demonstrate expertise in Databricks and Databricks Workflows with a proven track record of automating data pipelines. · Exhibit proficiency in Databricks SQL and the ability to optimize complex queries for performance. · Have in-depth knowledge of the Issuer and Issuer Processor domain with experience in handling domain-specific data challenges. · Showcase excellent problem-solving skills and the ability to troubleshoot complex technical issues. Salary and Other Compensation: Applications will be accepted until 1 Oct 2024. The annual salary for this position is between $115,500 - $135,000 depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizant’s discretionary annual incentive program and stock awards, based on performance and is subject to the terms of Cognizant’s applicable plans. Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements: Medical/Dental/Vision/Life Insurance Paid holidays plus Paid Time Off 401(k) plan and contributions Long-term/Short-term Disability Paid Parental Leave Employee Stock Purchase Plan Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.



  • Chicago, Illinois, United States CapB InfoteK Full time

    Job Description:CapB InfoteK is seeking a highly skilled Senior Python Pyspark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing architectures within AWS utilizing Databricks. Your expertise in writing Pyspark pipelines in Databricks will be crucial in driving our data engineering...


  • Chicago, United States CapB InfoteK Full time

    CapB is looking for Python PySpark developers Full time or Contract. Able to communicate technical concepts including presenting and whiteboarding  2  Ability to design and implement architectures within AWS utilizing Databricks  3  Hands on Experience writing Pyspark pipelines in Databricks  4  Minimum 5 7 years of experience with Python Spark and the...


  • Chicago, Illinois, United States CapB InfoteK Full time

    Job Description:At CapB InfoteK, we are seeking a highly skilled Senior Python PySpark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing architectures within AWS utilizing Databricks.Key Responsibilities:Design and implement data pipelines using Python PySpark in...


  • Chicago, Illinois, United States Diverse Lynx Full time

    Job Title: Data Engineer with Databricks ExperienceJob Description: We are seeking an experienced Data Engineer with a strong background in Databricks and Hadoop ecosystems to join our team at Diverse Lynx LLC. The ideal candidate will have 8+ years of experience in developing Spark applications using spark-SQL in Databricks for data extraction,...


  • Chicago, Illinois, United States Databricks Full time

    Job DescriptionAt Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Databricks Data Intelligence Platform.As a Delivery Solutions Architect, you will play a critical role in accelerating the adoption and growth of the Databricks platform in our customers' organizations.You will collaborate...

  • Developer - medical

    4 days ago


    Chicago, IL, United States Cognizant Full time

    A qualified applicant must be local to this area or be open to relocation. Practice - AIA - Artificial Intelligence and Analytics Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. Within AI & Analytics, we work to design the future—a future in which...


  • Chicago, Illinois, United States Nielsen Consumer LLC Full time

    Job DescriptionWe are seeking a highly skilled Cloud Architect to lead our Big Data team. The ideal candidate will have hands-on experience with Python, Pyspark, and Jupyter Notebooks, as well as a strong understanding of data science concepts.Key Responsibilities:Design and develop cloud-based big data applications using a variety of...


  • Chicago, Illinois, United States ClifyX Full time

    Job Title: Databricks Admin **Job Summary:** We are seeking a highly skilled Databricks Admin with strong DevOps skills to join our team at ClifyX. The ideal candidate will have a minimum of 10 years of IT experience and 4 years of Databricks administration experience. **Key Responsibilities:** * Administer and manage Databricks environments * Develop...

  • Azure Data Engineer

    1 week ago


    Chicago, Illinois, United States Diverse Lynx Full time

    Candidate should possess strong expertise in the following areas:Key Responsibilities:Develop and maintain Azure Databricks services for data engineering.Read and write data from/to Azure Blob storage and Azure Synapse Gen2 storage using Azure Databricks services.Work with Databricks File System (DBFS) and experience in constructing ingestion,...


  • Chicago, Illinois, United States Databricks Full time

    Job Title: Senior Manager Field EngineeringAt Databricks, we are seeking a highly experienced Senior Manager Field Engineering to lead our Field Engineering team. As a key member of our organization, you will be responsible for driving the success of our customers and partners by providing technical guidance and support.About the RoleThe Senior Manager Field...


  • Chicago, Illinois, United States Wavicle Data Solutions Full time

    Unlock Business Potential with Wavicle Data SolutionsAt Wavicle Data Solutions, we're on a mission to empower businesses to make data-driven decisions. As a Databricks Solution Architect, you'll play a crucial role in designing and implementing scalable and optimized solutions that leverage the latest Databricks features.Key Responsibilities: Develop data...

  • Senior Data Architect

    2 weeks ago


    Chicago, Illinois, United States Saxon Global Full time

    Data Engineer Role OverviewThe ideal candidate will have strong experience with PySpark and a proven track record in data engineering. They will work closely with the team to take our data platform to the next level, focusing on integrations, bug fixes, expansions, and improvements.Key Responsibilities: Strong expertise in PySpark, Spark, SQL, CI/CD, and...

  • Azure Data Engineer

    2 weeks ago


    Chicago, Illinois, United States Diverse Lynx Full time

    Job Requirements:We are seeking a highly skilled Cloud Data Solutions Expert to join our team at Diverse Lynx LLC. The ideal candidate will have strong experience in working with Azure Databricks services, including creating, reading, and writing data from/to Azure Blob storage and Azure Synapse Gen2 storage.The successful candidate will have hands-on...


  • Chicago, Illinois, United States Databricks Full time

    Job SummaryWe are seeking a highly skilled Geo Enterprise Account Executive to join our team at Databricks. As a strategic sales professional, you will be responsible for selling our cloud data platform to Healthcare & Life Sciences accounts. You will work closely with CIOs, IT executives, and other important partners to identify and close new business...

  • Data Scientist

    2 weeks ago


    Chicago, United States Purple Drive Full time

    Skills Required: 5 years of relevant experience as a handson quantitative investment professional with a track record of developing predictive alpha models in fixed income markets. Masters or PhD in a technical or quantitative discipline (e.g. statistics mathematics physics electrical engineering computer science applied economics or finance). Systematic...

  • Data Scientist

    1 week ago


    Chicago, United States Purple Drive Full time

    Skills Required: 5 years of relevant experience as a handson quantitative investment professional with a track record of developing predictive alpha models in fixed income markets. Masters or PhD in a technical or quantitative discipline (e.g. statistics mathematics physics electrical engineering computer science applied economics or finance). Systematic...


  • Chicago, Illinois, United States Cyclotron, Inc. Full time

    Job DescriptionCyclotron, Inc. is seeking a highly skilled Sr. Data Engineer to lead the creation of high-value data-driven solutions leveraging our proven implementation methodology and solutions for enterprise projects.Key Responsibilities:Design and implement advanced analytics solutions based on customer needs and knowledge of Microsoft Cloud and related...

  • MS Fabric

    1 month ago


    Chicago, United States Sogeti Full time

    Sogeti is looking for a talented, local MS Fabric (MSFT)-Databricks Data Engineer to join our Chicagoland team built on the success of our people and partnerships. Come be a part of our “People centric” culture!Sogeti is a wholly-owned subsidiary of Capgemini and the Technology and Engineering Services Division of Capgemini. We have more than 25,000...

  • Data Engineer

    2 weeks ago


    Chicago, Illinois, United States Syntricate Technologies Full time

    Job Description:We are seeking a highly skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks services. Your expertise in working with Azure Databricks services, including creating services, reading and...


  • Chicago, United States Go2Group LLC Full time

    Job DescriptionJob Description*No C2C please - only seeking candidates able to work full-time for any employer without sponsorship Are you eager to drive change and lead impactful transformations? We’re excited to welcome a Senior Architect to our client’s fast-growing Technology & Platforms Practice within the Data Engineering and Analytics group. In...