Databricks Architect

3 weeks ago


New York, United States acunor Full time

Acunor is looking for Databricks Architect for one of its premier clients. it is fulltime and hybrid opportunity at NJ / OH. interested candidates are encouraged to apply with the most recent resume to saikumar.m@acunor.com

Position: Databricks Architect Location: New Jersey / Dublin, OH (Hybrid) Full Time position

Role & Responsibilities Overview: Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring Continuously improve systems through performance enhancements and cost reductions in compute and storage Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs Lead Data Engineering Projects to manage and implement data-driven communication systems Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations Integrate data across different systems and platforms Strong verbal and written communication skills to manage client discussions

Candidate Profile: Required skills: Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management and Delta Lake Storage. For this one, we need an experienced architect that is an expert in the whole of Microstrategy environments, and has lead an end-to-end implementation. 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud Based out of US Some experience in insurance domain/ data is must Programming Languages – SQL, Python Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL). o Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops Project Management using Agile, Scrum B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering. Excellent communication & leadership skills, with the ability to lead and motivate team members Ability to work independently with some level of ambiguity and juggle multiple demands



  • New York, NY, United States DataBricks Full time

    FEQ125R103Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark,...


  • New York, United States Harnham Full time

    Senior Data Architect Fully Remote6-Month Contract, possible extensions$95-$115/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their...

  • Databricks Engineer

    5 days ago


    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...

  • Databricks Engineer

    5 days ago


    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...

  • Databricks Certified

    2 weeks ago


    New York, United States New York Technology Partners Full time

    Title: Databricks Certified - Data Architect and Machine LearningLocation: Remote (working hours as per EST time zone)Position Type: Contract positionResponsibilities:Databricks Certified Machine Learning Professional is requiredPreferred to have current credentials or ability to obtain within first 60 days of employment5+ years of experience with a proven...

  • Databricks Certified

    2 weeks ago


    New York, United States New York Technology Partners Full time

    Title: Databricks Certified - Data Architect and Machine LearningLocation: Remote (working hours as per EST time zone)Position Type: Contract positionResponsibilities:Databricks Certified Machine Learning Professional is requiredPreferred to have current credentials or ability to obtain within first 60 days of employment5+ years of experience with a proven...


  • New York, United States Diverse Lynx Full time

    Title Sr. Data Architect Azure & Databricks Duration 12 Months Location New York / Weehawken, NJ (Day 1 onsite ) Mandatory Skills Databricks, Azure Datalake, PySpark, Java. No of Open Positions 1 Job Description : Minimum 12+ years of IT experience and at least 5+ years in cloud native data engineering solution design/architecture and...

  • Azure Cloud Architect

    4 weeks ago


    New York, New York, United States Donato technologies Full time

    Job Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications Hands-on experience with Azure Data & Analytics PaaS Services Azure Data Factory...

  • Azure Cloud Architect

    4 weeks ago


    New York City, United States Donato technologies Full time

    Job Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications ·Hands-on experience with Azure Data & Analytics PaaS Services Azure Data...

  • Data Modeler

    1 week ago


    New Brunswick, United States Inizio Partners Full time

    About the job Data Modeler & Architect We are seeking a skilled Data Modeler and Architect to join our team, dedicated to optimizing the data architecture for our esteemed pharmaceutical client. This role is ideal for someone who thrives in understanding complex data environments and is adept at designing data models that empower analytical and operational...

  • Product Manager

    4 weeks ago


    new york, United States Atechstar Full time

    Your responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...

  • Product Manager

    3 weeks ago


    New York, New York, United States Atechstar Full time

    Your responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...

  • Data Modeler

    3 weeks ago


    New Brunswick, United States Inizio Partners Corp Full time

    Job DescriptionJob DescriptionWe are seeking a skilled Data Modeler and Architect to join our team, dedicated to optimizing the data architecture for our esteemed pharmaceutical client. This role is ideal for someone who thrives in understanding complex data environments and is adept at designing data models that empower analytical and operational...

  • Technical Architect

    3 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics Full time

    Tiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...

  • BI Data Architect

    3 days ago


    New York, United States Simplebet Full time

    Our mission is to power the future of fan engagement.  Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We’re reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...

  • BI Data Architect

    1 week ago


    New York, New York, United States Simplebet Full time

    Our mission is to power the future of fan engagement. Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We're reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...


  • New York, United States IT America Inc Full time

    Job DescriptionJob DescriptionSENIOR Data Engineer Location: NYC, NYUS Citizens and GC Holders 3 days a. week onsite Pyspark expertise, Scala, Databricks and AWS are a must have.Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. Expert-level expertise in SQL, Python, Scala or similar; other...

  • Senior Consultant

    2 weeks ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...

  • Azure DataEngineer

    1 week ago


    New York, United States Diverse Lynx Full time

    Role: Azure Data Engineer Experience: 7+ years' Work Location: Remote ( Once in every month to Chicago, New York City, Northern New Jersey) ContractPassport number is Mandatory Imp Notes • Candidates must be local to Chicago, New York City, Northern New Jersey • Must be able to available for onsite at least once a month • ll interviews to be performed...


  • New York, United States C-Vision Inc. Full time

    Job DescriptionJob DescriptionKindly share your resume with ansari.t@c-visionit.com or apply via below button. SENIOR Expert Data Engineer US Citizens and GC Holders 3 days a. week onsite Pyspark expertise, Scala, Databricks and AWS are a must have.Top Skills' DetailsQualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and...