Databricks Architect
3 weeks ago
Acunor is looking for Databricks Architect for one of its premier clients. it is fulltime and hybrid opportunity at NJ / OH. interested candidates are encouraged to apply with the most recent resume to saikumar.m@acunor.com
Position: Databricks Architect
Location: New Jersey / Dublin, OH (Hybrid)
Full Time position
Role & Responsibilities Overview:
Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
Continuously improve systems through performance enhancements and cost reductions in compute and storage
Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
Lead Data Engineering Projects to manage and implement data-driven communication systems
Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
Integrate data across different systems and platforms
Strong verbal and written communication skills to manage client discussions
Candidate Profile:
Required skills:
Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management and Delta Lake Storage.
For this one, we need an experienced architect that is an expert in the whole of Microstrategy environments, and has lead an end-to-end implementation.
8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
Based out of US
Some experience in insurance domain/ data is must
Programming Languages – SQL, Python
Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
o Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops
Project Management using Agile, Scrum
B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
Excellent communication & leadership skills, with the ability to lead and motivate team members
Ability to work independently with some level of ambiguity and juggle multiple demands
-
Sr. Solutions Architect
2 weeks ago
New York, NY, United States DataBricks Full timeFEQ125R103Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark,...
-
Senior Data Architect, Databricks Expert
1 week ago
New York, United States Harnham Full timeSenior Data Architect Fully Remote6-Month Contract, possible extensions$95-$115/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their...
-
Databricks Engineer
5 days ago
New York, United States EZDynamic, LLC Full timeNo Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...
-
Databricks Engineer
5 days ago
New York, United States EZDynamic, LLC Full timeNo Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...
-
Databricks Certified
2 weeks ago
New York, United States New York Technology Partners Full timeTitle: Databricks Certified - Data Architect and Machine LearningLocation: Remote (working hours as per EST time zone)Position Type: Contract positionResponsibilities:Databricks Certified Machine Learning Professional is requiredPreferred to have current credentials or ability to obtain within first 60 days of employment5+ years of experience with a proven...
-
Databricks Certified
2 weeks ago
New York, United States New York Technology Partners Full timeTitle: Databricks Certified - Data Architect and Machine LearningLocation: Remote (working hours as per EST time zone)Position Type: Contract positionResponsibilities:Databricks Certified Machine Learning Professional is requiredPreferred to have current credentials or ability to obtain within first 60 days of employment5+ years of experience with a proven...
-
Sr. Data Architect Azure
1 week ago
New York, United States Diverse Lynx Full timeTitle Sr. Data Architect Azure & Databricks Duration 12 Months Location New York / Weehawken, NJ (Day 1 onsite ) Mandatory Skills Databricks, Azure Datalake, PySpark, Java. No of Open Positions 1 Job Description : Minimum 12+ years of IT experience and at least 5+ years in cloud native data engineering solution design/architecture and...
-
Azure Cloud Architect
4 weeks ago
New York, New York, United States Donato technologies Full timeJob Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications Hands-on experience with Azure Data & Analytics PaaS Services Azure Data Factory...
-
Azure Cloud Architect
4 weeks ago
New York City, United States Donato technologies Full timeJob Title Azure Cloud Architect Work location New York City NY(Due to Covid we are ok with candidates working from remote locations; they will be expected to relocate to New York City once the travel restrictions are removed.) Client PacteraEDGE/Kraft Heinz Job Qualifications ·Hands-on experience with Azure Data & Analytics PaaS Services Azure Data...
-
Data Modeler
1 week ago
New Brunswick, United States Inizio Partners Full timeAbout the job Data Modeler & Architect We are seeking a skilled Data Modeler and Architect to join our team, dedicated to optimizing the data architecture for our esteemed pharmaceutical client. This role is ideal for someone who thrives in understanding complex data environments and is adept at designing data models that empower analytical and operational...
-
Product Manager
4 weeks ago
new york, United States Atechstar Full timeYour responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...
-
Product Manager
3 weeks ago
New York, New York, United States Atechstar Full timeYour responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...
-
Data Modeler
3 weeks ago
New Brunswick, United States Inizio Partners Corp Full timeJob DescriptionJob DescriptionWe are seeking a skilled Data Modeler and Architect to join our team, dedicated to optimizing the data architecture for our esteemed pharmaceutical client. This role is ideal for someone who thrives in understanding complex data environments and is adept at designing data models that empower analytical and operational...
-
Technical Architect
3 weeks ago
Jersey City, New Jersey, United States Tiger Analytics Full timeTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and leadership has been recognized by various market research firms, including...
-
BI Data Architect
3 days ago
New York, United States Simplebet Full timeOur mission is to power the future of fan engagement. Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We’re reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...
-
BI Data Architect
1 week ago
New York, New York, United States Simplebet Full timeOur mission is to power the future of fan engagement. Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We're reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...
-
Senior Data Engineer
4 days ago
New York, United States IT America Inc Full timeJob DescriptionJob DescriptionSENIOR Data Engineer Location: NYC, NYUS Citizens and GC Holders 3 days a. week onsite Pyspark expertise, Scala, Databricks and AWS are a must have.Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. Expert-level expertise in SQL, Python, Scala or similar; other...
-
Senior Consultant
2 weeks ago
New York, United States CTI DATA Full timeWe are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...
-
Azure DataEngineer
1 week ago
New York, United States Diverse Lynx Full timeRole: Azure Data Engineer Experience: 7+ years' Work Location: Remote ( Once in every month to Chicago, New York City, Northern New Jersey) ContractPassport number is Mandatory Imp Notes • Candidates must be local to Chicago, New York City, Northern New Jersey • Must be able to available for onsite at least once a month • ll interviews to be performed...
-
Expert Data Engineer
4 days ago
New York, United States C-Vision Inc. Full timeJob DescriptionJob DescriptionKindly share your resume with ansari.t@c-visionit.com or apply via below button. SENIOR Expert Data Engineer US Citizens and GC Holders 3 days a. week onsite Pyspark expertise, Scala, Databricks and AWS are a must have.Top Skills' DetailsQualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and...