Sr. Staff Big Data Software Architect
3 weeks ago
Responsibilities:
Sr. Staff Big Data Software Architect to implement a highly scalable system to ingest and process Petabytes of data per day.
Hands-on design and development of streaming data pipeline and data management.
Implement and manage industry best practice tools and processes such as Data Lake, Iceberg, Spark ETL, Airflow, Kafka, MQTT, Timeseries Database, Trino, Kubernetes, Docker, CI/CD, DevOps
Contribute to the overall architecture, implementation, and ongoing maintenance of our codebase
Optimize the performance and scale our data ingestion and processing infrastructure to server ever-increasing volume.
Qualifications:
Bachelor or Master's degree in Software Engineering and/or Computer Science
15+ years of experience in the design and development of large-scale data platforms
Experienced in Spark development with PySpark or Scala
Experienced in Data Lake, Parquet, ORC, or Similar Technologies
Experienced in containerization, including Docker and Kubernetes
Experienced in Data streaming platforms such as Apache Kafka, and Spark Streaming
Expert in designing and implementing reliable, scalable, and performant distributed systems and data pipelines
Extensive programming and software engineering experience, especially in Scala, Python, and/or C++
Experience with running large-scale distributed computing infrastructure such as load balancing, Zookeeper, Microservice architecture
Experience with managing distributed databases like Elasticsearch, Cassandra
Great verbal and written communication skills.
#J-18808-Ljbffr
-
AWS Data Architect
1 week ago
Newark, United States Diverse Lynx Full timeJob ID: 289974 Job Title: Technical Architect Skill: AWS Data Architect Minimum Experience: 10 - 14 Years Location: Newark, NJ 07102 JD: AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier. Minimum 10 years of professional experience with Data Management technologies. 3+ years of AWS Athena, Redshift, Pyspark, NoSQL, and...
-
AWS Data Architect
2 days ago
Newark, United States Diverse Lynx Full timeJob ID: 289974 Job Title: Technical Architect Skill: AWS Data Architect Minimum Experience: 10 - 14 Years Location: Newark, NJ 07102 JD: AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier. Minimum 10 years of professional experience with Data Management technologies. 3+ years of AWS Athena, Redshift, Pyspark, NoSQL, and...
-
Sr. Engineer, Systems Integration
2 weeks ago
Newark, United States Dew Software Full timeDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...
-
Sr. Engineer, Systems Integration
1 week ago
Newark, United States Dew Software Full timeDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...
-
Sr. Engineer, Systems Integration
2 weeks ago
Newark, United States Dew Software Full timeJob DescriptionJob DescriptionDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer,...
-
Sr. Data Engineer
1 week ago
Newark, United States JSR Tech Consulting Full timeJob Description : 8p - Engineering lead to help the design/build of the CDO enterprise data platforms Design, Develop and Implement End-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Data intake/ request/ onboarding services and service documentation. Data ingestion services for batch/ real time data ingest and service...
-
Azure Data Architect
4 weeks ago
Newark, United States Phaxis Full timeFinancial Services firm is looking for an experienced Azure-focused Data Architect! This is a full-time, permanent position.This Azure Data Architect Should Have:- 10-15+ years' experience in data architecture, with at least 3+ years focused on Azure-based solutions, showing strong history of successful Azure implementations.- Proficiency in Azure services,...
-
Azure Data Architect
4 weeks ago
Newark, United States Phaxis Full timeFinancial Services firm is looking for an experienced Azure-focused Data Architect! This is a full-time, permanent position.This Azure Data Architect Should Have:- 10-15+ years' experience in data architecture, with at least 3+ years focused on Azure-based solutions, showing strong history of successful Azure implementations.- Proficiency in Azure services,...
-
Azure Data Architect
4 weeks ago
Newark, United States Phaxis Full timeFinancial Services firm is looking for an experienced Azure-focused Data Architect! This is a full-time, permanent position.This Azure Data Architect Should Have:- 10-15+ years' experience in data architecture, with at least 3+ years focused on Azure-based solutions, showing strong history of successful Azure implementations.- Proficiency in Azure services,...
-
Sr. Analyst Manufacturing Finance
3 days ago
Newark, United States Dew Software Full timeDew Software is seeking a highly skilled Sr. Analyst Manufacturing Finance to join our team. As a leading software and technology company, we value excellence and innovation in all aspects of our work. The Sr. Analyst Manufacturing Finance will play a crucial role in providing financial analysis and support to our manufacturing operations. This is an...
-
Sr. Analyst Manufacturing Finance
4 weeks ago
Newark, United States Dew Software Full timeJob DescriptionJob DescriptionDew Software is seeking a highly skilled Sr. Analyst Manufacturing Finance to join our team. As a leading software and technology company, we value excellence and innovation in all aspects of our work. The Sr. Analyst Manufacturing Finance will play a crucial role in providing financial analysis and support to our manufacturing...
-
Sr. Analyst Manufacturing Finance
2 weeks ago
Newark, United States Dew Software Full timeJob DescriptionJob DescriptionDew Software is seeking a highly skilled Sr. Analyst Manufacturing Finance to join our team. As a leading software and technology company, we value excellence and innovation in all aspects of our work. The Sr. Analyst Manufacturing Finance will play a crucial role in providing financial analysis and support to our manufacturing...
-
Senior Data Architect
1 week ago
Newark, United States 4 Staffing Corp Full timeAbout the job Senior Data Architect - VP Senior Data Architect (VP Level) - Financial Services Full-time, direct employment Hybrid onsite/remote - Newark, NJ No visa sponsorship or C2C at this time Job Description: Our client is seeking a highly skilled Senior Data Architect at the VP level with extensive experience in designing and implementing...
-
Big Data Engineer
1 week ago
Newark, United States JSR Tech Consulting Full timeResponsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code Ensure the best possible performance and quality of high scale web applications and services Design and build highly performant function-based API's Developing microservices using Node.js / python/Java Ensures all code has been unit tested...
-
Sr. Embedded Security Engineer
3 weeks ago
Newark, United States Dew Software Full timeJob DescriptionJob DescriptionDew Software, a trusted name in the digital transformation industry, is seeking a highly skilled Sr. Embedded Security Engineer to join their team. As an ISO-certified and CMMi Level 3 organization, Dew Software works closely with Fortune 500 companies to deliver cutting-edge solutions and drive their digital transformation...
-
Sr. Software Engineer
1 week ago
Newark, United States Zobility Full timeWe are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to demonstrate excellence in their...
-
Sr. Engineer, Systems Integration
3 weeks ago
City of Newark, California, United States Dew Software Full timeDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...
-
Sr. Software Engineer
2 days ago
Newark, United States Zobility Full timeWe are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to demonstrate excellence in their...
-
Azure Data Architect
3 weeks ago
Newark, United States Phaxis Full timeSalary is 190k to 215k3 days remote and 2 days onsiteMust Have Qualifications:- Financial Services.- Comprehensive experience spanning 15+ years in data architecture, with a specialized focus of 3+ years on Azure solutions.- Proficiency in Azure services, notably Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.- Strong...
-
Business Intelligence Architect
3 days ago
Newark, United States Georgia IT Inc Full timeBusiness Intelligence Architect Location: Newark, NJ - Hybrid Duration: 8 months Job description The Business Intelligence Architect will be responsible for providing access to the data via reports, data extracts, and analysis tools, the development of ETL components and for coding stored procedures. 15+ years of IT experience and 10+ years of experience...