Sr. Staff Big Data Software Architect

4 weeks ago

Newark CA, United States Lucid Motors Full time

Leading the future in luxury electric and mobilityAt Lucid, we set out to introduce the most captivating, luxury electric vehicles that elevate the human experience and transcend the perceived limitations of space, performance, and intelligence. Vehicles that are intuitive, liberating, and designed for the future of mobility.We plan to lead in this new era of luxury electric by returning to the fundamentals of great design – where every decision we make is in service of the individual and environment. Because when you are no longer bound by convention, you are free to define your own experience.Come work alongside some of the most accomplished minds in the industry. Beyond providing competitive salaries, we’re providing a community for innovators who want to make an immediate and significant impact. If you are driven to create a better, more sustainable future, then this is the right place for you.Responsibilities:Sr. Staff Big Data Software Architect to implement a highly scalable system to ingest and process Petabytes of data per day.  Hands-on design and development of streaming data pipeline and data management.  Implement and manage industry best practice tools and processes such as Data Lake, Iceberg, Spark ETL, Airflow, Kafka, MQTT, Timeseries Database, Trino, Kubernetes, Docker, CI/CD, DevOpsContribute to the overall architecture, implementation, and ongoing maintenance of our codebaseOptimize the performance and scale our data ingestion and processing infrastructure to server ever-increasing volume.Qualifications:Bachelor or Master's degree in Software Engineering and/or Computer Science 15+ years of experience in the design and development of large-scale data platforms Experienced in Spark development with PySpark or Scala Experienced in Data Lake, Parquet, ORC, or Similar TechnologiesExperienced in containerization, including Docker and Kubernetes Experienced in Data streaming platforms such as Apache Kafka, and Spark StreamingExpert in designing and implementing reliable, scalable, and performant distributed systems and data pipelines Extensive programming and software engineering  experience, especially in Scala, Python, and/or C++ Experience with running large-scale distributed computing infrastructure such as load balancing, Zookeeper, Microservice architecture    Experience with managing distributed databases like Elasticsearch, Cassandra  Great verbal and written communication skills.  Salary Range: The compensation range for this position is specific to the locations listed below and is the range Lucid reasonably and in good faith expects to pay for the position taking into account the wide variety of factors that are considered in making compensation decisions, including job-related knowledge; skillset; experience, education and training; certifications; and other relevant business and organizational factors.Additional Compensation and Benefits: Lucid offers a wide range of competitive benefits, including medical, dental, vision, life insurance, disability insurance, vacation, and 401k. The successful candidate may also be eligible to participate in Lucid’s equity program and/or a discretionary annual incentive program, subject to the rules governing such programs.  (Cash or equity incentive awards, if any, will depend on various factors, including, without limitation, individual and company performance.)Base Pay Range (Annual)$195,500—$286,770 USDBy Submitting your application, you understand and agree that your personal data will be processed in accordance with our Candidate Privacy Notice. If you are a California resident, please refer to our California Candidate Privacy Notice.To all recruitment agencies: Lucid Motors does not accept agency resumes. Please do not forward resumes to our careers alias or other Lucid Motors employees. Lucid Motors is not responsible for any fees related to unsolicited resumes. 

  • Senior Software Development Engineer

    2 weeks ago

    San Francisco, CA, United States HireIO Inc Full time

    Team IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on...

  • Big Data ArchitectFulltime

    1 month ago

    San Francisco, CA, United States Sonsoft Full time

    Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionAt least 5 years of experience in technology consulting,...

  • Big Data Architect.Fulltime

    1 month ago

    San Francisco, CA, United States Sonsoft Full time

    Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionPreferred• At least 5 years of experience in technology...

  • Big Data Software Engineering

    2 weeks ago

    San Francisco, CA, United States Equilibrium Energy Full time

    Equilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the end-to-end power value...

  • Software Architect

    2 weeks ago

    Redwood City, CA, United States NextPit GmbH Full time

    Architect / Snr. Director of Development Product Development (Database) Do you want to redefine the way Data Infrastructure Platforms are built for the Cloud? Do you find the idea of developing hyperscale distributed Exadata Cloud Service for Public cloud exciting? Oracle’s premier Database Cloud offering Exadata Cloud Services can provide you the unique...

  • Sr Software Engineer: Scala + REST API

    2 weeks ago

    San Francisco, CA, United States Stride Health Full time

    ## Sr Software Engineer: Scala + REST API* San Francisco, CA* Stride Health seeks a Sr. Software Engineer to help shape its bright, bright future! You're a seasoned technologist with nimble fingers and a love of resilient, well-architected systems. We're a high-energy, forward-thinking team that's empowering consumers to make decisions about...

  • AWS Data Architect

    4 weeks ago

    Newark, United States Diverse Lynx Full time

    Job ID: 289974 Job Title: Technical Architect Skill: AWS Data Architect Minimum Experience: 10 - 14 Years Location: Newark, NJ 07102 JD: AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier. Minimum 10 years of professional experience with Data Management technologies. 3+ years of AWS Athena, Redshift, Pyspark, NoSQL, and...

  • AWS Data Architect

    4 days ago

    Newark, United States Diverse Lynx Full time

    Job ID: 289974 Job Title: Technical Architect Skill: AWS Data Architect Minimum Experience: 10 - 14 Years Location: Newark, NJ 07102 JD: AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier. Minimum 10 years of professional experience with Data Management technologies. 3+ years of AWS Athena, Redshift, Pyspark, NoSQL, and...

  • Sr. Data Engineer

    1 week ago

    Newark, United States Summit Tech Partners Full time

    Job Description : 8p - Engineering lead to help the design/build of the CDO enterprise data platforms Design, Develop and Implement End-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Data intake/ request/ onboarding services and service documentation. Data ingestion services for batch/ real time data ingest and service...

  • Staff Software Engineer

    2 weeks ago

    San Francisco, CA, United States Activision Full time

    Craft: Embrace the pivotal role of a Staff Software Engineer within our Data Platforms team, where your expertise will become the backbone of our cutting-edge analytics and data processing capabilities. In this role, you will architect and manage dynamic data solutions, ensuring a robust infrastructure that supports our strategic initiatives. Your work...

  • Sr. Engineer, Systems Integration

    1 month ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    1 month ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    1 week ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    1 week ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    1 month ago

    Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer,...

  • Sr. Engineer, Systems Integration

    1 week ago

    Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer,...

  • Data Architect

    2 days ago

    Newark, United States Spectraforce Technologies Full time

    Job Title: Data ArchitectLocation: Newark, NJ (Hybrid)Duration: 6+ Months (Temp to Hire) Data Architect - Job Description The Global Technology organization has a heavy focus on Technology & Data and is seeking a Senior level Data Architect to engage in and lead some very exciting work. Reporting to the Lead Solution Architect, this role will engage in the...

  • Data Architect

    2 weeks ago

    San Francisco, CA, United States Floodwave Full time

    floodwave ( is a Germany-based social media analytics company with a focus on Pinterest, the world's fastest growing website. The company is backed by well-reputed international investors and will launch very soon. The product is a state-of-the-art social media dashboard that helps enterprises understand and monitor brand conversations as well as guide their...

  • Software Engineer

    2 weeks ago

    San Francisco, CA, United States Karkidi Full time

    You’ll help in executing the roadmap for data infrastructure and systems to power the world’s first AI recruiter built by Moonhub. You'll play a pivotal role in the development of tools and infrastructure that democratize data access and enable core capabilities across the organization You’ll architect offline and online data pipelines to...

  • Senior Software Engineering, Data Platform

    2 weeks ago

    San Francisco, CA, United States HireIO Inc Full time

    Team IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on...