Lead/Senior Data Engineer

1 month ago

Mountain View, California, United States VentureDive Full time

Job Brief:
We're looking for a Senior Data Engineer to join our team, where you'll be instrumental in developing and managing data workflows that support large-scale analytics and business intelligence. Your responsibilities will include designing and optimizing ETL processes, ensuring data quality, and maintaining robust data infrastructure.
The ideal candidate will possess a robust computer science background, advanced proficiency in Python, and hands-on experience with cloud services, SQL/NoSQL databases, and containerization tools like Docker and Kubernetes.
You'll collaborate closely with engineering and product teams to drive innovation and generate valuable insights.
VentureDive Overview:
Founded in 2012 by veteran technology entrepreneurs from MIT and Stanford, VentureDive is the fastest growing technology company in the region that develops and invests in products and solutions that simplify and improve the lives of people world-wide. We aspire to create a technology organization and an entrepreneurial ecosystem in the region that is recognized as second to none in the world.
Key Responsibilities:
Design and Develop Data Pipelines:

  1. Architect, develop, and maintain scalable and efficient data pipelines to process large volumes of data from diverse sources.
  2. Implement ETL processes to integrate data from various internal and external sources into the data warehouse.

Data Modeling and Architecture:

  1. Design and optimize data models to support analytics and business intelligence initiatives.
  2. Ensure data quality and integrity across the data lifecycle.

Collaboration and Leadership:

  1. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
  2. Mentor and provide guidance to junior data engineers, fostering a culture of continuous learning and improvement.

Performance Optimization:

  1. Monitor and improve the performance of data systems, identifying and resolving bottlenecks.
  2. Implement best practices for data governance, security, and compliance.

Technology Evaluation and Implementation:

  1. Stay current with emerging technologies and industry trends, evaluating and recommending new tools and technologies to enhance our data capabilities.
  2. Lead the implementation and integration of new data technologies and frameworks.

Qualification Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or and related field.
  • 5+ years of experience in data engineering, with a proven track record in designing and implementing large-scale data solutions.
  • Experience with cloud data platforms such as AWS, Azure, or Google Cloud.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong experience with SQL and NoSQL databases.
  • Expertise in ETL tools and frameworks (e.g., Apache Spark, Apache Kafka, Talend).
  • Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team in a fast-paced environment.
Technical Skills:
  • Proficiency in programming languages such as Python, Java, or Scala.
    • Strong experience with SQL and NoSQL databases.
  • Expertise in ETL tools and frameworks (e.g., Apache Spark, Apache Kafka, Talend).
  • Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
  • Mandatory expertise in the following Azure services:
  • Azure Active Directory
  • Azure App Service
  • Azure Blob Storage
  • Azure Application Insights
  • Azure Key Vault
  • Azure Cosmos DB
  • Azure Data Factory
  • Azure Open AI
  • Azure Functions

Soft Skills:

• Excellent problem-solving and analytical skills.

• Strong communication and collaboration skills.

Preferred Qualifications:

  1. Experience with big data technologies (e.g., Hadoop, Hive, Presto).
  2. Experience in developing data pipelines utilizing tools such as Fluentd, Fluent Bit, Vector, and Logstash.
  3. Knowledge of data visualization tools (e.g., Tableau, Power BI).
  4. Certifications in relevant technologies or methodologies.

In order to thrive at VentureDive, you
intellectually smart and curious
the passion for and take pride in your work
believe in VentureDive's mission, vision, and values
a no-frills attitude
a collaborative team player
ethical and honest
Are you ready to put your ideas into products and solutions that will be used by millions?
You will find VentureDive to be a quick pace, high standards, fun and a rewarding place to work at. Not only will your work reach millions of users worldwide, you will also be rewarded with competitive salaries and benefits. If you think you have what it takes to be a VenDian, come join us ... we're having a ball

  • Lead Data Engineer

    1 month ago

    Mountain View, California, United States Samsung Full time

    Lead Data Engineer - Samsung Adsremote typeHybridlocations645 Clyde Avenue, Mountain View, CA, USAtime typeFull timejob requisition idR85404Position SummaryRole and ResponsibilitiesSamsung Ads is a leading innovator in advertising technology, dedicated to providing cutting-edge solutions that optimize ad performance and deliver exceptional results for our...

  • Lead Software Engineer in Robotics

    1 week ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is dedicated to enhancing the quality of life for our residents through innovative technology solutions. Our mission is to create a safe and engaging environment that fosters independence and well-being. As we continue to advance our technological capabilities, we are seeking a talented individual to join our team in a hybrid...

  • Lead Software Engineer in Robotics

    3 days ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is dedicated to enhancing the quality of life for our residents through innovative technology solutions. Our mission is to create a safe and enjoyable environment, leveraging cutting-edge robotics to improve daily living experiences.Key ResponsibilitiesCollaborate with a talented team to ensure the seamless operation of our...

  • Lead Software Engineer in Robotics

    1 week ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is at the forefront of enhancing the quality of life through innovative technology solutions. Our mission is to create a safe and enriching environment for our residents by leveraging advanced robotics. We are seeking a talented individual to join our team in a pivotal role within our Robotics Engineering division.Your...

  • Lead Software Engineer in Robotics

    4 days ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is dedicated to enhancing the quality of life for our residents through innovative technology solutions. Our mission is to create a safe and engaging environment that promotes independence and well-being. As we continue to advance our technological capabilities, we are seeking a talented individual to join our team in a pivotal...

  • Lead Software Engineer in Robotics

    3 days ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is at the forefront of innovation in autonomous technology, striving to enhance the quality of life for our residents through advanced solutions. Our commitment is to create a safe and efficient environment that empowers mobility and independence.Your RoleCollaborate with a talented team to ensure our systems operate safely and...

  • Lead Software Engineer in Robotics

    1 week ago

    Mountain View, California, United States Willows Landing Senior Living Full time

    Willows Landing Senior Living is dedicated to enhancing the quality of life for our residents through innovative technology solutions. Our mission is to provide a safe and engaging environment, utilizing advanced robotics to support our community. We are seeking a talented individual to join our Planner Technology team in a hybrid role.Your...

  • Senior Camera Module Design Lead

    4 days ago

    Mountain View, California, United States Google Full time

    Senior Camera Module Design LeadAt Google, we're seeking a highly skilled Senior Camera Module Design Lead to join our team of innovators and contribute to the development of cutting-edge camera solutions for our direct-to-consumer products.About the RoleAs a Senior Camera Module Design Lead, you will be responsible for leading the design, development, and...

  • Distinguished Data Engineer

    1 month ago

    Mountain View, California, United States Intuit Full time

    Intuit is looking for a Distinguished Data Engineer who will be responsible for Mailchimp's data technology strategy, architecture and our approach to leverage data to drive growth for the business. As a Distinguished Engineer, you will play a critical role in shaping the future of Intuit Mailchimp by providing architectural and thought leadership across...

  • Data Engineer

    2 months ago

    Mountain View, California, United States Otter Full time

    This position is based in Mountain View, CAThe OpportunityWe are searching for a talented Data Engineer to play a pivotal role in transforming business and engineering requirements into intuitive data models. You'll be responsible for architecting, building, and ensuring the integrity of robust data pipelines. Your collaboration with cross-functional teams...

  • Lead Software Engineer

    1 day ago

    Mountain View, California, United States Walmart Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Technical Architect to lead our software engineering team in designing and implementing cutting-edge solutions for our e-commerce platform. As a key member of our technology team, you will be responsible for architecting and implementing scalable, secure, and high-performance software...

  • Lead Android Software Engineer

    1 week ago

    Mountain View, California, United States Abidi Solutions Full time

    Job OverviewPosition: Senior Software Engineer - Mobile AndroidCompany: Abidi SolutionsLocation: HybridContract Type: C2CVisa: USC GC GC EAD H4 EADCompany ProfileAbidi Solutions is at the cutting edge of automotive technology, specializing in the development of innovative Software-Defined Vehicle (SDV) solutions. Our focus is on enhancing the future of...

  • Senior Software Technical Program Manager, Data Platform Lead

    1 day ago

    Mountain View, California, United States Nuro Full time

    About the RoleWe are seeking a highly skilled Technical Program Manager to lead our Data Platform team at Nuro. As a key member of our engineering organization, you will be responsible for driving the development and implementation of our data management systems, ensuring seamless data flow across our autonomous vehicle platform.Key ResponsibilitiesProgram...

  • Lead AI Automation Engineer

    1 week ago

    Mountain View, California, United States Orby AI Full time

    Orby AI is at the forefront of developing an innovative Automation AI platform designed to streamline repetitive tasks. Our platform offers a distinctive "observe, learn, and automate" experience, leveraging an actions-based foundation model. Orby AI observes user activities, identifies repetitive workflows, and generates actionable suggestions to automate...

  • Lead Cloud Solutions Engineer

    4 days ago

    Mountain View, California, United States PredictSpring Full time

    Senior Staff Engineer - DevOpsWe are seeking a Senior Staff Engineer to become a vital member of our DevOps division. In this capacity, you will play a key role in developing and maintaining applications and infrastructure that empower teams to configure, deploy, operate, and monitor essential services for our PredictSpring Cloud platform, which supports...

  • Senior Facilities Engineer

    1 week ago

    Mountain View, California, United States ABM Industries Full time

    Job Overview The Senior Facilities Engineer will be responsible for supervising the on-site engineering team and providing essential support for the facility. This role includes managing Monthly, Quarterly & Annual Preventive Maintenance schedules, daily task assignments, and ensuring compliance with all applicable regulations. The Senior Engineer will...

  • Senior Data Analyst

    2 months ago

    Mountain View, California, United States Aurora Full time

    Who We AreAurora (Nasdaq: AUR) is delivering the benefits of self-driving technology safely, quickly, and broadly to make transportation safer, increasingly accessible, and more reliable and efficient than ever before. The Aurora Driver is a self-driving system designed to operate multiple vehicle types, from freight-hauling semi-trucks to ride-hailing...

  • Senior Staff Data Scientist, Search Optimization

    14 hours ago

    Mountain View, California, United States Coupang Full time

    About CoupangCoupang is a leading e-commerce company that is revolutionizing the way people shop, eat, and live. Our mission is to build the future of commerce by empowering customers with data-driven insights and innovative solutions.We are a team of bold and ambitious individuals who are passionate about making a hands-on impact. Our culture is a perfect...

  • Senior Facilities Engineer

    4 days ago

    Mountain View, California, United States ABM Industries Full time

    Job Overview The Senior Facilities Engineer will supervise the on-site engineering team and provide essential support for facility operations. This role involves delegating Monthly, Quarterly & Annual Preventive Maintenance tasks, daily work assignments, and ensuring compliance with all applicable regulations. The Senior Engineer will perform both Certified...

  • Lead Android Software Engineer

    1 week ago

    Mountain View, California, United States Abidi Solutions Full time

    Job OverviewPosition: Senior Software Engineer - Mobile AndroidCompany Overview: Abidi Solutions is at the cutting edge of automotive technology, specializing in innovative Software-Defined-Vehicle (SDV) solutions. As a pivotal member of our advanced technical team, you will be instrumental in shaping the architecture and design of transformative systems...