Senior Data Engineer
2 weeks ago
Company Overview: Welcome to the forefront of data-driven innovation Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us and be part of a dynamic team shaping the future of data engineering.
Position Overview: As a Senior Data Engineer, you'll play a critical role in designing, building, and maintaining our data infrastructure and pipelines. You'll work on challenging projects, from data ingestion and processing to data storage and retrieval, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team.
Requirements
Key Responsibilities:
- Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources.
- Data Modeling: Design and implement data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance.
- Data Warehousing: Design, build, and optimize data warehouses and data lakes to store and manage structured and unstructured data for analytics and reporting purposes.
- Data Integration: Integrate data from disparate sources and systems, ensuring data consistency, quality, and completeness throughout the data lifecycle.
- Data Governance: Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with regulatory requirements.
- Performance Optimization: Optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
- Monitoring and Alerting: Implement monitoring and alerting systems to track data pipeline performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
- Documentation: Document data infrastructure and pipelines, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver data solutions that meet business needs.
- Mentorship and Leadership: Mentor junior engineers, providing guidance, support, and technical leadership in data engineering best practices and technologies.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 5+ years of experience in data engineering, with a focus on designing, building, and maintaining data infrastructure and pipelines.
- Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering frameworks and tools such as Apache Spark, Apache Kafka, Apache Airflow, or similar.
- Strong understanding of data modeling concepts and techniques, with experience designing and implementing data models and schemas for relational and non-relational databases.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based data services such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
- Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
- Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
- Competitive salary: The industry standard salary for Senior Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of data-driven innovation.
Join Us: Ready to shape the future of data engineering? Apply now to join our team and be part of the data revolution
-
Senior Data Engineer
7 days ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
Senior Data Scientist
3 days ago
San Francisco, CA, United States Data Masked Full timeNeighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...
-
Senior Systems Engineer
4 weeks ago
San Francisco, United States VAST Data Full timeVAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...
-
Senior Data Engineer
4 weeks ago
San Francisco, United States UpRecruit Full timeJob DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...
-
Senior Data Engineer
2 months ago
San Francisco, United States Sephora Full timeAt Sephora we inspire our customers, empower our teams, and help them become the best versions of themselves. We create an environment where people are valued, and differences are celebrated. Every day, our teams across the world bring to life our purpose: to expand the way the world sees beauty by empowering the ExtraOrdinary in each of us. We are...
-
Senior Data Engineer
1 week ago
San Francisco, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionSenior Data Engineer 12 MonthsSFO, CA( Onsite)Need to be strong with object oriented programming languages Java, Scala, PythonNeed to have some frontend skills JavaScript or similar.Skill set Big Data: Scala, Databricks, Spark SQL, Spark Streaming ( Nice to Have ), Python ( Nice to Have ), PySpark ( Nice to Have )Cloud: Azure ,...
-
Senior Software Engineer, Data
5 days ago
San Francisco, United States Social Finance Ltd Full timeWho we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and...
-
Senior Data Warehouse Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...
-
Senior Data Systems Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...
-
Senior Data Systems Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...
-
Senior Data Systems Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....
-
Senior Cloud Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part...
-
Senior Cloud Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...
-
Senior Big Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...
-
Senior Software Engineer
5 days ago
San Francisco, United States StreetLight Data Full timeStreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...
-
Software Engineer
2 months ago
San Francisco, CA, United States Nova Credit Full timeFull Time] Senior Software Engineer (Data) at Nova Credit (United States) | BEAMSTART Jobs Senior Software Engineer (Data) Nova Credit United States Full Time Remote Work Stock Options At Nova Credit, our mission is to power a more fair and inclusive financial system for the world. If you have no credit, it can take years to build that up, even...
-
Senior Real-Time Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join...
-
Senior Engineer, Data Engineering
3 days ago
San Francisco, CA, United States Bayone Full timeSenior Engineer, Data Engineering Job ID: 240167 Location Name: FSC REMOTE SF/NY/DC -173(USA_0173) Address: FSC, Remote, CA 94105, United States (US) Job Type: Full Time Position Type: Regular Job Function: Information Technology Remote Eligible: Yes Company Overview: At Sephora we inspire our customers, empower our teams, and help them...
-
Senior Data Warehouse Engineer
2 weeks ago
San Francisco, United States TuneIn Full time**Senior Data Warehouse Engineer** San Francisco / Engineering Platform / Full-time Regular **Location: San Francisco, Los Angeles, New York, or Remote** At TuneIn, we are reinventing radio for a connected world, with live sports, up-to-the-minute news, curated music, millions of podcasts, and over 120,000 streaming radio stationsstreamed to tens of...
-
Senior Data Engineer
7 days ago
San Francisco, California, United States Gantri Full timeCompanyGantri is the world's first digital manufacturer for creative lighting. We help independent designers, studios, and influencers to develop original, sustainably made lighting designs and sell directly to consumers. We manufacture and fulfill all orders on-demand using 3D printing from innovative plant-based materials.Since launching in 2017, we've...
