Senior Big Data Engineer
4 weeks ago
Company Overview: Welcome to the forefront of data-driven innovation Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine learning, and business intelligence. Join us and be part of a dynamic team shaping the future of big data engineering.
Position Overview: As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines. You'll work on challenging projects, from data ingestion and processing to data storage and retrieval, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in big data technologies and a passion for building robust data systems, we want you on our team.
Requirements
Key Responsibilities:
- Big Data Infrastructure Design: Design, architect, and implement scalable and efficient big data infrastructure, including data lakes, data warehouses, and streaming data platforms, leveraging technologies such as Hadoop, Spark, Kafka, and more.
- Data Pipeline Development: Develop, deploy, and manage data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources, ensuring reliability, scalability, and performance.
- Data Modeling: Design and implement data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance in a distributed environment.
- Data Integration: Integrate data from disparate sources and systems, ensuring data consistency, quality, and completeness throughout the data lifecycle.
- Performance Optimization: Optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
- Monitoring and Alerting: Implement monitoring and alerting systems to track big data platform performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
- Security and Compliance: Implement security controls and data governance policies to ensure data security, privacy, and compliance with regulatory requirements.
- Documentation and Best Practices: Document big data infrastructure and pipelines, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver big data solutions that meet business needs.
- Mentorship and Leadership: Mentor junior engineers, providing guidance, support, and technical leadership in big data engineering best practices and technologies.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 5+ years of experience in big data engineering, with a focus on designing, building, and maintaining big data infrastructure and pipelines.
- Proficiency in programming languages such as Java, Scala, or Python, and experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, and more.
- Strong understanding of distributed systems and parallel processing, with experience designing and optimizing data pipelines for performance and scalability.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based big data services such as Amazon EMR, Azure HDInsight, or Google Dataproc.
- Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
- Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
- Competitive salary: The industry standard salary for Senior Big Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of big data innovation.
Join Us: Ready to shape the future of big data engineering? Apply now to join our team and be part of the data revolution
-
Big Data Engineer
4 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and...
-
Big Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and...
-
Lead Big Data Engineer
4 days ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join us and...
-
Senior Software Development Engineer
3 weeks ago
San Francisco, United States HireIO Inc Full timeTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience...
-
Senior Software Development Engineer
2 months ago
San Francisco, United States Hireio, Inc. Full timeJob DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the...
-
Senior Software Development Engineer
1 week ago
San Francisco, United States Hireio, Inc. Full timeJob DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the...
-
Big Data Engineer
3 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionUnleash the Power of Data We believe in the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us...
-
Big Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionUnleash the Power of Data We believe in the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us...
-
Senior Software Development Engineer
2 weeks ago
San Francisco, CA, United States HireIO Inc Full timeTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on...
-
Big Data Engineer
4 days ago
San Francisco, United States Diverse Lynx Full timeRole: Big Data Engineer Location: Remote Duration: Fulltime Technical/Functional Skills Bachelors degree in Computer Science Engineering or equivalent. Bigdata: 5-6 years of Hands-on experience in Hadoop / Spark (Scala or Python), Hbase, Hive, Sqoop. Knowledge on Database architectures of RDBMS & No-SQL. Good in writing optimized SQL queries which...
-
Big Data Engineer II
3 weeks ago
San Diego, United States SHEIN Technology LLC Full timePostion Title: Big Data Engineer II Reports to: Senior Manager, Big Data Location: San Diego, CA Job Status: Exempt, FT About SHEIN Technology SHEIN Technology is a U.S. technology company. Founded in 2012, SHEIN is a leading global online retailer with operations in Guangzhou, Los Angeles, and Singapore, along with other key markets. SHEIN reaches consumers...
-
Big Data Engineer II
3 weeks ago
San Diego, United States SHEIN Technology LLC Full timePostion Title: Big Data Engineer IIReports to: Senior Manager, Big DataLocation: San Diego, CAJob Status: Exempt, FTAbout SHEIN TechnologySHEIN Technology is a U.S. technology company. Founded in 2012, SHEIN is a leading global online retailer with operations in Guangzhou, Los Angeles, and Singapore, along with other key markets. SHEIN reaches consumers...
-
Big Data Engineer II
3 weeks ago
San Diego, United States SHEIN Technology LLC Full timePostion Title: Big Data Engineer IIReports to: Senior Manager, Big DataLocation: San Diego, CAJob Status: Exempt, FTAbout SHEIN TechnologySHEIN Technology is a U.S. technology company. Founded in 2012, SHEIN is a leading global online retailer with operations in Guangzhou, Los Angeles, and Singapore, along with other key markets. SHEIN reaches consumers...
-
Big Data Engineer II
1 week ago
San Diego, United States SHEIN Technology LLC Full timePostion Title: Big Data Engineer IIReports to: Senior Manager, Big DataLocation: San Diego, CAJob Status: Exempt, FTAbout SHEIN TechnologySHEIN Technology is a U.S. technology company. Founded in 2012, SHEIN is a leading global online retailer with operations in Guangzhou, Los Angeles, and Singapore, along with other key markets. SHEIN reaches consumers...
-
Big Data Engineer II
3 weeks ago
San Diego, United States SHEIN Technology LLC Full timePostion Title: Big Data Engineer IIReports to: Senior Manager, Big DataLocation: San Diego, CAJob Status: Exempt, FTAbout SHEIN TechnologySHEIN Technology is a U.S. technology company. Founded in 2012, SHEIN is a leading global online retailer with operations in Guangzhou, Los Angeles, and Singapore, along with other key markets. SHEIN reaches consumers...
-
Senior Data Engineer
4 days ago
San Francisco, United States UpRecruit Full timeJob Details: Title: Sr. Data Engineer Salary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role in...
-
Senior Data Engineer
3 weeks ago
San Francisco, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionSenior Data Engineer 12 MonthsSFO, CA( Onsite)Need to be strong with object oriented programming languages Java, Scala, PythonNeed to have some frontend skills JavaScript or similar.Skill set Big Data: Scala, Databricks, Spark SQL, Spark Streaming ( Nice to Have ), Python ( Nice to Have ), PySpark ( Nice to Have )Cloud: Azure ,...
-
Senior Data Engineer
1 month ago
San Francisco, United States UpRecruit Full timeJob DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...
-
Senior Data Engineer
1 week ago
San Francisco, United States UpRecruit Full timeJob DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...
-
Senior Data Engineer
3 weeks ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
