Big Data Engineer
4 weeks ago
Company Overview: Welcome to the forefront of big data innovation At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and be part of a dynamic team committed to shaping the future of big data engineering.
Position Overview: As a Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and platforms. Working closely with cross-functional teams of data scientists, analysts, and software engineers, you'll ensure the reliability, scalability, and efficiency of our big data pipelines and systems. If you're passionate about big data engineering and eager to drive innovation through scalable data solutions, we want you on our team.
Requirements
Key Responsibilities:
- Big Data Infrastructure Design: Design and architect scalable and reliable big data infrastructure and platforms, including data lakes, data warehouses, and streaming data pipelines.
- Data Ingestion and Processing: Develop and maintain data ingestion pipelines to collect and process large volumes of data from diverse sources, ensuring data quality and integrity.
- Data Storage and Management: Implement and manage big data storage solutions, including distributed file systems (e.g., HDFS), NoSQL databases (e.g., Cassandra, MongoDB), and cloud storage services (e.g., Amazon S3, Google Cloud Storage).
- Data Transformation and ETL: Design and implement data transformation and ETL (Extract, Transform, Load) processes to standardize, cleanse, and enrich data for analysis and modeling.
- Data Querying and Analysis: Develop and optimize data querying and analysis tools and frameworks, enabling data scientists and analysts to extract insights from large datasets.
- Data Governance and Security: Implement data governance policies and security controls to ensure compliance with regulatory requirements and protect sensitive data.
- Monitoring and Optimization: Monitor big data pipelines and systems for performance, reliability, and efficiency, proactively identifying and addressing issues to minimize downtime and optimize resource utilization.
- Documentation and Collaboration: Document big data infrastructure and processes, including architecture diagrams, data lineage, and workflow documentation, and collaborate with cross-functional teams to ensure alignment and transparency.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, or related field.
- Strong background in big data engineering, with hands-on experience in designing, building, and maintaining big data infrastructure and platforms.
- Proficiency in programming languages such as Java, Python, or Scala, and experience with big data processing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink.
- Experience with distributed computing technologies and concepts, including MapReduce, Spark RDDs, and streaming data processing.
- Familiarity with big data storage solutions and databases, including HDFS, Cassandra, MongoDB, Amazon S3, and Google Cloud Storage.
- Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
- Competitive salary: The industry standard salary for Big Data Engineers typically ranges from $150,000 to $230,000 per year, depending on experience and qualifications. Exceptional candidates may be eligible for higher compensation packages.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with team-building activities and social events.
- Opportunities for career growth and advancement within the company.
- Exciting projects with real-world impact across diverse industries.
- Chance to work alongside top talent and industry experts in the field of big data engineering.
Join Us: Ready to shape the future of big data engineering? Apply now to join our team and be part of an exciting journey of innovation and discovery
-
Big Data Engineer
3 months ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and...
-
Senior Big Data Engineer
4 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...
-
Senior Big Data Engineer
3 months ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...
-
Big Data Engineer
4 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionUnleash the Power of Data We believe in the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us...
-
Big Data Engineer
3 months ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionUnleash the Power of Data We believe in the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us...
-
Big Data Developer
2 weeks ago
San Francisco, United States Varite Full timeJob Title: Big Data Engineer Location: Preferred SF Bay area candidate. Duration: 6-12 months Comments/Special Instructions: Looking for someone strong in communication, troubleshooting and interested in customer support. Background in big data platform operations would be desirable. Job Description: The ***Bank is looking for a Big Data Engineer to...
-
Senior Software Development Engineer
4 weeks ago
San Francisco, United States Hireio, Inc. Full timeJob DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the...
-
Senior Software Development Engineer
3 months ago
San Francisco, United States Hireio, Inc. Full timeJob DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the...
-
Big Data Architect
4 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionShape the Future of DataWe're not just collecting data; we're crafting the blueprint for tomorrow's innovations. As a Big Data Architect, you'll spearhead our efforts to design and construct the infrastructure that underpins our cutting-edge data solutions. Your vision will pave the way for breakthroughs that...
-
Big Data Architect
1 month ago
San Francisco, United States Unreal Gigs Full timeShape the Future of Data We're not just collecting data; we're crafting the blueprint for tomorrow's innovations. As a Big Data Architect, you'll spearhead our efforts to design and construct the infrastructure that underpins our cutting-edge data solutions. Your vision will pave the way for breakthroughs that leverage colossal data sets to solve real-world...
-
Big Data Architect
3 months ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionShape the Future of DataWe're not just collecting data; we're crafting the blueprint for tomorrow's innovations. As a Big Data Architect, you'll spearhead our efforts to design and construct the infrastructure that underpins our cutting-edge data solutions. Your vision will pave the way for breakthroughs that...
-
Big Data Developer
1 day ago
San Francisco, California, United States Sigmaways Inc Full timeAbout Sigmaways Inc.Sigmaways Inc. is a leading provider of innovative data solutions, and we're seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Design and Develop Data Solutions: Utilize open-source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.) to create end-to-end data...
-
Big Data Developer
1 month ago
San Francisco, United States Sigmaways Inc Full timeIn this role, you can contribute to several high-quality data solutions and enhance your technical skills across many disciplines.Key ResponsibilitiesDesign, develop, and maintain end-to-end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.)Contribute to multiple data solutions...
-
Big Data Developer
1 month ago
San Francisco, United States Sigmaways Inc Full timeIn this role, you can contribute to several high-quality data solutions and enhance your technical skills across many disciplines.Key ResponsibilitiesDesign, develop, and maintain end-to-end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.)Contribute to multiple data solutions...
-
Big Data Developer Advanced
2 weeks ago
San Francisco, United States JobRialto Full timeDescription Client is looking for a Big Data Engineer to join the Advanced Data and Analytics Capabilities Team. We are a team based out of San Francisco that partners with business lines across the Client to deliver big data and advanced analytics products and solutions. In this role, you will have the opportunity to contribute to several high-quality...
-
Big Data Engineer
2 months ago
San Jose, United States Apollose Full timeResponsibilities Design develop and implement scalable data pipelines and ETL processes using Java Python and Spark. Collaborate with data scientists analysts and other stakeholders to understand data requirements and design efficient solutions. Perform data exploration data cleaning and data transformation tasks to prepare data for analysis and...
-
Big Data Developer
9 hours ago
San Francisco, United States Sigmaways Inc Full timeWe are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...
-
Big Data Developer
1 day ago
San Francisco, United States Sigmaways Inc Full timeWe are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...
-
Engineering Manager, Big Data Platform
3 months ago
San Francisco, United States BHO Tech Full timeOur Data Platform team builds our core data infrastructure including transactional data (OLTP), metric data (OLAP) and the related ETL pipelines. In this position you will guide the technical development of the platform, lead the development roadmap and grow the team members. We value focus, ownership, collaboration, flexibility, transparency and honest...
-
Senior Data Engineer
2 months ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
