Data Engineer

Responsibilities:Collaborate with stakeholders to understand data migration requirements, including scope, timelines, and specific data sets.Design and develop a comprehensive data migration plan, considering factors such as data volume, complexity, and business continuity.Utilize Komprise data management software to perform assessments, identify target...

Responsibilities Develop and operate data management tools monitoring data flows data quality data cleansing and data processing. Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes. Collaborate with different stakeholders to collect required data from internal and...

Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD

Who we are.Pachama is a mission-driven company looking to restore nature to help address climate change. Pachama brings the latest technology in remote sensing and AI to the world of forest carbon in order to enable forest conservation and restoration to scale. Pachama's core technology harnesses satellite imaging with artificial intelligence to measure...

CompanyArchipelo is building a code security platform that gives organizations the ability to verify the authenticity and provenance of code within their software development lifecycle. They are solving a painful problem that affects every software developer on the planet: ensuring software security, authenticity, integrity, and compliance - by providing the...

Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...

Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...

Who we areDomino Data Lab is a game-changer, providing a leading Enterprise AI platform trusted by more than 20% of the Fortune 100 companies. With Domino, businesses speed up data science work, foster collaboration, and uphold governance. Enterprises globally benefit from Domino's solutions, improving areas such as healthcare, agriculture, automotive...

Skills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)

Responsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance...

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

Job Description:We are seeking a Cloud Engineer for a very important client.Job Description:Principal Duties and Responsibilities: Applies Software knowledge to assist and support the design, development, creation, modification, and validation of embedded and cloud edge software, applications, and/or specialized utility programs. Analyzes user needs and...

Our major field office locations include Denver, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas, San Francisco.Juice - The "Stuff" it takes to be a Needle MoverWe look forward to the goal, mentallymapping outevery checkpoint on the pathway to success, and visualizing what the final destination looks and feels like.We're looking to add...

Teradata is looking for a dedicated engineering leader to lead the Data Platform Product Architecture Organization. This group is made up of senior product architects who provide architecture and design for the Teradata Data Platform engineering teams. This position is the key driver for execution innovation standardization user experience. This role will...

Software Engineer, Data OpsDepartment: EngineeringEmployment Type: Full TimeLocation: San Mateo, CADescriptionBigHat Biosciences is seeking an exceptional individual for the role of Software Engineer, Data Ops. This role is targeted at someone who is ready to dive deep into our computational engine and enhance its capabilities to meet the evolving demands of...

While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations.As a Data Infrastructure Engineer on the security data infrastructure team you will help build Lakehouse for Security organization. You will build reliable, large-scale, multi-geo data pipelines to support detecting threats(internal and...

Blockchain technology is powering a growing wave of innovation. Businesses and governments around the world are using blockchains to make banking more efficient, connect with their customers, and investigate criminal cases. As adoption of blockchain technology grows, more and more organizations seek access to all this ecosystem has to offer. That's where...

About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...

Responsibilities Ensure that pipelines meet both operations and security requirements. Design and implement innovations that improve software velocity infrastructure resiliency security and data availability. Work with Software and Engineering to ensure new pipelines are created in Parelle to code build. Work with Architecture on setting the path forward and...

About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...