Data Migration Engineer

2 weeks ago


San Diego, California, United States MetroSys Full time

Responsibilities:

  • Collaborate with stakeholders to understand data migration requirements, including scope, timelines, and specific data sets.
  • Design and develop a comprehensive data migration plan, considering factors such as data volume, complexity, and business continuity.
  • Utilize Komprise data management software to perform assessments, identify target data, and orchestrate the migration process.
  • Configure and optimize Komprise settings to align with migration goals, ensuring efficient and secure data transfer.
  • Conduct pre-migration validation tests to ensure data integrity and accuracy before the actual migration process.
  • Monitor the data migration process in real-time, addressing any issues or discrepancies as they arise.
  • Implement data validation and reconciliation procedures to verify the successful completion of the migration.
  • Collaborate with cross-functional teams, including storage administrators and system engineers, to ensure seamless integration with the NetApp environment.
  • Document the entire migration process, including configurations, settings, and any custom scripts or workflows used.
  • Provide knowledge transfer and training to internal teams for ongoing management and maintenance of the migrated data.

Requirements:

  • Bachelor's degree in Information Technology, Computer Science, or a related field (preferred) or equivalent work experience.
  • Proven work experience as a Data Migration Engineer with specific expertise in migrating data from Isilon to NetApp using Komprise.
  • Strong proficiency in Komprise data management software and related tools.
  • In-depth knowledge of Isilon and NetApp storage platforms, including file systems, protocols, and administration.
  • Experience with scripting languages (e.g., Python, PowerShell) for automation and customization of migration processes.
  • Excellent problem-solving and analytical skills, with the ability to diagnose and resolve complex data migration issues.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders.


  • San Francisco, California, United States PingCAP Ltd Full time

    Join us as we expand our market presence in North America and Europe by leveraging our existing success worldwide. The database market is expected to double in size over the next few years, with IDC estimating it to be $119B+ by 2025. PingCAP is positioned as a global player, disrupting the industry with its TiDB Database and Database as a Service offerings....

  • Data Engineer

    2 weeks ago


    San Diego, California, United States MSIT Full time

    Responsibilities Develop and operate data management tools monitoring data flows data quality data cleansing and data processing. Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes. Collaborate with different stakeholders to collect required data from internal and...


  • San Jose, California, United States GDH Full time

    GDH Consulting is looking for a Collaboration Engineer to work remotely.Job DescriptionAs a Consulting Engineer, you will be gathering requirements and performing analysis of data to prepare for and execute complex changes within the customer's environment. Thinking through the process and procedures with a critical eye and attention to detail is a must....


  • San Jose, California, United States QData Full time

    Responsibilities Working with GCP team for various GCP Cloud programs including Certifications Partner engineering Marketplace and other Cloud platform solutions. Educating GCP / ISVs customers on best practices Stakeholders management / Communication Google ISVs Project Teams Program Management and ExecutionManaging the teams on different projects Reporting...

  • Data Engineer

    4 weeks ago


    San Francisco, California, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD


  • San Jose, California, United States QData Full time

    Responsibilities Working with the GCP team for various GCP Cloud programs including Certifications Partner engineering Marketplace and other Cloud platform solutions. Educating GCP / ISVs customers on best practices Stakeholders management / Communication Google ISVs Project Teams Program Management and Execution Managing the teams on different projects...

  • Staff Data Engineer

    2 weeks ago


    San Francisco, California, United States Pachama Full time

    Who we are.Pachama is a mission-driven company looking to restore nature to help address climate change. Pachama brings the latest technology in remote sensing and AI to the world of forest carbon in order to enable forest conservation and restoration to scale. Pachama's core technology harnesses satellite imaging with artificial intelligence to measure...

  • Sr. Data Engineer

    3 weeks ago


    San Francisco, California, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, California, United States Nightfall AI Full time

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, California, United States Glow Full time

    About GlowAt Glow, we believe that insurance can provide peace of mind to small business owners so they can pursue their dreams. We are building a digital insurance platform that ensures small businesses have the right coverage for all their insurance needs at the lowest cost, not just when they purchase, but every year. We recently completed a $22M Series A...

  • GCP Data Engineer

    4 weeks ago


    San Jose, California, United States QData Full time

    Skills Needed Spark(PySpark preferred) Spark Workload Tuning/Optimization Python(focus on data engineering) Apache Beam(Python preferred) Airflow(Cloud Composer preferred) BigQuery Hive Data Modeling/Data Warehouse/Analytics Looker Tableau CICD(Cloud Build Bazel MonoRepo) Jupyter Notebooks(Good to have but not required)

  • GCP Data Engineer

    4 days ago


    San Jose, California, United States QData Full time

    Responsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance...


  • San Diego, California, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Engineer|6127

    1 week ago


    San Diego, California, United States ATR International Full time

    Job Description:We are seeking a Cloud Engineer for a very important client.Job Description:Principal Duties and Responsibilities: Applies Software knowledge to assist and support the design, development, creation, modification, and validation of embedded and cloud edge software, applications, and/or specialized utility programs. Analyzes user needs and...


  • San Francisco, California, United States Trace3, Inc Full time

    Our major field office locations include Denver, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas, San Francisco.Juice - The "Stuff" it takes to be a Needle MoverWe look forward to the goal, mentallymapping outevery checkpoint on the pathway to success, and visualizing what the final destination looks and feels like.We're looking to add...


  • San Diego, California, United States Teradata Full time

    Teradata is looking for a dedicated engineering leader to lead the Data Platform Product Architecture Organization. This group is made up of senior product architects who provide architecture and design for the Teradata Data Platform engineering teams. This position is the key driver for execution innovation standardization user experience. This role will...


  • San Mateo, California, United States BigHat Biosciences Full time

    Software Engineer, Data OpsDepartment: EngineeringEmployment Type: Full TimeLocation: San Mateo, CADescriptionBigHat Biosciences is seeking an exceptional individual for the role of Software Engineer, Data Ops. This role is targeted at someone who is ready to dive deep into our computational engine and enhance its capabilities to meet the evolving demands of...


  • San Francisco, California, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations.As a Data Infrastructure Engineer on the security data infrastructure team you will help build Lakehouse for Security organization. You will build reliable, large-scale, multi-geo data pipelines to support detecting threats(internal and...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, California, United States Scroll Capital Full time

    Lead Data Engineer - Python Expert$45k – $90k • 0.1% – 0.25%About Our CompanyWe are a VC backed Fintech Startup in the Bay Area.The RoleStaff/Lead Software EngineerThis is a core and very important role for the company. You'll have a lot of agency in architecting and implementing a corner store of modern financial infrastructure.You'll be enhancing and...

  • Data Engineer II

    4 weeks ago


    San Jose, California, United States Chainalysis Full time

    Blockchain technology is powering a growing wave of innovation. Businesses and governments around the world are using blockchains to make banking more efficient, connect with their customers, and investigate criminal cases. As adoption of blockchain technology grows, more and more organizations seek access to all this ecosystem has to offer. That's where...