Remote Data Engineer

2 weeks ago

Indianapolis, United States Cerebra Consulting Inc Full time
Job DescriptionJob Description

Role: Remote Data Engineer

Length: 12 months + extension

Location: 100% Remote

Job Description:

Key Responsibilities:

  • Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
  • Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.
  • Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
  • Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.
  • Designs and implements physical data models to define the database structure.
  • Optimizing database performance through efficient indexing and table relationships.
  • Participates in optimizing, testing, and troubleshooting of data pipelines.
  • Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
  • Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Assists with renovating the data management infrastructure to drive automation in data integration and management.
  • Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team members

Skillset:

  • Hands-on Azure Data experience
    • Tools to have: Databricks, Synapse, Data Factory, etc.
  • High functional knowledge of Big Data
  • Hands-on experience automating the ETL process
    • No specific tool is required: Jenkins preferred
  • Scala or PySpark knowledge (Scala preferred)

Required Skills : This candidate must possess skills in the Azure Data platform. This client is looking for a mid-level Data Engineer. They must be skilled in Azure Data Bricks, Data Factory, and Data Lake. This candidate should also have an exposure to Big Data. This position is a with a long-term client. This opportunity is great for a candidate who is strong technically and is looking to expand on their career. Our previous resource was on with this client for 2 years and is being rolled off due to tenure limits.

  • REMOTE Application Support Engineer

    2 weeks ago

    Indianapolis, United States Saxon Global Full time

    Remote Application Support Engineer Apex Systems is looking for a qualified individual to fill an immediate opening for a Remote Application Support Engineer position. Please see the job description below for details of the role. Job Duties and Responsibilities: This position troubleshoots software issues and provides solutions for clients, works closely...

  • AI Data Engineer

    1 week ago

    Indianapolis, Indiana, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • AI Data Engineer

    1 week ago

    Indianapolis, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Data Engineer

    1 week ago

    Indianapolis, United States BCforward Full time

    Data Engineer BCforward is seeking a Data Engineer to work hybrid in Indianapolis, IN Data Engineer Location: Indianapolis, IN Top Skills: -5-10 years Data Integration Experience Experience with cloud systems (azure, synapse, etc) Local candidates highly preferred. The first week will be on-site in the Indianapolis office then 1 time a month for a couple of...

  • Data Engineer

    7 days ago

    Indianapolis, United States BCforward Full time

    Data Engineer BCforward is seeking a Data Engineer to work hybrid in Indianapolis, IN Data Engineer Location: Indianapolis, IN Top Skills: -5-10 years Data Integration Experience Experience with cloud systems (azure, synapse, etc) Local candidates highly preferred. The first week will be on-site in the Indianapolis office then 1 time a month for a...

  • Remote Controls Engineer

    24 hours ago

    Indianapolis, United States Avero Full time

    Our customer is a global custom equipment manufacturer and is looking to add a Controls Engineer to their team. This person will be designing the automation for the new equipment. This is a remote opportunity; you can work anywhere but they do require occasional travel to support the installation of the equipment.This person needs to be able to work on both...

  • Data Engineer

    2 weeks ago

    Indianapolis, United States Rose International Full time

    Date Posted: 04/25/2024 Hiring Organization: Rose International Position Number: 462967 Job Title: Data Engineer Job Location: Indianapolis, IN, USA, 46204 Work Model: Onsite Shift: 8:00 AM - 5:00 PM Employment Type: Temporary Estimated Duration (In months): 13 Min Hourly Rate ($): 70.00 Max Hourly Rate ($): 80.00 Must Have...

  • Data Engineer

    2 weeks ago

    Indianapolis, United States Rose International Full time

    Date Posted: 04/25/2024 Hiring Organization: Rose International Position Number: 462967 Job Title: Data Engineer Job Location: Indianapolis, IN, USA, 46204 Work Model: Onsite Shift: 8:00 AM - 5:00 PM Employment Type: Temporary Estimated Duration (In months): 13 Min Hourly Rate ($): 70.00 Max Hourly Rate ($): 80.00 Must Have...

  • Associate Data Engineer

    1 day ago

    Indianapolis, United States Brooksource Full time

    *Associate Data Scientist* *Indianapolis, IN* *6 month reoccurring contract* *Pay: $36.43/hr.* As the Associate Data Engineer, you will collaborate with partners and external stakeholders to collect and process data related to various issues and subjects, aiming to create data-driven solutions for complex business challenges. Responsibilities: * Extracts and...

  • Data Engineering Manager

    1 day ago

    Indianapolis, United States Travel + Leisure Full time

    We Put the World on Vacation At Travel + Leisure Co., our mission is simple: to put the world on vacation. With a focus on vacation ownership, travel memberships, and exchange programs, we’re shaping the future of leisure travel by creating new possibilities for vacationers. Innovation and growth keep our work interesting and fun. Every day is a chance to...

  • Data BI Analyst

    2 weeks ago

    Indianapolis, United States Remotely Full time

    This is a remote position. Data BI Analyst (1 year experience, remote) Be part of our future! This job posting builds our talent pool for potential future openings. We'll compare your skills and experience against both current and future needs. If there's a match, we'll contact you directly. No guarantee of immediate placement, and we only consider...

  • Data Engineering Manager

    5 days ago

    Indianapolis, United States Avanade Spain SL Full time

    Cities: Chicago, Cleveland, Detroit, Indianapolis, Minneapolis, St. Louis Data Engineering Manager Our talented Data & AI Practice is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business...

  • Data Engineering Manager

    7 days ago

    Indianapolis, United States CareerBuilder Full time

    Cities: Chicago, Cleveland, Detroit, Indianapolis, Minneapolis, St. Louis Data Engineering Manager Our talented Data & AI Practice is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business...

  • Data Engineer

    5 days ago

    Indianapolis, IN, United States BCforward Full time

    Data Engineer BCforward is seeking a Data Engineer to work hybrid in Indianapolis, IN Data Engineer Location: Indianapolis, IN Top Skills: -5-10 years Data Integration Experience Experience with cloud systems (azure, synapse, etc) Local candidates highly preferred. The first week will be on-site in the Indianapolis office then 1 time a month for a...

  • Data Engineer Intern

    2 weeks ago

    Indianapolis, United States INDIANAPOLIS MARION CNTY BLDG Full time

    Job DescriptionJob DescriptionDescription:This Position will report to and work with the CAD Data Engineer and will maintain the data, its storage, and the connection between the BIM and CMMS systems. Responsible for running and analyzing reports, collaborating with our analytics team to help us better understand and interpret our data, develop strategies to...

  • Senior Data Engineer/Data Architect

    1 day ago

    Indianapolis, United States ShiftCode Analytics Full time

    Interview : Video Visa : All apart from H1b and CPT This is hybdrid from Day-1 ( Tuesdays and Wednesdays in the office) Need only local candiates Description : Job title: Senior Data Engineer/Data Architect (looking for Snowflake SME) The Data Engineer Senior/Area Data Architect will provide strategic leadership and direction for data-related projects. The...

  • AWS Data Engineer

    1 day ago

    Indianapolis, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionPosition : AWS Data EngineerLocation: Indianapolis, INJob Type: Fulltime Job Need only USC/GC/GC EADJD-Must Have Technical/Functional Skills-Bachelor's degree in computer science, Information Systems, or a related field.Python Programming: Strong proficiency in Python for data manipulation, scripting, and ETL tasks.AWS...

  • Sr. Data Platform DevOps Engineer

    4 days ago

    Indianapolis, United States Salesforce Full time

    About Salesforce. Were Salesforce, the Customer Company, inspiring the future of business with AI Data CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we DevOps Engineer, Platform, Engineer, Salesforce, DevOps, Data, Technology

  • Associate Director

    1 week ago

    Indianapolis, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Associate Director – Data Products Engineering Lead

    3 weeks ago

    Indianapolis, Indiana, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...