Big Data Engineer
2 days ago
AI Big Data Engineer
Hybrid to Troy, MI
60-70/hr W2
This is NOT a C2C Position
Job Description: We are actively building our AI team. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in continuous learning, especially in Cloud Technologies, who are aware of, and follow the latest and best generative AI technologies and trends, can learn by themselves, are self-motivated and value self-directed initiative with technology and AI exploration. Summary As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and Kubernetes, to handle large-scale and complex data challenges. You will also collaborate with full stack developers, data scientists, analysts, and stakeholders to ensure data quality, reliability, and usability. You must be comfortable working with huge datasets.
Main Responsibilities
- Build automated pipelines to extract and process data from a variety of legacy platforms (predominantly SQL Server), e.g., in stored procedures, Glue processing, etc.
- Implement data-related business logic on modern data platforms, such as AWS Glue, Databricks, and Azure using best practices and industry standards.
- Create vector databases, data marts and the data models to support them
- Optimize and monitor the performance, reliability, and security of data systems and processes.
- Integrate and transform data from (or to) various sources and formats, such as structured, unstructured, streaming, and batch.
- Develop and maintain data quality checks, tests, and documentation.
- Support data analysis, reporting, and visualization using tools such as SQL, Python, Tableau and Quicksight
- Research and evaluate new data technologies and trends to improve data solutions and existing capabilities. Qualifications And Skills
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field
- At least 5 years of experience in data engineering or a similar role (previous DBA experience is a plus)
- Experience with big data frameworks and tools, such as Spark, Hadoop, Kafka and Hive
- Expert in SQL, including a knowledge of efficient query and schema design, DDL, data modeling and use of stored procedures
- Proficient in at least one programming language, such as Python, Go or Java
- Experience with CI/CD, containerization (ex: docker, K8s) and orchestration (ex: Airflow)
- Experience building production systems with more modern ETL, ELT and data systems, such as AWS Glue, Databricks, Snowflake, Elastic, and Azure Cognitive Search
- Experience deploying data infrastructure on cloud platforms (AWS, Azure, or GCP)
- Strong knowledge of data quality, data governance, and data security principles and practices
- Excellent communication, collaboration, and problem-solving
If you're ready to unleash your expertise and drive digital innovation forward, reach out to Brett Middleton at bmiddleton@alinestaffing.com or simply apply to this posting. Let's shape the future of data together 🚀
-
AI Big Data Engineer
1 week ago
Troy, United States Jobot Full timeThis Jobot Consulting Job is hosted by: Amanda PrestonAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $65 - $73 per hourA bit about us:Automotive Information Systems Group Actively building out their AI teamWhy join us?Competitive Compensation PackageHybridAccelerated Growth PotentialJob DetailsJob...
-
AI Big Data Engineer
5 days ago
Troy, Michigan, United States Beacon Hill Full timeJob Title: AI Big Data EngineerWe are seeking an experienced AI Big Data Engineer to join our team at Beacon Hill. As an AI Big Data Engineer, you will play a key role in designing, developing, and maintaining a Unified Data Platform.Main Responsibilities:Data Pipeline Development: Design and implement automated pipelines to extract and process data from...
-
AI Big Data Engineer
5 days ago
Troy, United States Jobot Full timeDice is the leading career destination for tech experts at every stage of their careers. Our client, Jobot, is seeking the following. Apply via Dice today!This Jobot Consulting Job is hosted by: Amanda PrestonAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $65 - $73 per hourA bit about us:Automotive...
-
AI Big Data Engineer
1 week ago
Troy, Michigan, United States Rose International Full timeJob Title: AI Big Data EngineerWe are seeking an experienced AI, Big Data Engineer to join our team at Rose International. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our...
-
AI Big Data Engineer
6 days ago
Troy, United States Mondo Full timeJob Title: AI Big Data EngineerLocation-Type: Hybrid - Troy, MI - T/W/Th on-siteStart Date Is: 10/21/24Duration: 12+ month contractCompensation Range: $60-$75/hrRole Overview:As a Data Engineer with our client, you will contribute to building a Unified Data Platform, focusing on designing, developing, and maintaining data pipelines, data lakes, and platforms...
-
AI Big Data Engineer
6 days ago
Troy, United States Rose International Full timeDate Posted: 10/04/2024Hiring Organization: Rose InternationalPosition Number: 472324Job Title: AI Big Data EngineerJob Location: Troy, MI, USA, 48098Work Model: HybridEmployment Type: TemporaryEstimated Duration (In months): 12Min Hourly Rate($): 75.00Max Hourly Rate($): 80.00Must Have Skills/Attributes: AWS, Azure, Databricks, GCP, Hadoop, Hive, Kafka,...
-
AI Big Data Engineer
1 week ago
Troy, United States Everest Consultants, Inc. Full timeJob Title: AI Big Data Engineer Location: Troy, Michigan Duration: 12 months Hours: 8.00am 5.00pm Pay Rate - $65 - $69.5/hr on W-2 (No 1099 or C2C) Summary As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics...
-
AI Big Data Engineer
3 days ago
Troy, United States Beacon Hill Full timeSummary: As an AI Big Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms to support analytics and business intelligence needs. This role involves working with cutting-edge technologies and tools like Spark, Kafka, AWS, Azure, and Kubernetes to manage...
-
AI Big Data Engineer
1 week ago
Troy, United States Rose International Full time•**Only qualified AI Big Data Engineer candidates located near the Troy, MI area to be considered due to the position requiring an onsite presence***Qualifications: Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field At least 5 years of experience in data engineering or a similar role (previous DBA...
-
AI Big Data Engineer
1 week ago
Troy, United States Robert Half Full timeJob Summary:As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes to tackle large-scale data...
-
AI Big Data Engineer
1 week ago
Troy, United States Robert Half Full timeJob DescriptionJob DescriptionJob Summary:As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes...
-
AI Big Data Engineer
7 days ago
Troy, United States Robert Half Full timeJob Summary:As a Data Engineer, you will play a key role in building a Unified Data Platform that empowers our clients with advanced analytics and business intelligence. You will design, develop, and maintain data pipelines, data lakes, and platforms using cutting-edge technologies like Spark, Kafka, AWS, Azure, and Kubernetes to tackle large-scale data...
-
AI Big Data Engineer
2 weeks ago
Troy, United States Rose International Full timeWe are seeking an experienced AI, Big Data Engineer for the MOTOR Information Systems operating group. As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You...
-
AI Big Data Engineer
1 week ago
Troy, United States Yoh, A Day & Zimmermann Company Full timeJob DescriptionJob DescriptionAs a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and...
-
AI Big Data Engineer
6 days ago
Troy, United States A-Line Staffing Solutions Full timeTitle: AI Big Data Engineer Rate: $65/hr Location: Troy, MI - HybridNote: This is a contract on W2. THIS IS NOT OPEN TO C2C.We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in...
-
AI Big Data Engineer
6 days ago
Troy, United States A-Line Staffing Solutions Full timeJob DescriptionJob DescriptionTitle: AI Big Data EngineerRate: $65/hrLocation: Troy, MI - Hybrid Note: This is a contract on W2. THIS IS NOT OPEN TO C2C. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have...
-
AI Data Engineer
2 days ago
Troy, Michigan, United States Beacon Hill Full timeJob Title: AI Big Data EngineerBeacon Hill is seeking a highly skilled AI Big Data Engineer to join our team. As an AI Big Data Engineer, you will play a critical role in designing, developing, and maintaining a Unified Data Platform.Main Responsibilities:Design and implement automated data pipelines to extract and process data from legacy platforms using...
-
AI Data Engineer
4 days ago
Troy, Michigan, United States MASHPOINT LLC Full timeJob Title: AI Big Data EngineerMASHPOINT LLC is seeking a highly skilled AI Big Data Engineer to join our team. As a key member of our AI team, you will be responsible for designing, developing, and maintaining data pipelines, data lakes, and platforms that meet the analytics and business intelligence needs of our organization.Key Responsibilities:Design and...
-
Senior Data Engineer
4 days ago
Troy, United States A-Line Staffing Solutions Full timeJob DescriptionJob Description We Are actively building out an AI team. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in continuous learning, especially in Cloud...
-
Data Analytics Strategist
1 day ago
Troy, Michigan, United States TEPHRA Full timeJob Title: Analytics LeadAt TEPHRA, we are seeking an experienced Analytics Lead to join our Innovation & Transformation Group (ITG) within the manufacturing vertical. Our team provides unique business consulting services in Aero, Industrial Machinery, Process, and Agri industries.Job Description:We are looking for a talented individual to develop and...