Sr. Data Automation Engineer IV
24 hours ago
In the role of Sr. Data Automation Engineer IV, you are at the heart of our efforts to streamline data-centric processes. Your responsibilities include crafting and overseeing databases, as well as devising comprehensive solutions that enhance the efficiency of our business operations team. Collaborating with various departments, you will assess data requirements, devise automation scripts, and roll out scalable systems tailored to our workforce's needs. This position demands the integration of multiple external systems via APIs, linked servers, and standardized industry practices to develop new platforms that elevate our staff's productivity in their day-to-day activities. Furthermore, you will lead the deployment of AI Ops-style solutions, incorporating data for advanced technologies such as Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) models, and various Machine Learning applications.
Responsibilities:
- Architect, build, and maintain diverse database systems, ensuring optimal performance and quick response times for front-end queries.
- Craft and refine code in Python, PowerShell, and additional programming languages to streamline data processing and unify various systems through automation.
- Spearhead the creation and upkeep of scripts dedicated to the extraction, transformation, and loading (ETL) of data.
- Assist other teammates in web design elements to enhance user engagement when using our data automation tools.
- Employ RESTful APIs for seamless integration with a range of third-party services.
- Manage and analyze large data sets using sophisticated querying methods to draw actionable insights and aid in decision-making.
- Implement Machine Learning or Generative AI techniques to boost data analysis and predictive modeling capabilities.
- Keep abreast of the latest technological advancements and trends in data to refine and advance our automation strategies continuously.
Required Knowledge and Skills:
- Ability to convey complex technical / operational information to non-technical colleagues and stakeholders.
- Adjusts processes to enhance effectiveness, solve recurring problems or improve efficiency.
- Collaborates with functional and cross-organizational teams to generate solutions to complex and challenging issues.
- Expertise in MS-SQL, Databricks, Python, PowerShell, and other scripting languages, demonstrating strong coding proficiency.
- A thorough understanding of web technologies, including HTML, CSS, and JavaScript, alongside fundamental web design concepts.
- A proven track record in full-stack development, showing a capability to handle both backend and frontend tasks.
- Experience handling large datasets and conducting complex data analysis through advanced querying.
- A solid grasp of Machine Learning or Generative AI methodologies, with familiarity in using platforms such as Microsoft's Semantic Kernel, Google's Vertex AI, Open AI API, or comparable technologies.
Basic Qualifications:
- BA/BS degree and 4-6 years' relevant experience OR equivalent combination of education and experience.
- 4+ years' of experience in database management, including designing, developing, and maintaining various database systems.
- Proficiency in programming languages such as Python and PowerShell for automating tasks and integrating systems.
- Experience with RESTful API integration and managing large datasets.
- Basic knowledge of web technologies (HTML, CSS, JavaScript) for developing user interfaces.
- Understanding of data extraction, transformation, and loading (ETL) processes.
Preferred Qualifications:
- Master's degree and 6+ years' relevant experience OR equivalent combination of education and experience.
- 4+ years of experience in a data automation or data engineering role, with a proven track record of implementing scalable solutions.
- 3+ year of experience with software solutions based in Healthcare or pharmaceutical environments (PHI/PII)
- 3+ year of experience with Kafka and other similar services
- 3+ year of experience managing and developing in large data lakes
- 1+ year of public and local cloud architectures, such as AWS, Docker, Nutanix
- 1+ year of experience of inventory / warehouse management
Work Conditions
- Remote environment
- Ability to travel less than 10% of the time
-
Sr. Data Engineer
13 hours ago
Pittsburgh, Pennsylvania, United States Data Ideology Full time $120,000 - $145,000 per yearData IdeologyAt DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services enable our customers to transform data into insights by driving a culture of empowerment and ownership of results. Our team consists of highly motivated individuals...
-
Sr Director, Data Engineering
1 day ago
Pittsburgh, Pennsylvania, United States GNC Full time $120,000 - $200,000 per yearCompany DescriptionAs the global leader in health and wellness innovation since 1935, GNC motivates people to reach their goals with the most trusted and exciting selection of products in the industry.As #TeamGNC, we work hard to ensure that our consumers come first. We are always cultivating and collaborating on new ideas to bring innovative solutions to...
-
Engineer II, Automation
3 days ago
Pittsburgh, Pennsylvania, United States ElevateBio Full time $100,000 - $140,000 per yearThe Role:ElevateBio is looking for an Automation Engineer II who will play a key role in owning the Basecamp facilities controls and automation systems [Systems]. For these Systems, this role will develop support models to ensure robust operations, manage vendor and software support contracts, provide key support for various manufacturing, quality and...
-
Principal Engineer, AI and Automation
17 hours ago
Pittsburgh, Pennsylvania, United States TrueCommerce Full time $150,000 - $250,000 per yearAt TrueCommerce, your AI expertise transforms complex data and workflows into intelligent solutions that move commerce forward.We are seeking a forward-thinking Principal Engineer, AI and Automation to accelerate the development and adoption of AI and Gen AI solutions across our organization. This high-impact individual contributor role, reporting to the...
-
Industrial Automation Network Engineer
14 hours ago
Pittsburgh, Pennsylvania, United States Carmeuse Full time $95,000 - $106,000The Automation Network and Server Engineer is responsible for the overall development, administration, implementation, maintenance and troubleshooting of all operations networks, historian servers, HMI's and cloud/web services. Other responsibilities include network monitoring, performance analysis, development/implementation of standards, project support,...
-
Resiliency Automation Engineer
5 days ago
Pittsburgh, Pennsylvania, United States Software Engineering Institute | Carnegie Mellon University Full time $120,000 - $180,000 per yearWe are seeking a highly skilled Resiliency Automation Engineer to join our team supporting embedded systems development in a regulated environment. This role will blend software engineering expertise, automation, and toolchain development to ensure our codebase is stable, secure, and maintainable.In this role, you will collaborate closely with development,...
-
Software Engineer II, Pipeline Automation
3 days ago
Pittsburgh, Pennsylvania, United States Aurora Innovation Full time $126,000 - $201,000Who we areAurora's mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, more efficient, and more accessible future to everyone.At Aurora, you will tackle massively complex problems alongside other passionate, intelligent...
-
QA Automation Engineer
16 hours ago
Pittsburgh, Pennsylvania, United States TWO95 International, Inc Full time $60,000 - $120,000 per yearTitle: QA Automation EngineerLocation: Pittsburgh, PAPosition: ContractRate: $/OpenDescription: -Work and/or academic experience testing applications using automated testing toolsEffective in a fast paced environment, Collaborative/enjoys working in teamsSelf-starter/motivator, Organizational skills / Detail orientedCreative and Effective problem solving...
-
Automation Engineer Level 1
5 days ago
Pittsburgh, Pennsylvania, United States LVI Associates Full time $90,000 - $120,000 per yearJob Title:Automation Engineer - Level 1Location:PittsburghJob Type:Full-TimeSummaryWe are seeking a skilled Automation Engineer to design and implement automation solutions for both modernization and new installations of Level 1 control systems. This role involves working with a range of industrial equipment including Electric Arc Furnaces, Vacuum Tank...
-
Data Engineer II
3 days ago
Pittsburgh, Pennsylvania, United States TeleTracking Technologies, Inc. Full time $80,000 - $120,000 per yearLocation: Pittsburgh, PA - OnsiteType: Full-timeAbout The Role…Are you looking for a patient-focused, innovation-driven company that will inspire you and empower you to shine? Join us as A Data Engineer... As a Data Engineer at TeleTracking, you will be responsible for innovative design and engineering data solutions on some of the most...