Sr.DataOps Engineer
3 months ago
Long Beach, United States
Tri-Force Consulting Services, Inc.
Full time
Job Description Position Name: DataOps Engineer
Location: Long Beach, CA 90802
Client Name: The California State University (CSU).
Note: This is an onsite position
Job Description:
The DataOps Engineer will be responsible for enhancing and managing the data infrastructure and processes to support data-driven decision-making across the organization. This role involves collaborating with data engineering, analytics, and IT teams to streamline data workflows, ensure data quality, and implement efficient data operations practices.
Key Responsibilities:
- Data Pipeline Management:
- Design, implement, and maintain scalable and reliable data pipelines for extracting, transforming, and loading (ETL) data from various sources.
- Optimize data workflows for performance and scalability.
- Automation and Monitoring:
- Develop and automate data workflows and monitoring systems to ensure data availability, accuracy, and timely delivery.
- Implement and maintain monitoring solutions to track data pipeline health and performance.
- Data Integration:
- Integrate data from multiple sources, including databases, APIs, and third-party services.
- Ensure seamless data integration and synchronization across platforms.
- Data Quality and Governance:
- Establish and enforce data quality standards and processes.
- Implement data governance practices to ensure data integrity and compliance.
- Collaboration and Support:
- Work closely with data engineers, data scientists, and business analysts to understand data requirements and deliver solutions.
- Provide technical support and troubleshooting for data-related issues.
- Documentation and Best Practices:
- Document data processes, workflows, and architecture.
- Develop and promote best practices for data management and operations.
Skills and Experience Required:
- Technical Expertise:
- Strong experience with data engineering, ETL processes, and data pipeline management.
- Proficiency in SQL and scripting languages (e.g., Python, Bash).
- Experience with data orchestration tools (e.g., Apache Airflow, Luigi).
- Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Tools and Technologies:
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Data Management:
- Understanding of data modeling, data integration, and data quality frameworks.
- Experience with version control systems (e.g., Git).
- Soft Skills:
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work independently and manage multiple tasks simultaneously.
- Experience with DataOps practices and tools.
- Familiarity with machine learning workflows and tools.
- Certification in relevant technologies or platforms.
If you are: bright, motivated, skilled, a difference-maker, able to get things done, work with minimum direction, enthusiastic, a thinker, able to juggle and multi-task, communicate effectively, and lead, then we would like to hear from you. We need exceptionally capable people for this role for our client, so get back to us and tell us why you think you are a fit.
About Us:
Tri-Force is one of the fastest growing companies in Philadelphia region by receiving the award 5 times and 3 times(Ranked #931 2021) on Inc. 5000 fastest growing companies in the USA. Tri-Force Consulting Services, Inc. is an established consulting services firm offering innovative solutions to Government and Commercial sectors. We specialize in building customized software applications solutions such as knowledge management systems, business intelligence, data analysis, database support and maintenance, data warehouse implementation and support, systems architecture and systems integration for our clients. Our technical competencies are in Java, .NET, SharePoint, PHP, Business Intelligence (Cognos, Data Warehouse), mobile applications platforms (iPhone, iPad, Android, Blackberry), and various other technologies. We also specialize in providing resources to manage infrastructure projects. Tri-Force is one of the fastest growing companies in Philadelphia region by receiving the award 5 times and 2 times on Inc. 5000 fastest growing companies in the USA.