Data Engineer
3 days ago
Job Description: Job Title: Senior Data Engineer
About Us:
We are the Consumer Data Engineering team (CoDE) at ***, seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the scalability, reliability, and performance of our data systems.
Job Summary:
We are looking for a highly skilled Senior Data Engineer with a strong background in big data engineering, cloud computing, and software development. The ideal candidate will have a proven track record of designing and implementing scalable data solutions using AWS, Spark, and Python. The candidate should have hands-on experience with Databricks, optimizing Spark applications, and building ETL pipelines. Experience with CI/CD, unit testing, and big data problem-solving is a plus.
Key Responsibilities:
• Design, build, and maintain large-scale data pipelines using AWS EMR, Spark, and Python
• Develop and optimize Spark applications and ETL pipelines for performance and scalability
• Collaborate with product managers and analysts to design and implement data models and data warehousing solutions
• Work with cross-functional teams to integrate data systems with other applications and services
• Ensure data quality, integrity, and security across all data systems
• Develop and maintain unit test cases for data pipelines and applications
• Implement CI/CD pipelines for automated testing and deployment
• Collaborate with the DevOps team to ensure seamless deployment of data applications
• Stay up to date with industry trends and emerging technologies in big data and cloud computing
Requirements:
• Ideally 7-8 years of experience in data engineering, big data, or a related field
• Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming
• Experience with AWS EMR, including cluster management and job optimization
• Strong skills in Python, including data structures, algorithms, and software design patterns
• Hands-on experience with Databricks, including Databricks Lakehouse (advantageous)
• Experience with optimizing Spark applications and ETL pipelines for performance and scalability
• Good understanding of data modeling, data warehousing, and data governance
• Experience with CI/CD tools such as Jenkins, GitLab, or CircleCI (advantageous)
• Strong understanding of software development principles, including unit testing and test-driven development
• Ability to design and implement scalable data solutions that meet business requirements
• Strong problem-solving skills, with the ability to debug complex data issues
• Excellent communication and collaboration skills, with the ability to work with cross-functional teams
Nice to Have:
• Experience with Databricks Lakehouse
• Knowledge of data engineering best practices and design patterns
• Experience with agile development methodologies, such as Scrum or Kanban
Comments for Suppliers: Key Technical Requirements:
Spark
AWS
Databricks
Key Soft Skills:
Good communication
Good collaboration skills
Enthusiasm for work
Former *** experience strongly preferred
-
Data Engineer
5 months ago
Tallahassee, United States META Full timeSummary: At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta Data Center’s Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center organization....
-
Senior Data Engineer
2 days ago
Tallahassee, United States Brilliant Infotech Full timeJob Title: Senior Data EngineerAbout Us: Brilliant Infotech is a leading provider of innovative data solutions. We are seeking a highly skilled Senior Data Engineer to join our team and help us drive business growth through data-driven insights.Job Description: We are looking for a senior-level data engineer with 3-5 years of experience in designing and...
-
Data Engineer
3 weeks ago
Tallahassee, United States Ciber Full timeHTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services...
-
Senior Data Architect and Engineer
3 weeks ago
Tallahassee, Florida, United States Elit IT Inc. Full timeAt Elit IT Inc., we are seeking an experienced Senior Data Architect and Engineer to lead our data architecture initiatives. This is a 1-year contract with the possibility of extension.Salary:$120,000 per yearJob OverviewWe are looking for a highly skilled professional to design, build, and maintain our data infrastructure. As a Senior Data Architect and...
-
Chief Data Engineering Specialist
3 weeks ago
Tallahassee, United States Elit IT Inc. Full timeElit IT Inc. is seeking a highly skilled Data Architect to join our team in Tallahassee, Florida.Estimated Salary: $120,000 - $180,000 per annumAbout the RoleWe are looking for an experienced professional with a strong background in ETL development and data engineering. The successful candidate will have a proven track record of building and optimizing...
-
Senior Data Engineering Lead
2 days ago
Tallahassee, United States Integrated Resources Full timeAbout Integrated ResourcesWe are a leading provider of data engineering solutions, dedicated to helping businesses unlock the full potential of their data. Our team of experts is passionate about designing and implementing scalable data systems that drive business growth.
-
Tallahassee, United States Confluent Full timeAbout ConfluentWe're a leading innovator in the field of data streaming, dedicated to empowering organizations to harness the full potential of continuously flowing data. Our purpose is to create an entirely new category within data infrastructure – data streaming – allowing every organization to create experiences and utilize the power of data in...
-
Data Integration Engineer
3 weeks ago
Tallahassee, United States TECKpert Full timeWe are looking for a Data Integration Engineerto support our client based in Tallahassee, Florida. US BASED CANDIDATES ONLY. This is an onsite position in Tallahassee, FL. *No third parties and no sponsorship* Who we are Founded in 2009 and headquartered in beautiful Miami, FL, TECKpert is a tech consulting and staff augmentation firm. At TECKpert,...
-
Tallahassee, United States Elit IT Inc. Full time**Job Summary:**We are seeking an experienced Data Engineer Lead to lead our team in developing and optimizing large-scale ETL pipelines for high-performance, high-availability environments.**About Elit IT Inc.:**Elit IT Inc. is a leading provider of innovative technology solutions. We are dedicated to delivering exceptional results and exceeding our...
-
Data Engineer
3 weeks ago
Tallahassee, Florida, United States Ciber Full timeJob Description:We are seeking an experienced Data Engineer to build and maintain the data pipeline for our Generative AI platform. The ideal candidate will be well-versed in the latest Large Language Model (LLM) technologies and have a strong background in data engineering, with a focus on Retrieval-Augmented Generation (RAG) and knowledge-base...
-
Senior Data Integration Engineer
3 weeks ago
Tallahassee, Florida, United States Maverc Technologies Full timeJob OverviewMaverc Technologies is a leading provider of cybersecurity and IT services, seeking an exceptional Senior Data Integration Engineer to join our dynamic team. This role requires expertise in designing, developing, and deploying data integration solutions with a focus on financial data accuracy and integrity.Job ResponsibilitiesData Integration and...
-
Data Modeler
6 days ago
Tallahassee, United States Elegant Enterprise- Wide Solutions Inc Full timePrimary Work: Serve as Data Engineer for the Data & Analytics (D&A) Office. Education: Bachelor's or master's degree in Data Science, Computer Science, Information Systems or other Information Technology major, or equivalent work experience. Required Tasks to be performed: Design, implement, and maintain robust data pipelines and architectures. ...
-
Data Analyst
2 days ago
Tallahassee, United States Tech Army, LLC Full timeAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at Tech Army, LLC.The estimated salary for this position is $85,000 - $110,000 per year, based on experience and location.This role involves developing visually appealing dashboards and reports using Qlik Sense, collaborating with data engineers to gather and clean data, and working...
-
Data Modeler
7 days ago
Tallahassee, United States Elegant Enterprise- Wide Solutions Inc Full timePrimary Work: Serve as Data Engineer for the Data & Analytics (D&A) Office. Education: Bachelor's or master's degree in Data Science, Computer Science, Information Systems or other Information Technology major, or equivalent work experience.Required Tasks to be performed:
-
Data Analyst
5 days ago
Tallahassee, United States Brilliant Infotech Full timeJob Title: Data Analyst Location: Tallahassee, FL Duration: 12+ Months (Extendable) Assignment Type: OnsiteNeed Locals Only Due To Work RequirementsDescription Education: Bachelor's or master's degree in Data Science, Computer Science, Information Systems or other Information Technology major, or equivalent work experience. Required Tasks to be performed: ...
-
Data Scientist
2 days ago
Tallahassee, United States Brilliant Infotech Full timeJob Title: Data ScientistAbout Us: Brilliant Infotech is a leading provider of innovative data solutions. We are seeking an experienced Data Scientist to join our team and help us drive business growth through data-driven insights.Job Description: We are looking for a highly skilled Data Scientist to design, implement, and maintain robust data pipelines and...
-
Data Analyst
3 days ago
Tallahassee, United States Lifescale Analytics Full timeWho we are: Lifescale Analytics, a woman-owned small business (WBENC and WOSB certifications) provides specialized expertise in data and analytics. Formed in 2012, the Lifescale Analytics team has years of experience providing a spectrum of customized data management services and solutions including Data Management/Analytics, Big Data Solutions, Cloud...
-
BI Data Analyst
3 days ago
Tallahassee, United States Tech Army, LLC Full timeEducation: Bachelor’s or master’s degree in Data Science, Computer Science, Information Science, or other Information Technology major, or equivalent work experience.Required Tasks to be performed:• Develop visually appealing, intuitive, user friendly, and insightful Qlik Sense dashboards and reports• Advise program areas on which visualizations and...
-
Data Engineer/Architect
3 weeks ago
Tallahassee, United States Lifescale Analytics Full timeAt Lifescale Analytics, we help achieve data driven decisions by leveraging strategic technologies to create innovative solutions, that ultimately help our clients to navigate their ever-changing data landscape. We have an opportunity for a Data Engineer/Architect. This role will be an Onsite Role, candidates will be required to be onsite in Tallahassee, FL....
-
Data Engineer/Architect
1 month ago
Tallahassee, United States Lifescale Analytics Full timeAt Lifescale Analytics, we help achieve data driven decisions by leveraging strategic technologies to create innovative solutions, that ultimately help our clients to navigate their ever-changing data landscape. We have an opportunity for a Data Engineer/Architect. This role will be an Onsite Role, candidates will be required to be onsite in Tallahassee, FL....