Data Lake Architect

What you'll Do You will be responsible to design, build, deploy and maintain business applications for Americold's cloud systems and technologies. As an experienced technologist and key member, you will help influence architectural choices across broad use cases involving security, data lake, analytics, and AI/ML. The ideal candidate will possess demonstrated ability to think strategically about business, product, and technical challenges. You will be responsible to provide exceptional technical design guidance and thought leadership. You will work closely with business and cross-functional technical teams to offer strategies to optimize existing solutions on the cloud as well as propose new solutions on cloud platforms to migrate existing workloads, assist with cloud migration efforts, review workload architectures, and provide guidance on how to address high-risk issues. You will lead efforts to capture and share best-practice knowledge with the technical data engineers and data analysts.
Responsible for Architecting, designing, and maintaining scalable, cost-effective, and efficient Cloud solutions on data lake while taking care of compliance and best practices.
Design, build and implement proof-of-concept solutions, cloud architectures and applications.
Working closely with stakeholders and product teams to understand business objectives, bridge the gap between technical and non-technical stakeholders and creating cloud-based solutions to facilitate those objectives.
Communicate with stakeholders and build applications to meet project needs
Collaborate with stakeholders within - Business Operations, Sales / Business Development, Finance and Customers
Keeping cloud environments secure and preventing downtime or security breaches.
Look for ways to move older systems and solutions into the cloud for more efficiency. Determine upgrades and improvements to current cloud architectures Implement solutions using AWS cloud offerings such as EC2, S3, Lambda, Glue jobs, etc.
Ensure that the architecture and solutions are compliant with cloud best practices and mitigate any security vulnerabilities that might occur. Provide technical support on cloud related issues, monitor solutions, and implement appropriate strategies to eliminate performance bottlenecks. Utilize tools such as IAM, resource tagging, cost management etc. to enforce Cloud governance policies and implement monitoring and alerting solutions to address issues proactively. Scale our cloud data infrastructure, data pipelines and tools to meet growing business needs Evaluate and enhance data quality and reliability Manage & collaborate with data engineers and data analysts in all phases of SDLC Stay abreast of the latest trends and advancements in data science, machine learning, and cloud technologies, and apply this knowledge to drive innovation within the organization Lead the design, development, and deployment of ML pipelines and data solutions in cloud environments such as AWS, Microsoft Azure, and Google Cloud Platform (GCP), with a focus on AWS. Develop and implement advanced machine learning models and algorithms to solve complex business problems
What Experience and Education You Need Bachelor of Science degree in Computer Science or equivalent; or equivalent combination of education Experience architecting complex systems and working on large-scale projects in AWS Cloud and Data Lake.
+10yrs experience in designing, implementing, and maintaining data engineering solutions, with +5yrs working in Cloud architecture/solutions, preferably AWS Strong knowledge of cloud concepts architecture patterns, and best practices AWS Solution Architect, Associate or Professions is a plus
Strong SQL skills, ability to perform effective querying involving multiple tables and subqueries Experience of data mining principles: predictive analytics, machine learning, mapping, collecting data from multiple data systems on premises and cloud-based data sources Experience designing Data Warehouse/Data Lake, Cloud Based Technologies (AWS - Data Migration Service, Glue, S3, EC2, Lambda, Step Functions, Document DB, RedShift / Spectrum) Experience working with stakeholders and putting together cloud based solution-architecture for Data/Analytics products Experience understanding/eliminating functional and technical blockers for the team Level of Experience: Performs work with little to no supervision. Leads & provides guidance to experienced analysts/developers. Acts as project leader on large, complex projects. Maintains a senior-level workload. Fully capable of working at the highest technical level. Has 5+ years of relevant experience
What Could Set You Apart Familiarity with big data technologies such as Hadoop, Spark, and Kafka. Familiarity with Generative AI Knowledge of containerization and orchestration tools such as Docker and Kubernetes. Knowledge with CI/CD pipelines and infrastructure as code (IaC) tools like Terraform or CloudFormation Knowledge leveraging and improving the Agile Scrum Process and DevSecOps practices Experience of programming languages extensively used in Data Science applications (e.g., R, Python, Pyspark, Scala, Java, etc.) Strong problem solving, quantitative, data architecture and analytical abilities Exposure to the web-apps technology stacks like: Angular, C#/MVC/.NET Knowledge of integrating data lake with enterprise systems using XML, JSON, API, event bridge Knowledge of Microsoft tool set including Excel, Word, and PowerPoint Excellent communication, analytical and delegation skills Knowledge of data visualization tools: Power BI, SSRS, Tableau, etc. Knowledge of Supply Chain processes and business models
Physical Requirements The physical demands described below are representative of those that must be met to successfully perform the essential functions of the job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions of the job. Requires the ability to sit for long periods of time, with frequent interruptions Requires several hours per day of sitting, getting up and down from chairs, and reaching, or bending Requires manual dexterity with normal hand and finger movements for typical office work
Talking, hearing, and seeing are important elements of completing assigned tasks May require travel by automobile and airplane up for business May require a visit to facility operation in temperatures at or below freezing May carry loads related to travel and occasionally lifts, carries, positions, or moves objects weighing up to 20 pounds Requires the use of various electronic tools
Requires the ability to relate to others beyond giving and receiving instructions: must partner with colleagues without exhibiting behavioral extremes Requires the performance of work activities including reasoning, negotiating, instructing, persuading, or speaking with others; and respond appropriately to constructive feedback from executive management
Work EnvironmentThe work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. The Company makes reasonable accommodations in accordance with applicable law.What We Offer:Our associates know the answer to the question What's in it for me? We offer best-in-class benefit programs and continuously work with our associates to ensure that our offerings meet the needs of their health and financial well-being. When you join Americold you join a values-oriented company with a clear mission. We help our customers feed the world.Americold is an Equal Opportunity/Affirmative Action Employer and complies with applicable employment laws.EOE/AA M/F/D/V DFW.