Data Engineer
3 weeks ago
Data Engineer (Databricks, Snowflake, AWS)
Contract: 4-6 months
Los Angeles, CA or New York City, NY – Hybrid onsite 1-2 days per week
Seeking a Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join the Engineering Centre of Excellence. This is a great opportunity to join a data-first media company and be part of a Enterprise Data Platform team that prides itself in making them a data-driven organization. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
Responsibilities
- Collaborate with and across Agile teams to design and develop data engineering solutions by rapidly delivering value to our customers
- Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
- Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
- Build highly performing real-time data ingestion solutions for streaming workloads
- Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
- Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
- Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
- Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
- Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Communicate clearly and effectively to technical and non-technical leadership
Must Have skills:
Education: Bachelor's degree in Computer Science, Computer Engineering, or relevant field
Work Experience:
- Senior Data Engineer: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
- Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
- Experience with Databricks
- Experience working with data acquisition and transformation tools such as Fivetran and DBT
- Experience building highly optimized & efficient data engineering pipelines using Python, PySpark
- Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
- Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
- Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
- Expertise in Advanced SQL programming and SQL Performance Tuning
- Experience with version control tools such as GitHub or Bitbucket.
- Expert level understanding of dimensional modeling techniques
- Excellent communication, adaptability, and collaboration skills
- Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
- Strong logical and problem-solving skills with critical thinking
Nice to Have:
- Experience in designing and building applications using Container and serverless technologies
- Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
- Experience working with semi-structured, unstructured data, No SQL databases
- Experience with CI/CD using GitHub Actions or Jenkins
- Experience designing and building APIs
-
Data Engineer
3 weeks ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California*** Key Responsibilities: Build complex data engineering pipelines using Python and Airflow to...
-
Data Engineer
1 week ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California*** Key Responsibilities: Build complex data engineering pipelines using Python and Airflow to...
-
Data Engineer
5 days ago
Los Angeles, United States Motion Recruitment Partners LLC Full timeData Engineer Los Angeles, California Hybrid Contract $65/hr - $77/hr Our client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position , working onsite 3 days/week . Candidates must be commutable to Hollywood, California *** Key Responsibilities: Build...
-
Data Engineer
4 weeks ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
2 months ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
2 weeks ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
1 week ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
2 months ago
Los Angeles, United States Proliance Consulting Full timeData EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...
-
Data Engineer
3 weeks ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA!***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***Key Responsibilities:Build complex data engineering pipelines using Python and Airflow to hydrate datamarts...
-
Data Engineer
3 weeks ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA!***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***Key Responsibilities:Build complex data engineering pipelines using Python and Airflow to hydrate datamarts...
-
Data Engineer
3 weeks ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA!***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***Key Responsibilities:Build complex data engineering pipelines using Python and Airflow to hydrate datamarts...
-
Data Engineer
1 week ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA!***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***Key Responsibilities:Build complex data engineering pipelines using Python and Airflow to hydrate datamarts...
-
Data Engineer
2 weeks ago
Los Angeles, United States Motion Recruitment Full timeOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA!***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***Key Responsibilities:Build complex data engineering pipelines using Python and Airflow to hydrate datamarts...
-
Data Engineer
3 days ago
Los Angeles, United States Motion Recruitment Partners LLC Full timeData Engineer Los Angeles, California Hybrid Contract $65/hr - $77/hr Our client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position , working onsite 3 days/week . Candidates must be commutable to Hollywood, California *** Key Responsibilities: Build...
-
Certified Engineer
3 weeks ago
Los Angeles, United States T5 Data Centers Full timeJob DescriptionJob DescriptionCompany DescriptionForever On! From the start in 2008, T5 has been focused on supporting enterprise and hyperscale customers with customized data center solutions. Today, we remain dedicated to an unrivaled level of quality that extends across the lifecycle of the core data center ranging from customized turnkey development,...
-
Data Engineer
4 weeks ago
Los Angeles, United States TekWissen LLC Full timeJob DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is a media and entertainment company that develops, produces, and markets entertainment, news, and information. It owns and operates a portfolio of news and entertainment television networks, a motion...
-
Data Engineer II
7 days ago
Los Angeles, California, United States Riot Games Full timeData Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...
-
Senior Data Engineer
4 weeks ago
Los Angeles, United States YO HR CONSULTANCY Full timeJob DescriptionJob DescriptionSenior Data Engineer& ExpertisePythonSQLNoSQLAWSAzureData ModelingKubernetesHIPAAApache Spark - 3 yearsPySparkSnowflake - 3 yearsApache AirflowData Engineer - 3 yearsSchema DesignRequirements: Bachelor’s or master’s degree in computer science, Engineering, or a related field. 5 - 10 years of experience in data...
-
Senior Data Engineer
1 week ago
Los Angeles, United States YO HR CONSULTANCY Full timeJob DescriptionJob DescriptionSenior Data Engineer& ExpertisePythonSQLNoSQLAWSAzureData ModelingKubernetesHIPAAApache Spark - 3 yearsPySparkSnowflake - 3 yearsApache AirflowData Engineer - 3 yearsSchema DesignRequirements: Bachelor’s or master’s degree in computer science, Engineering, or a related field. 5 - 10 years of experience in data...
-
Data Engineer II
1 month ago
Los Angeles, California, United States Riot Games Full timeData Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...
