Streaming Data Engineer

Job description Desired Candidate ProfileExperience with setup of Azure data factory Synapse Azure Data lake Azure Data bricks Azure Cosmos DB Azure Streaming Analytics Event-hub Strong expertise in SQL Experience across end to end data management concepts including Data Quality Meta data Data Security Coding skills (Python additional programming skills such...

Job descriptionRoles & Responsibilities You would be responsible for evaluating developing maintaining and testing big data solutions for advanced analytics projects The role would involve big data pre-processing & reporting workflows including collecting parsing managing analyzing and visualizing large sets of data to turn information into business insights...

Summary Data Engineers work with data consumers to create and populate optimal data architectures, structures, and systems to meet CIA's business needs. Duties As a Data Engineer for CIA, you will focus on the design, implementation, and operation of data management systems to meet the CIA's business needs. This includes designing how the data will be...

Key Responsibilities Design implement and support applications that provide structured and timely access to actionable business information addressing stakeholder needs. Interface directly with stakeholders gathering requirements and owning automated end-to-end reporting solutions. Partner with analysts data engineers business intelligence engineers and...

We're looking for a Big Data Engineer who can find creative solutions to tough problems. As a Big Data Engineer you'll create and manage our data infrastructure and tools including collecting storing processing and analyzing our data and data systems. You know how to work quickly and accurately using the best solutions to analyze mass data sets and you know...

Responsibilities Design build and own all the components of a high-volume data warehouse end to end. Build efficient data models using industry best practices and metadata for ad-hoc and pre-built reporting Provide wing-to-wing data engineering support for project lifecycle execution (design execution and risk assessment) Interface with business customers...

Role OverviewWe are looking for a DevOps engineer to support a world wide development team that is building cloud native products for real time analytics and streaming applications. This is an intermediate position in product development responsible for integrating Streaming products with cloud infrastructure implementing DevOps pipelines and processes to...

Job description Skills RequiredProficient in languages Python.Experience in AWS StackGlue Athena Quick sight RDS Redshift Kafka pySpark.Experience setting up data pipelines archiving data data lakes.Bachelors or Master's degree in computer science Maths statistics or related field.Expertise with designing complex Data Models and Data Engineering...

Job descriptionKey ResponsibilitiesCreate and maintain optimal data pipeline architecture. Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build...

We are seeking a data scientist for the Soccer Operations department with D.C. United.Analyze data from all aspects of soccer operationsCollaborate within strategy and analytics department, as well as across soccer operations departmentsPrepare written and/or automated reports for presentation to soccer operations personnelBachelor's degree or higher in...

As a Senior DevOps/Site Reliability Engineer you willAdvise clients on best practices to improve reliability observability and scalability of cloud workloads Develop test and implement high availability and disaster recovery solutions Write automated run-books and play-books to perform repetitive management tasks Implement capacity planning incident...

What we are looking for M.S. in a quantitative discipline (Business Analytics Engineering Operations Research Mathematics Computer Science Statistics etc.) with a minimum 2 years of relevant work experience Profound understanding of data structure and database management and real-world experience with large-scale databases Proficiency in SQL Python R and/or...

Description Leidos is looking for a highly-motivated, first-class Data Specialist II to add to our busy team supporting the Litigation Support Section of the Antitrust Division of the U.S. Department of Justice. The location is 450 5th Street NW, Washington, DC. This job is on-site in Washington, D.C. at Judiciary Square office. After client approval, may...

Every great story has a new beginning, and yours starts here.Welcome to Warner Bros. Discovery... the stuff dreams are made of.Who We Are... When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved...

Summary: This position, reporting to the Senior Director, Business Strategy & Analytics, is responsible for managing ETL (extract, transform, load) pipelines, ensuring seamless data flow and accessibility across Nationals revenue and marketing departments. This technical role requires expertise in data engineering, system optimization, and an understanding...

This is a hybrid position which requires 8 days/month in the office. You can be based in our office in Washington DC; WRI Global Office (US). Existing work authorization is required at the time of application submission as WRI is unable to sponsor any visa work sponsorship for this position.About the Program:WRI's Food, Land, and Water (FLW) program focuses...

U.S. News & World Report is a multifaceted digital media company dedicated to helping citizens, consumers, business leaders and policy officials make important decisions in their lives.We publish independent reporting, rankings, data journalism and advice that has earned the trust of our readers and users for 90 years.Learn more about our Diversity, Equity...

A Washington, D.C. startup is looking for a Senior Software Engineer to join their growing team.They have build a SaaS social platform. They have merged the benefits of an educational and informative content with the high quality content of streaming services. Their platform includes games that are architected from currently existing board games, educational...

Summary Digital Forensics Engineers analyze data from ongoing cyber-attacks, provide information on threat mitigations, and write code to help develop information recovery techniques.Duties As a Digital Forensic Engineer (DFE) for CIA, you will focus on the Agency's toughest technology challenges and cyber threats. DFEs are energetic and enthusiastic...

Job descriptionRequired Technical and Professional ExpertiseMinimum 1-5 years of experience in IT Inudstry Window Services Proficient in development using and C# sharp Versioning through TFS Experience with IBM FileNet P8/BPM XML(Including schemas) XSLT(stylesheet) Hands on DataCap Installation Configuration and Migration Experience with paper document to...