Big Data Engineer

4 weeks ago


Washington, Washington, D.C., United States Atechstar Full time

Job descriptionRoles & Responsibilities You would be responsible for evaluating developing maintaining and testing big data solutions for advanced analytics projects The role would involve big data pre-processing & reporting workflows including collecting parsing managing analyzing and visualizing large sets of data to turn information into business insights The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.

An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.

Qualification & Experience0-1 years of demonstrable experience designing technological solutions to complex data problems developing & testing modular reusable efficient and scalable code to implement those solutions.

Ideally this would include work on the following technologies Expert-level proficiency in at-least one of Java C++ or Python (preferred).

Scala knowledge a strong advantage.

Strong understanding and experience in distributed computing frameworks particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies one or more of Hive Sqoop Avro Flume Oozie Zookeeper etc.

Hands-on experience with Apache Spark and its components (Streaming SQL
  • Big Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Dash techology Full time

    We're looking for a Big Data Engineer who can find creative solutions to tough problems. As a Big Data Engineer you'll create and manage our data infrastructure and tools including collecting storing processing and analyzing our data and data systems. You know how to work quickly and accurately using the best solutions to analyze mass data sets and you know...

  • Big Data Analyst

    5 days ago


    Washington, Washington, D.C., United States Atechstar Full time

    3 years experience in SQL development o 3 years experience in data modeling ETL and Data Warehousing o 3 years experience in designing and developing solutions on AWS platforms o Experience with Service Desk ZenDesk or other support platforms o Experience with Big Data technologies such as Hive/Spark o Experience with Linux scripting o Ability to work in a...

  • Big Data Analyst

    4 weeks ago


    Washington, Washington, D.C., United States Atechstar Full time

    o 3 years experience in SQL development o 3 years experience in data modeling ETL and Data Warehousing o 3 years experience in designing and developing solutions on AWS platforms o Experience with Service Desk ZenDesk or other support platforms o Experience with Big Data technologies such as Hive/Spark o Experience with Linux scripting o Ability to work in a...

  • Big Data Developer

    4 weeks ago


    Washington, Washington, D.C., United States Atechstar Full time

    Job descriptionJD -Mandatory Skills - Spark Scala Big Data Developer required with experience working in Hadoop in technologies including Spark Scala Kafka Scoop Flume and Hive. Candidate also needs to have experience on CI/CD (Jenkins Nexus etc.) and Openshift PaaS implementations and data pipelines for instance through Control-M or any other scheduling...

  • Data Engineer

    2 days ago


    Washington, Washington, D.C., United States Atechstar Full time

    Key Responsibilities Design implement and support applications that provide structured and timely access to actionable business information addressing stakeholder needs. Interface directly with stakeholders gathering requirements and owning automated end-to-end reporting solutions. Partner with analysts data engineers business intelligence engineers and...

  • Data Engineer

    3 weeks ago


    Washington, Washington, D.C., United States Atechstar Full time

    Responsibilities Design build and own all the components of a high-volume data warehouse end to end. Build efficient data models using industry best practices and metadata for ad-hoc and pre-built reporting Provide wing-to-wing data engineering support for project lifecycle execution (design execution and risk assessment) Interface with business customers...


  • Washington, Washington, D.C., United States Atechstar Full time

    Job description Skills RequiredProficient in languages Python.Experience in AWS StackGlue Athena Quick sight RDS Redshift Kafka pySpark.Experience setting up data pipelines archiving data data lakes.Bachelors or Master's degree in computer science Maths statistics or related field.Expertise with designing complex Data Models and Data Engineering...

  • Data Engineer

    2 days ago


    Washington, Washington, D.C., United States Atechstar Full time

    Job descriptionKey ResponsibilitiesCreate and maintain optimal data pipeline architecture. Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build...

  • Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Non-Departmental Agency Full time

    Summary Data Engineers work with data consumers to create and populate optimal data architectures, structures, and systems to meet CIA's business needs. Duties As a Data Engineer for CIA, you will focus on the design, implementation, and operation of data management systems to meet the CIA's business needs. This includes designing how the data will be...


  • Washington, Washington, D.C., United States TPC Energy Fund Full time

    TPC Energy Fund is a proprietary energy trading firm located in Washington, DC. Our business is primarily focused on the wholesale power markets. We combine quantitative analysis, fundamental knowledge of the grid, cutting edge technology and regulatory know-how to shape our success. Our team is young, dynamic, collaborative and results oriented. We are...

  • Software Engineer

    3 weeks ago


    Washington, Washington, D.C., United States Statt Full time

    About Statt:Ever wonder where public policy, legislation, regulations, and ideas come from? We do, too. Statt is a stealth, venture-backed cloud-native startup building a cutting-edge platform powered by big data, machine learning, and NLP to create real-world impact. We are a small but mighty and growing team looking to democratize access to policy and...


  • Washington, Washington, D.C., United States Altana Technologies Full time

    The Opportunity at AltanaThe Implementation team is looking for talented Senior Implementation Data Engineers to help execute on our vision. In this role, you will manage, architect, and contribute to successful customer software deployments on premise in secured environments, design and configure integrations and other customizations based on customer...


  • Washington, Washington, D.C., United States WRI - World Resources Institute Full time

    This is a hybrid position which requires 8 days/month in the office. You can be based in our office in Washington DC; WRI Global Office (US). Existing work authorization is required at the time of application submission as WRI is unable to sponsor any visa work sponsorship for this position.About the Program:WRI's Food, Land, and Water (FLW) program focuses...

  • Azure Data Engineer

    3 weeks ago


    Washington, Washington, D.C., United States Atechstar Full time

    Job description Desired Candidate ProfileExperience with setup of Azure data factory Synapse Azure Data lake Azure Data bricks Azure Cosmos DB Azure Streaming Analytics Event-hub Strong expertise in SQL Experience across end to end data management concepts including Data Quality Meta data Data Security Coding skills (Python additional programming skills such...

  • Data Scientist

    4 weeks ago


    Washington, Washington, D.C., United States D.C. United Full time

    We are seeking a data scientist for the Soccer Operations department with D.C. United.Analyze data from all aspects of soccer operationsCollaborate within strategy and analytics department, as well as across soccer operations departmentsPrepare written and/or automated reports for presentation to soccer operations personnelBachelor's degree or higher in...

  • Data Product Manager

    4 weeks ago


    Washington, Washington, D.C., United States Tivix Full time

    About Kellton Kellton is a global technology company, home to 1800+ minds across 7 countries, delivering industry-leading capabilities centered around new technologies and transforming enterprises for a digital future. At Kellton, our real strength lies in our ability to create technology-agnostic solutions for our clients. We're committed to delivering...

  • Senior Data Analyst

    4 weeks ago


    Washington, Washington, D.C., United States Atechstar Full time

    What we are looking for M.S. in a quantitative discipline (Business Analytics Engineering Operations Research Mathematics Computer Science Statistics etc.) with a minimum 2 years of relevant work experience Profound understanding of data structure and database management and real-world experience with large-scale databases Proficiency in SQL Python R and/or...


  • Washington, Washington, D.C., United States teamworkonline Full time

    Summary: This position, reporting to the Senior Director, Business Strategy & Analytics, is responsible for managing ETL (extract, transform, load) pipelines, ensuring seamless data flow and accessibility across Nationals revenue and marketing departments. This technical role requires expertise in data engineering, system optimization, and an understanding...


  • Washington, Washington, D.C., United States BAE Systems Full time

    Job Description BAE Systems seeks a qualified CommVault Data Protection Engineer with extensive knowledge and experience in designing, developing, configuring, implementing, testing, troubleshooting, deploying, and supporting backup and recovery technical solutions for a large scale federal government enterprise's environment. The candidate shall also server...


  • Washington, Washington, D.C., United States Non-Departmental Agency Full time

    Summary Digital Forensics Engineers analyze data from ongoing cyber-attacks, provide information on threat mitigations, and write code to help develop information recovery techniques.Duties As a Digital Forensic Engineer (DFE) for CIA, you will focus on the Agency's toughest technology challenges and cyber threats. DFEs are energetic and enthusiastic...