Current jobs related to Lead Big Data Engineer - Rockville - Tential

  • Data Engineer

    3 months ago


    Rockville, United States ASCENDING Full time

    Job DescriptionJob DescriptionFull-time, Remote - Location Requirement: Must be located in the Eastern Time ZoneAvailable for W-2 or 1099 Individual. Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to join their team of technologists to build and contribute...


  • Rockville, Maryland, United States Ethereum Technologies LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine LearningJob Title: Machine Learning EngineerLocation:Duration: 11 MonthsDomain Exposure:Work Authorization:Client: To Be Discussed LaterEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)Ethereum Technologies LLC is seeking a skilled Machine Learning Engineer to join our...


  • Rockville, Maryland, United States Blockchain Technologies. LLC Full time

    Job OverviewSpecialized Area: Artificial Intelligence and Machine LearningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 11 MonthsEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)Blockchain Technologies, LLC is seeking a skilled Machine Learning Engineer to join our team of experts in...

  • Data SDET

    4 weeks ago


    Rockville, United States ConsultNet Full time

    Patterns SDETLocation: remote anywhere in the continental USContract to Hire, Long term Contract Job Description: Our client is a major financial regulatory body.  This role is in one of their anomaly detection organizations that is scanning over 235 billion market events per day.  Our client has built machine learning and rule based “patterns” that...

  • Data SDET

    1 month ago


    Rockville, United States ConsultNet Full time

    Patterns SDETLocation: remote anywhere in the continental USContract to Hire, Long term Contract Job Description: Our client is a major financial regulatory body.  This role is in one of their anomaly detection organizations that is scanning over 235 billion market events per day.  Our client has built machine learning and rule based “patterns” that...


  • Rockville, Maryland, United States Robotics Technologies LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine LearningJob Title: Machine Learning EngineerEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)Robotics Technologies LLC is seeking a skilled Machine Learning Engineer to join our team of engineers and data scientists in developing advanced algorithms for time series, text,...


  • Rockville, Maryland, United States Quantum Technologies. LLC Full time

    Job OverviewSpecialized Area: Artificial Intelligence and Machine LearningJob Title: Machine Learning EngineerLocation: Remote or On-SiteDuration: 11 MonthsDomain Exposure: Big Data, Cloud Computing, and CybersecurityWork Authorization: W-2 (Consultant must be on our company payroll. C2C is not allowed)Client: ConfidentialEmployment Type: Full-timeQuantum...

  • Lead Systems Engineer

    2 months ago


    Rockville, Maryland, United States BAE Systems Full time

    Job Description BAE Systems is seeking an experienced lead systems engineer to join our Integrated Defense Solutions team in an exciting program supporting the U.S. Navy's next generation of strategic deterrent and integrated combat systems. Serving as one of our lead System Engineers, you will lead multi-disciplinary teams of engineers in developing and...


  • Rockville, Maryland, United States General Dynamics Information Technology Full time

    Job Title: Senior Software Engineer at General Dynamics Information TechnologySummary:As a key member of our engineering team, you will be responsible for optimizing software development processes to ensure the security and reliability of our products. You will design, deploy, and maintain secure cloud-based systems and services to support the development of...


  • Rockville, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionSalary: $20 - $25 / hourT & E Tester -  TSAJob Summary/DescriptionADS is seeking personnel at various skill levels who are available on short notice to provide testing services for several days to weeks at domestic airport locations. Testers must possess or be able to acquire the licenses, permits, skills and resources required...


  • Rockville, United States ConsultNet Full time

    Senior Backend Java Engineer (Remote) Location: Remote anywhere in the continental US (lower 48 states). Cannot work outside of the U.S. Contract to Hire, Long term Contract Job Description: We are supporting a Senior Director in our client's big data department. Our client has a host of initiatives and they're looking for strong engineer with big data...


  • Rockville, Maryland, United States Acquired Data Solutions Full time

    Job OverviewPosition: Intern / Co-op: Integration Testing Engineer - Hardware/SoftwareRole SummaryAcquired Data Solutions is in search of an engineering intern with expertise in automated programming. Candidates should possess familiarity with testing and measurement instruments utilized in laboratory and manufacturing testing environments.Programming...


  • Rockville, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionSalary: Intern / Co-op: Test/Integration Engineer - Hardware/SoftwareJob Summary/DescriptionAcquired Data Solutions is seeking an engineering intern with automated programming experience.Candidates must be familiar with test and measure instruments used in laboratories and manufacturingtest environments.Programming experience in...


  • Rockville, United States Cloud Analytics Technologies, LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 11 MonthsDomain Exposure: To Be Discussed LaterWork Authorization: To Be Discussed LaterClient: To Be Discussed LaterEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)Intelligent...


  • Rockville, United States Automation Technologies LLC Full time

    Job OverviewJob ID: J36993Specialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be Discussed LaterDuration: 11 MonthsDomain Exposure: Work AuthorizationClient: To Be Discussed LaterEmployment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed)Intelligent Automation, Inc. (IAI) is looking for a junior to...


  • Rockville, Maryland, United States Leidos Full time

    Position OverviewLeidos is in search of a Senior Software Engineering Lead with a TS/SCI clearance to enhance our efforts in the unification and optimization of Tasking, Collection, Processing, Exploitation, and Dissemination (TCPED) of Open Source Intelligence (OSINT) across the Department of Defense (DoD) and Intelligence Community (IC). This role involves...


  • Rockville, United States Blockchain Technologies. LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters.Job OverviewSpecialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be...


  • Rockville, United States Blockchain Technologies. LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters.Job OverviewSpecialized Area: Machine learningJob Title: Machine Learning EngineerLocation: To Be...


  • Rockville, Maryland, United States USAJobs Full time

    DutiesThe successful candidate will perform the full range of Sr. Reactor Systems Engineer (Data Scientist) duties.Such duties include but are not limited to:1. Serving as a technical authority independently performing the most complex nuclear safety research using data science and AI techniques. As the senior technical expert, develops solutions to reactor...


  • Rockville, United States Robotics Prcocess Automation, LLC Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/third-party recruiters. Job Overview Job ID: J36993 Specialized Area: Machine learning Job Title: Machine Learning Engineer...

Lead Big Data Engineer

4 months ago


Rockville, United States Tential Full time

Lead Big Data Developer
Are you passionate in data? Do you like working in a challenging environment where massive volume of data is ingested and processed every day? Are you a continuous learner who wants to learn new tools and technologies in evolving big data and data science technology? Do you have passion in detecting data anomalies in large datasets? Do you expect the best from yourself and those around you?

We are looking for lead big data developer for ETL project in our enterprise Transparency Services group. Big data developer will work on designing, ingesting, storing, validating and disseminating, after transforming data in a consumable format, for business intelligence teams and data analysts to get deeper business insight from the data.

Job Responsibilities

  • Understand complex business requirements
  • Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
  • Develop automated unit tests, functional tests and performance tests.
  • Maintain optimal data pipeline architecture
  • Design ETL jobs for optimal execution in AWS cloud environment
  • Reduce processing time and cost of ETL workloads
  • Lead peer reviews and design/code review meetings
  • Provide support for production support operations team
  • Implement data quality checks.
  • Identify areas where machine learning can be used to identify data anomalies

Experience & Qualifications
  • 7+ years of experience in programming language Java or Scala
  • 7+ years of experience in ETL projects
  • 5+ years of experience in big data projects
  • 3+ years of experience with API development (REST API's)
  • Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology
  • Strong and creative analytical and problem-solving skills

Required Technical Skills & Knowledge
  • Strong experience in Java or Scala
  • Strong experience in big data technologies like AWS EMR, AWS EKS, Apache Spark
  • Strong experience with serverless technologies like AWS Dynamo DB, AWS Lambda
  • Strong experience in processing with JSON and csv files
  • Must be able to write complex SQL queries
  • Experience in performance tuning and optimization
  • Familiar with columnar storage formats (ORC, Parquet) and various compression techniques
  • Experience in writing Unix shell scripts
  • Unit testing using JUnit or ScalaTest
  • Git/Maven/Gradle
  • Code Reviews
  • Experience with CI/CD pipelines
  • Agile

The following skills a plus:
  • AWS Cloud
  • BPM/ AWS Step Functions
  • Python scripting
  • Performance testing tools like Gatling or JMeter

#LI-WB
#Dice