Big Data Engineer w/ElasticSearch experience TS/SCI

divh2Big Data Engineer W/Elasticsearch Experience (Ts/Sci)/h2pLocation: Ashburn, VA w/telework available/ppWe are looking for a highly skilled Data Engineer w/ElasticSearch experience to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure supports business needs and enables advanced analytics and data-driven decision-making./ppNinja Analytics is an information technology company that provides analytical and software development services to companies with Anti-Money Laundering (AML), fraud detection, trade surveillance, and systems integration, documentation, and governance needs. We provide an exciting, challenging, and rewarding work experience. We select people based on ability, attitude, character, skill, and training without discrimination regarding age, race, color, marital status, national origin, political belief, religious beliefs, or a disability that does not prohibit performance of essential job functions. Ninja employees enjoy competitive wages, paid time off, paid holidays, as well as health and welfare benefits. Our work environment is comfortable, orderly, safe, and partially remote (2 days per week on-site). Ninja Analytics treats all employees with respect, courtesy, and consideration./ppKey Responsibilities:/pulliDesign and develop scalable, robust, and high-performance data pipelines and data storage solutions./liliArchitect and implement data models and schemas optimized for both performance and scalability./liliDevelop and maintain ETL (Extract, Transform, Load) processes to ingest data from various sources, including structured and unstructured data./liliImplement data transformation and cleaning procedures to ensure data quality and consistency./liliOptimize data processing workflows to ensure efficient resource utilization and minimize latency./liliUtilize big data technologies such as Hadoop, Databricks, Spark SQL, Kafka, and Hive to process and analyze large datasets./liliIntegrate data from multiple sources, including databases, APIs, and third-party data providers./liliManage and maintain data lakes and data warehouses, ensuring data is organized and accessible for analysis./liliWork closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs./liliProvide technical guidance and support to team members and other departments as needed./liliStay updated with the latest industry trends and best practices in big data engineering./liliContinuously improve data processing techniques and tools to enhance the overall efficiency and effectiveness of the data engineering team./liliFamiliarity with containerization and orchestration tools (e.g., Docker, Kubernetes)./li/ulpQualifications:/pulliBachelors or Masters degree in Computer Science, Engineering, or a related field./liliProven experience as a Big Data Engineer or in a similar role, with a strong focus on big data technologies and data processing./liliMinimum 9 to 12 years of experience, depending upon education./liliPreferred: Certification in big data or cloud technologies./li/ulpRequired Technical Skills:/pulliProficiency in programming languages such as Java, Scala, or Python./liliStrong experience with big data technologies and frameworks (e.g., Hadoop, Databricks, Spark SQL, Kafka, Hive)./liliKnowledge of database systems, both SQL (e.g., PostgreSQL, MySQL, Oracle) and NoSQL (e.g., Cassandra, MongoDB)./liliImplement and maintain Elasticsearch clusters, ensuring data availability, reliability, and consistency across distributed environments./liliIntegrate Elasticsearch with other big data tools and frameworks, such as Apache Kafka, Hadoop, and Spark, to streamline data processing pipelines./liliExperience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services./liliKnowledge of data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake./li/ulpRequired Soft Skills:/pulliExcellent analytical and problem-solving skills./liliStrong verbal and written communication skills./liliAbility to work effectively both independently and as part of a team./liliStrong organizational skills and the ability to manage multiple tasks and priorities./lipSecurity Clearance:/ppSelected applicants must be a current US Citizen and must have an active Top-Secret security clearance with recent background investigation (within the last five years), or current enrollment in continuous evaluation./p/ul/div