Bigdata Spark Developer

3 weeks ago


Bethesda, United States Futran Tech Solutions Pvt. Ltd. Full time
Bigdata Spark developer

Bethesda, Maryland (Onsite role)

Contract role

JOB SUMMARY
Spark Scala knowledge is very important for a big and complex engagement currently being handled. The client is currently setting up AWS DR instance. Underlying tools such as Spark/Scala, Oozie, Postgre and Couchbase. Need a technical team member with hands-on experience to implement and setup big-data eco-system in DR instance.

JOB RESPONSIBILITIES
  • # Create Scala/Spark jobs for data transformation and aggregation
  • # Shall be able to understand and modify the underlying Scala framework as needed
  • # Should be able to understand Spark Streaming jobs and how to work with in-memory Spark state and process messages for near-real time system
  • # Spark query tuning and performance optimization
  • # SQL database integration especially with Postgre and Couchbase
  • # Solve various technical problems in the project in a collaborative manner under specified timeline with minimal guidance and review
  • # Responsible for implementing diverse engineering tasks including gap, data, and impact analysis
  • # Independently perform low-level design configuration, code customization, refactoring and review
  • # Gain expertise and demonstrate high levels of skills in design, review, development, testing, build and deployment stages of the software life cycle
  • # Ensure adequate documentation and provide assistance as a reliable engineer to all stakeholders

  • Bigdata Developer

    1 week ago


    Bethesda, United States Diverse Lynx Full time

    Role name: Developer Role Description: Bigdata with AWS & Snowflake Competencies: Digital : BigData and Hadoop Ecosystems Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability,...

  • Bigdata Developer

    5 days ago


    Bethesda, United States Diverse Lynx Full time

    Role name: Developer Role Description: Bigdata with AWS & Snowflake Competencies: Digital : BigData and Hadoop Ecosystems Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability,...


  • Bethesda, United States Diverse Lynx Full time

    Job Title: BigData Snowflake Developer Location: Bethesda, MD Duration: FulltimeMust-Have Technical/Functional Skills. Hands on experience in Hadoop, Spark or AWS Redshift, Athena, Glue or Snowflake Strong SQL and Stored Procedure skills and is comfortable operating with relational and non-relational data models and structure. Comfortable working on Linux...


  • Bethesda, United States Futran Tech Solutions Pvt. Ltd. Full time

    Tech Lead - Snowflake , Big Data, AWS , Scala #Technical Skills Required Must Snowflake exp Experience on Snowflake , Scala , AWS , Airflow & Nifi other Big Data Projects Experience in working on Cloud Implementations, AWS ecosystem - S3, EC2,... Good knowledge of Hadoop ecosystem tools - Hive, HBase, Pig, ... Knowledge of NiFi, Kafka, Snowflake...


  • Bethesda, United States SysMind Tech Full time

    Incident management, Problem management, change management using ServiceNow tool. Modifies and maintains existing systems to address changes in business processes. Performs research, analysis, design, creation and implementation of business systems to meet current and future user requirements. Monitoring and improve application performance Co-ordinate with...


  • Bethesda, United States SysMind Tech Full time

    Incident management, Problem management, change management using ServiceNow tool. Modifies and maintains existing systems to address changes in business processes. Performs research, analysis, design, creation and implementation of business systems to meet current and future user requirements. Monitoring and improve application performance Co-ordinate with...

  • Software Architect

    5 days ago


    Bethesda, United States TWO95 International Full time

    Job Title: Software Architect Location: Bethesda, MD (3-4 days a week onsite, can be remote after that) Duration: 4 + Months Requirements: Experience with technologies like: SPARK (or any other stream processing framework like Flume) KAFKA Elastic Search (or any search engine like Solr) No SQL database (Couchbase, Mongo etc., but Couchbase highly preferred...


  • Bethesda, Maryland, United States TWO95 International Full time

    About TWO95 InternationalWe are a leading international organization seeking an experienced Senior Enterprise Data Architect to join our team.Estimated Salary:$125,000 - $170,000 per year based on location and experience.Job DescriptionThis is a 4+ month contract opportunity with the possibility of extension. The successful candidate will work remotely or...

  • Software Architect

    4 months ago


    Bethesda, United States TWO95 International Full time

    Job Title: Software Architect Location: Bethesda, MD (3-4 days a week onsite, can be remote after that) Duration: 4 + Months Requirements: Experience with technologies like a. SPARK (or any other stream processing framework like Flume) b. KAFKA c. Elastic Search (or any search engine like Solr) d. No SQL database (Couchbase, Mongo etc. but Couchbase highly...

  • Software Architect

    3 weeks ago


    Bethesda, United States Two95 International Inc. Full time

    Job Title: Software ArchitectLocation: Bethesda, MD (3-4 days a week onsite, can be remote after that)Duration: 4 + MonthsRequirements:Experience with technologies like:SPARK (or any other stream processing framework like Flume)KAFKAElastic Search (or any search engine like Solr)No SQL database (Couchbase, Mongo etc., but Couchbase highly preferred over...


  • Bethesda, United States TWO95 International Full time

    Title: Senior Associate Engineer (KAFKA) Location: Bethesda, MD Position: Contract Rate: Open Description:- • SPARK (or any other stream processing framework like Flume but SPARK & SPARK Streaming preferred) • Elastic Search (any other search engine will work too like Solr and Lucidworks but ElasticSearch is highly preferred over others) • KAFKA (or...

  • Big Data Lead

    1 month ago


    Bethesda, United States KRG Technologies Inc. Full time

    Any combination of the below technical skills:Processing & StreamingSpark, Storm, Samza, KafkaSearch ServersElastic Search, Lucene, SolrAdditional InformationProfessional Experience PreferredKnowledge/experience of cloud computing infrastructure (e.g., Amazon Web Services EC2, Elastic MapReduce, Azure)Good to have experience in application development and...

  • Data Scientist

    1 month ago


    Bethesda, United States Manhattan Strategy Group Full time

    DescriptionMSG is a small-disadvantaged, social sciences consulting firm specializing in research and evaluation, policy analysis, and technical assistance (TA). We pride ourselves on rigorous and innovative qualitative and quantitative data collection, management, analysis, and reporting. Our work is with multiple Departments, including education, labor,...


  • Bethesda, Maryland, United States Total Wine & More Full time

    Job Overview: As a key contributor to Total Wine & More's growth, we're seeking an In-Store Marketing Leader who can spark joy with our customers and communities. We offer opportunities for professional development and provide the tools necessary for success.Estimated Salary: $85,000 - $110,000 per year.About Us: At Total Wine & More, we're passionate about...


  • Bethesda, Maryland, United States Two95 International Inc. Full time

    Two95 International Inc. is seeking a highly skilled Enterprise Data Architect to lead the design and development of our data processing systems.With a strong focus on innovation and collaboration, this role will play a key part in shaping our enterprise applications and driving business growth.Salary: $140,000 - $160,000 per year (dependent on experience),...


  • Bethesda, Maryland, United States KRG Technologies Inc. Full time

    About KRG Technologies Inc.We are a forward-thinking organization seeking an experienced professional to lead our data science team.Job SummaryThe Data Science Team Lead will be responsible for overseeing the development and implementation of data-driven solutions across various business functions.Key Responsibilities:Lead a team of data scientists and...


  • Bethesda, United States Booz Allen Hamilton Full time

    Job Number: R0197583Data Architect, Senior Manager The Opportunity: For an organization to transform today's digital world, we need to properly collect, store, and organize data. Effective data management can enable more efficient operations, yielding more growth. As a data architect, you know how to apply your creative thinking and analytical mindset to...


  • Bethesda, United States Booz Allen Hamilton Full time

    Job Number: R0197583Data Architect, Senior Manager The Opportunity: For an organization to transform today's digital world, we need to properly collect, store, and organize data. Effective data management can enable more efficient operations, yielding more growth. As a data architect, you know how to apply your creative thinking and analytical mindset to...

  • Lead Data Architect

    1 week ago


    Bethesda, Maryland, United States Marriott Full time

    Job OverviewAs a Lead Data Architect for Market Mix Modeling at Marriott International, you will play a pivotal role in devising and implementing strategies to optimize data operations, drive informed business decisions, and enhance marketing effectiveness.Key ResponsibilitiesDesign and develop effective marketing data infrastructure to support analytics and...


  • Bethesda, Maryland, United States Scout Solutions Inc Defunct Full time

    We are seeking a highly skilled Data Integration Specialist to join our team at Scout Solutions Inc Defunct. This role is based in Bethesda, MD (Hybrid) and requires an active Secret clearance with the ability to obtain and maintain a TS/SCI with Polygraph.The estimated salary for this position is $120,000 - $180,000 per year, commensurate with...