Sr. Big Data Developer

3 weeks ago

Windsor Mill, United States Omm IT Solutions Full time
Job Description
Please note:
  • Selected candidate must reside within two (2) hours of the client's Headquarters in Woodlawn, MD
  • Selected candidate must be willing to work on-site at least 2 days a week.
Position Description:
  • The candidate will be responsible for Design, build and maintenance of security-enabled Big Data workflows/pipelines to process billions of records into and out of our Hadoop Distributed File System (HDFS).
  • The candidate will engage in sprint requirements and design discussions.
  • The candidate will be proactive in troubleshooting and resolving data processing issues.
  • The candidate should be highly accountable, self-starter; possess strong sense of urgency; can work autonomously with limited direction.
Key Required Skills:

Extensive experience in Design, implementation; support data ingestion, and consumption pipelines for enterprise-scale datasets using Big Data tools, such as Kafka, Spark, Oozie, Hive, MapReduce, Flume, Pig, Scala, Python, and Java

Requirements

Basic Qualifications:
  • Bachelor's Degree in Computer Science, Mathematics, Engineering or a related field with 7+ years of experience.
  • Masters or Doctorate degree may substitute for required experience.
  • 7+ years experience in Hadoop, bigdata, kafka, data analysis.
  • Must be able to obtain and maintain a Public Trust. Contract requirement.
Required Skills:
  • Extensive working experience with HDFS, Spark, Spark Streaming, Oozie, Hive, Kafka, Kafka Message Queues, Splunk, Flume, Pig, Scala, and Sqoop.
  • Excellent knowledge and experience with Java/J2EE programming including Hadoop MapReduce.
  • Experience with Object Oriented Design (OOD), Object-oriented programming (OOP) and development, data structures and design patterns.
  • Strong knowledge, implementation skills, and experience with security processes involving Java-Hadoop communication, Spark Streaming, and Kafka.
  • Experience working in highly productive Agile/Scrum software development environment using tools like Version One and ability to apply best practices with industry standards throughout the software development phase.
  • Experience with REST API development using Spring Boot framework and JWT Security.
  • Extensive experience with Linux environment and development using Shell Script and Python.
  • Proficiency working in Cloud-based development environment using OpenShift containers and Jenkins CI/CD pipeline.
  • Experience with traditional relational databases as well as NoSQL database design and troubleshooting (HBase, MongoDB, and PostgreSQL).
  • Experience with version control software such as Git/Bitbucket.
  • Experience with complex programming, program debugging, data analysis, problem analysis and resolution issues within HDFS.
  • Communication skills to present ideas and concepts effectively; strong and proven problem-solving skills.
  • Strong technical and analytical documentation skills.
  • Self-starter, highly motivated individual, a team player who adapts to a dynamic work environment, and the ability to mentor others.
  • Able to multi-task and work in a dynamic, fast-pace environment.
  • Ability to investigate/research issues, determines impact, and provide solutionsStrong knowledge, implementation skills, and experience with security processes involving Java-Hadoop communication, Spark Streaming, and Kafka.
  • Experience working in highly productive Agile/Scrum software development environment using tools like Version One and ability to apply best practices with industry standards throughout the software development phase.
  • Experience with REST API development using Spring Boot framework and JWT Security.
  • Extensive experience with Linux environment and development using Shell Script and Python.
  • Proficiency working in Cloud-based development environment using OpenShift containers and Jenkins CI/CD pipeline.
  • Experience with traditional relational databases as well as NoSQL database design and troubleshooting (HBase, MongoDB, and PostgreSQL).
Desired Skills:
  • Experience running on a cloud environment with Cloud Computing such as AWS.
  • Exposure to writing Technical White Papers and systems design documents.
  • Prior experience with Federal or State government IT projects

  • Sr .Net Developer

    1 week ago

    Windsor Mill, United States Omm IT Solutions Full time

    Job Description Please Note: Selected candidate must reside within two (2) hours of the client's Headquarters in Woodlawn, MD Selected candidate must be willing to work on-site at least 2 days a week. Position Description: Design and develop software applications using functional requirements. Develop highly innovative UI design, Web components, achieved...

  • Sr .Net Developer

    2 days ago

    Windsor Mill, United States Omm IT Solutions Full time

    Job Description Please Note: Selected candidate must reside within two (2) hours of the client's Headquarters in Woodlawn, MD Selected candidate must be willing to work on-site at least 2 days a week. Position Description: Design and develop software applications using functional requirements. Develop highly innovative UI design, Web components, achieved...

  • Sr. Data engineer

    3 days ago

    Windsor Locks, United States Diverse Lynx Full time

    Sr. Data engineer Hybrid - Hartford, CT 1. Pyspark 2. Snowflake 3. AWS Summary: 7+ years of pyspark & Snowflake Experience 3 years of Experience in Could migration engagement Experience on AWS services such as EMR, S3 is preferred Experience on Snowflake is required Knowledge to operate with defect management tools such as JIRA QC, Rally, etc. Ability to...

  • Sr. Net Developer

    1 week ago

    Fort Mill, United States TalentBridge Full time

    Hi,Hope you are doing great!Title: Sr. Net DeveloperLocation: Fort Mill, SC (Hybrid) only Locals to Charlotte, NC and Fort Mills, SCNote : NO Corp to CorpJob Description: Job Overview: Responsibilities: Thought leadership for system design using Domain Driven Design techniques. Familiar and interested in Event Sourcing architecture. Strong API design skills...

  • Sr. Net Developer

    11 hours ago

    Fort Mill, United States TalentBridge Full time

    Hi,Hope you are doing great!Title: Sr. Net DeveloperLocation: Fort Mill, SC (Hybrid) only Locals to Charlotte, NC and Fort Mills, SCNote : NO Corp to CorpJob Description: Job Overview: Responsibilities: • Thought leadership for system design using Domain Driven Design techniques. • Familiar and interested in Event Sourcing architecture. • Strong API...

  • Sr. Net Developer

    2 weeks ago

    Fort Mill, United States TalentBridge Full time

    Hi,Hope you are doing great!Title: Sr. Net DeveloperLocation: Fort Mill, SC (Hybrid) only Locals to Charlotte, NC and Fort Mills, SCNote : NO Corp to CorpJob Description: Job Overview: Responsibilities: • Thought leadership for system design using Domain Driven Design techniques. • Familiar and interested in Event Sourcing architecture. • Strong API...

  • Sr. Net Developer

    2 weeks ago

    Fort Mill, United States TalentBridge Full time

    Hi,Hope you are doing great!Title: Sr. Net DeveloperLocation: Fort Mill, SC (Hybrid) only Locals to Charlotte, NC and Fort Mills, SCNote : NO Corp to CorpJob Description: Job Overview: Responsibilities: • Thought leadership for system design using Domain Driven Design techniques. • Familiar and interested in Event Sourcing architecture. • Strong API...

  • Sr MDM Developer

    2 days ago

    Fort Mill, United States Lorven technologies Full time

    Job DescriptionJob DescriptionRole: Sr MDM Developer - MARKIT EDM IHS Cloud EngineerLocation: Fort Mill, SC (Onsite)Job Type: ContractMust-Have Skills: 5+ years of development in Master Data Management (MDM) using IHS Markit/Cadis. Strong Experience in designing and developing the Core Matcher component in MarkIT. Strong Experience in designing and...

  • Data Governance Engineer

    5 days ago

    Windsor Mill, United States Omm IT Solutions Full time

    Job Description *** Selected candidate must reside within two (2) hours ofClient's Headquarters in Woodlawn, MD *** Selected candidate must be willing to work on-site at least 2 days a week. Position Description: Ability to create, execute and troubleshoot resources/connections for metadata loads and profiling. Experience to create connections/resources...

  • Sr Engineer

    2 days ago

    Windsor Mill, United States exeloncorp Full time

    Description: We're powering a cleaner, brighter future. Exelon is leading the energy transformation, and we're calling all problem solvers, innovators, community builders and change makers. Work with us to deliver solutions that make our diverse cities and communities stronger, healthier and more resilient. We're powered by purpose-driven people like you who...

  • Sr. Automation Engineer

    3 weeks ago

    Windsor Mill, United States Omm IT Solutions Full time

    Job Description *** Selected candidate must reside within two (2) hours of Federal Headquarters in Woodlawn, MD *** Selected candidate must be willing to work on-site at least 2 days a week. Position Description: Lead the development of highly innovative products/solutions, achieved through collaboration and dialogue with other experts in the field. The...

  • Sr Workday Integration Developer

    2 weeks ago

    Pensyls Mill, United States Soltex systens Full time

    Job DescriptionJob Description Workday Developer:ResponsibilitiesDesigns, builds, tests, and deploys integration solutions for Workday.Troubleshoots integration issues requiring in depth expertise in the Workday solution.Conduct unit and end-to-end testing of interfaces to ensure they function as designed based on functional and technical...

  • Sr. Microservices Lead Developer

    1 week ago

    Mill Valley, United States Omni Inclusive Full time

    Primary Responsibilities: These roles include, but are not limited to analysis, design, coding, engineering, testing, debugging, standards, methods, tools analysis, documentation, research and development, maintenance, new development, operations, and delivery. • Evaluating new tools, new techniques, strategies • Automation of common tasks; build of...

  • Sr. Microservices Lead Developer

    2 days ago

    Mill Valley, United States Omni Inclusive Full time

    Primary Responsibilities: These roles include, but are not limited to analysis, design, coding, engineering, testing, debugging, standards, methods, tools analysis, documentation, research and development, maintenance, new development, operations, and delivery. • Evaluating new tools, new techniques, strategies • Automation of common tasks; build of...

  • Python Developer

    2 weeks ago

    Windsor Locks, United States Diverse Lynx Full time

    Role: Python Developer Location: Plano, TX / Morris Plains, NJ / Hartford, CT - Remote to Start Duration: Full-time Only Start Date: ASAP Job Description: Here the individual will be expected to part of all stages of software sign, build, test and deployment in a CICD environment. The individual Function as hands-on member of the team. Maintain a...

  • Senior Data Scientist

    5 days ago

    Windsor, United States SS&C Technologies Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • AI Governance Specialist

    2 weeks ago

    Windsor Mill, United States Omm IT Solutions Full time

    Job Description Please Note: Selected candidate must reside within two (2) hours of the client's Headquarters in Woodlawn, MD Selected candidate must be willing to work on-site at least 2 days a week. Position Description: Collaborate with the customer to develop AI framework, governance and policy. Develop associated standards and guide the customer on...

  • Master Data Planner

    1 week ago

    Windsor, United States QuEST Global Full time

    61692BR Title: Master Data Planner Job Description: Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one,...

  • Master Data Planner

    2 days ago

    Windsor, United States QuEST Global Full time

    61692BR Title: Master Data Planner Job Description: Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one,...

  • Sr Associate Electrical Engineer

    3 weeks ago

    Windsor Locks, United States AZ Full time

    Job DetailsLevelExperiencedJob LocationHartford CT - Hartford, CTPosition TypeFull TimeEducation Level4 Year DegreeTravel PercentageNegligibleJob ShiftDayJob CategoryDesignDescriptionPOSITION SUMMARY:The Sr Associate Electrical Engineer will report directly to the Principal, Electrical Engineering. The position encompasses a variety of responsibilities...