Big Data Architect

3 weeks ago

Strongsville, United States Diverse Lynx Full time
Job Title: Big Data Architect
Location: Strongsville OH//Onsite
Duration: Full Time-Only

JOB DESCRIPTION:
Big Data Architect
  • Big Data Architect, Cloudera Big Data Tool stack (Hive, Impala, OoZie), Pyspark, Teradata, Shell Script, Unix programing, Hadoop.
  • 8+ years of data engineering/architecture experience in Waterfall and Agile Methodology, with a proven track record of delivering complex data solutions, preferably in the financial sector.
  • Proficiency in Python for advanced data analysis, scripting, automation, and integration with Big Data platforms and ecosystems.
  • Strong SQL experience (Oracle, Hive, Impala) in designing and implementing complex data models, DDLs, and DMLs, with a focus on performance optimization and scalability.
  • Proficiency in shell scripting for automation, task orchestration, and system integration in Unix/Linux environments.
  • Expertise in Cloudera Big Data Technologies, including Cloudera Distribution of Hadoop (CDP), Apache Hadoop, Apache Spark, Apache Hive, Apache Impala, and Apache HBase, with hands-on experience in deploying, configuring, and optimizing these technologies for large-scale data processing and analytics.
  • In-depth knowledge of data governance policies, metadata management, and regulatory compliance requirements, with a focus on protecting sensitive data and ensuring data privacy and security.
  • Proven experience migrating data from relational databases to Hadoop platforms, with a deep understanding of data migration strategies, tools, and best practices.
  • Ability to integrate complex big data infrastructure with diverse systems, applications, and data sources, using industry-standard APIs, connectors, and integration patterns.
  • Familiarity with data encryption tools and techniques, including Protegrity, for securing data at rest and in transit, and ensuring compliance with industry regulations and data protection standards.
  • Experience working with development tools like Jenkins for continuous integration, deployment, and pipeline automation, streamlining the software development lifecycle and ensuring rapid delivery of high-quality solutions.
  • Proficiency in Apache Oozie for workflow management, job scheduling, and orchestration of complex data processing workflows in Hadoop ecosystems, ensuring reliable and efficient execution of data pipelines and batch processing jobs.
  • Hands-on experience with ELK (Elasticsearch, Logstash, Kibana) stack, including configuration, customization, and management of Kibana dashboards for real-time monitoring and visualization of system metrics and application logs.
  • Effective communication, presentation, and organizational skills, with the ability to articulate complex technical concepts to diverse audiences and influence stakeholders at all levels of the organization.
  • Proficiency in Microsoft Visio, Excel, PowerPoint, and Word, with the ability to create compelling visualizations, documentation, and presentations to support decision-making and knowledge sharing.
  • Equivalent work experience, with a strong academic background in data management, analytics, or a related discipline.
  • Demonstrated leadership, analytical, and problem-solving skills, with a track record of driving innovation, fostering collaboration, and delivering results in dynamic, fast-paced environments.
  • Excellent written and oral communication skills, with the ability to convey complex technical concepts clearly and persuasively to technical and non-technical audiences.
  • Proven ability to work independently and as part of a high-performing team, with a collaborative and customer-centric approach to problem-solving and decision-making.
  • Commitment to continuous learning and professional development, with a passion for staying abreast of emerging technologies, trends, and best practices in data management, analytics, and related fields.
  • Strong critical thinking and decision-making abilities, with the capacity to prioritize competing demands, discern critical from minor issues, and innovate creative solutions to complex challenges.


Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Specialty Software Engineer Lead/ Hadoop Big Data Lead/ Only W2/ C2H

    2 weeks ago

    Strongsville, United States DVI Technologies, Inc. Full time

    Role: Specialty Software Engineer LeadPosition Location: 1st Preference - Strongsville/Cleveland/Columbus OH2nd Preference - Remaining HubsPittsburgh, PABirmingham, AlabamaDallas, TXPhoenix, AZAbility to work remote: Hybrid - 3 office / 2 remoteAcceptable time zone(s): Central/EasternDURATION: 3 months (C2H On W2) Job Description:Summary: Responsible for...

  • Specialty Software Engineer Lead

    6 days ago

    Strongsville, United States System One Full time

    Job Title - Specialty Software Engineer Lead Location - 1st Preference - Strongsville/Cleveland/Columbus OH 2nd Preference - Remaining Hubs Pittsburgh, PA Birmingham, Alabama Dallas, TX Phoenix, AZ Job Summary – Responsible for the provisioning of any IT development, analysis, Information management (DBA), or QA requiring specialized knowledge of a niche...

  • Specialty Software Engineer Lead

    2 weeks ago

    Strongsville, United States System One Holdings, LLC Full time

    Job Title - Specialty Software Engineer Lead Location - 1st Preference - Strongsville/Cleveland/Columbus OH 2nd Preference - Remaining Hubs Pittsburgh, PA Birmingham, Alabama Dallas, TX Phoenix, AZ Job Summary - Responsible for the provisioning of any IT development, analysis, Information management (DBA), or QA requiring specialized knowledge of a niche...

  • Software Engineer

    2 weeks ago

    Strongsville, United States Artech Full time

    Software Engineer Sr. Location: Pittsburgh PA / Cleveland OH Hybrid 3 days min in office/week Shift Times/Preferred Time Zone 8-5 pm EST Length of Assignment 6 months, possibility of extension Key responsibilities: Interact with Business in understanding requirements of current tech stack Modify Tech stack to provide business solutions Using technology...

  • Hadoop Developer

    2 weeks ago

    Strongsville, United States SSI People Full time

    Location: Strongsville/Cleveland/Columbus OH/ Phoenix, AZ/ Pittsburgh, PA/ Dallas, TX/ Birmingham, ALDuration: 6 Months with possible extension.Contract Type: W2 Contract Key Responsibilities:Attend daily standups, spring planning, and sprint retrospective sessions and any ad hoc meetings.Coding development and unit testing. Job Description:Responsible for...

  • W2 Contract-Hadoop Developer at OH, PA--only

    2 weeks ago

    Strongsville, United States USG, Inc. Full time

    Hi, Greetings!! We have an Immediate opening for Hadoop Developer. Please go through the requirement and reply with your updated profile, contact details, and your availability if you would be interested in it. Title: Hadoop Developer Location: Strongsville, OH or Pittsburgh, PA Duration: 6 to 12 months Required Skills Hands on experience in...

  • Python Developer

    1 month ago

    Strongsville, OH, United States Tata Consultancy Services Full time

    Job Title: Python Developer Location: Strongsville OH, Pittsburgh, PA Salary Range: $80000K - 90000K Mandatory Skills: Python development with javascript/jquery, Rest API, exp with change process, Scrum, deployment process Also exp with SQL Roles & Responsibilities: * Python Developer * Strong experience in Python programming with data intensive...

  • Python Developer

    1 month ago

    Strongsville, OH, United States Tata Consultancy Services Full time

    Job Title: Python Developer Location: Strongsville OH, Pittsburgh, PA Salary Range: $80000K - 90000K Mandatory Skills: Python development with javascript/jquery, Rest API, exp with change process, Scrum, deployment process Also exp with SQL Roles & Responsibilities: Python DeveloperStrong experience in Python programming with data intensive...

  • Process Engineer, Electrical

    7 days ago

    Strongsville, United States MOMENTIVE PERFORMANCE MATERIALS QUARTZ, INC. Full time

    About Momentive Technologies Momentive Technologies delivers purity that inspires progress. Leveraging a nearly 75-year legacy of innovation, our ultra-high-purity products help enable high-quality processing and production for a wide range of applications in the semiconductor, photovoltaic, lighting, aerospace, water purification, pharmaceutical, consumer...

  • Global Procurement Director

    2 weeks ago

    Strongsville, United States MOMENTIVE PERFORMANCE MATERIALS QUARTZ, INC. Full time

    Momentive Performance Materials Quartz, Inc. Global Procurement Director Strongsville , Ohio Apply Now About Momentive TechnologiesMomentive Technologies delivers purity that inspires progress. Leveraging a nearly 75-year legacy of innovation, our ultra-high-purity products help enable high-quality processing and production for a wide range of applications...