Big Data Architect

4 weeks ago

Cincinnati, United States Tata Consultancy Services Full time

Skillset:

Cloudera Big Data Tool stack (Hive ,Impala, OoZie) , Pyspark, Teradata, Shell Script, Unix programing, Hadoop

JD:

1. 8+ years of data engineering/architecture experience in Waterfall and Agile Methodology, with a proven track record of delivering complex data solutions, preferably in the financial sector.

2. Proficiency in Python for advanced data analysis, scripting, automation, and integration with Big Data platforms and ecosystems.

3. Strong SQL experience (Oracle, Hive, Impala) in designing and implementing complex data models, DDLs, and DMLs, with a focus on performance optimization and scalability.

4. Proficiency in shell scripting for automation, task orchestration, and system integration in Unix/Linux environments.

5. Expertise in Cloudera Big Data Technologies, including Cloudera Distribution of Hadoop (CDP), Apache Hadoop, Apache Spark, Apache Hive, Apache Impala, and Apache HBase, with hands-on experience in deploying, configuring, and optimizing these technologies for large-scale data processing and analytics.

6. In-depth knowledge of data governance policies, metadata management, and regulatory compliance requirements, with a focus on protecting sensitive data and ensuring data privacy and security.

7. Proven experience migrating data from relational databases to Hadoop platforms, with a deep understanding of data migration strategies, tools, and best practices.

8. Ability to integrate complex big data infrastructure with diverse systems, applications, and data sources, using industry-standard APIs, connectors, and integration patterns.

9. Familiarity with data encryption tools and techniques, including Protegrity, for securing data at rest and in transit, and ensuring compliance with industry regulations and data protection standards.

10. Experience working with development tools like Jenkins for continuous integration, deployment, and pipeline automation, streamlining the software development lifecycle and ensuring rapid delivery of high-quality solutions.

11. Proficiency in Apache Oozie for workflow management, job scheduling, and orchestration of complex data processing workflows in Hadoop ecosystems, ensuring reliable and efficient execution of data pipelines and batch processing jobs.

12. Hands-on experience with ELK (Elasticsearch, Logstash, Kibana) stack, including configuration, customization, and management of Kibana dashboards for real-time monitoring and visualization of system metrics and application logs.

13. Effective communication, presentation, and organizational skills, with the ability to articulate complex technical concepts to diverse audiences and influence stakeholders at all levels of the organization.

14. Proficiency in Microsoft Visio, Excel, PowerPoint, and Word, with the ability to create compelling visualizations, documentation, and presentations to support decision-making and knowledge sharing.

15. Bachelors degree in Computer Science, Information Technology, or a related field, or equivalent work experience, with a strong academic background in data management, analytics, or a related discipline.

  • Senior Data Architect

    5 days ago

    Cincinnati, United States Great American Insurance Company Full time

    Be Here. Be Great. Working for a leader in the insurance industry means opportunity for you. Great American Insurance Group's member companies are subsidiaries of American Financial Group. We combine a "small company" culture where your ideas will be heard with "big company" expertise to help you succeed. With over 30 specialty and property and casualty...

  • Senior Data Architect

    16 hours ago

    Cincinnati, United States Great American Insurance Company Full time

    Be Here. Be Great. Working for a leader in the insurance industry means opportunity for you. Great American Insurance Group's member companies are subsidiaries of American Financial Group. We combine a "small company" culture where your ideas will be heard with "big company" expertise to help you succeed. With over 30 specialty and property and casualty...

  • Senior Data Architect

    2 hours ago

    Cincinnati, United States Great American Insurance Company Full time

    Be Here. Be Great. Working for a leader in the insurance industry means opportunity for you. Great American Insurance Group's member companies are subsidiaries of American Financial Group. We combine a "small company" culture where your ideas will be heard with "big company" expertise to help you succeed. With over 30 specialty and property and casualty...

  • Data Architect

    2 weeks ago

    Cincinnati, United States Capgemini Government Solutions LLC Full time

    Capgemini Government Solutions (CGS) is seeking an experienced Data Architect to join our world-class engineering team in Cincinnati, OH. As a Data Architect at Capgemini, you will have the exceptional opportunity to apply your expertise in designing and handling our clients' data infrastructure, ensuring flawless data management and security. As a Data...

  • Senior Data Architect

    3 hours ago

    Cincinnati, OH, United States Great American Insurance Company Full time

    Be Here. Be Great. Working for a leader in the insurance industry means opportunity for you. Great American Insurance Group's member companies are subsidiaries of American Financial Group. We combine a "small company" culture where your ideas will be heard with "big company" expertise to help you succeed. With over 30 specialty and property and casualty...

  • Senior Data Architect

    2 hours ago

    Cincinnati, OH, United States Great American Insurance Company Full time

    Be Here. Be Great. Working for a leader in the insurance industry means opportunity for you. Great American Insurance Group's member companies are subsidiaries of American Financial Group. We combine a "small company" culture where your ideas will be heard with "big company" expertise to help you succeed. With over 30 specialty and property and casualty...

  • IT Data Architect

    4 weeks ago

    Cincinnati, Ohio, United States FIS Global Full time

    Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor of Computer Science Travel Percentage : 0%Job DescriptionThe world of finance moves fast. At FIS, we're faster. Our teams are empowered to learn, grow, and make an impact–in their careers and communities. We deliver innovation that...

  • IT Data Architect

    1 month ago

    Cincinnati, United States Jobs for Humanity Full time

    Job Description Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor of Computer Science Travel Percentage : 0% Job Description The world of finance moves fast. At FIS, we’re faster. Our teams are empowered to learn, grow, and make an impact–in their careers and communities....

  • Sr. Business Data Architect

    7 days ago

    Cincinnati, United States Munich Re Full time

    Sr. Business Data Architect Company American Modern Insurance Group Location Cincinnati , United States Location: Amelia / Cincinnati, OH (hybrid schedule) - may be open to remote Applicants requiring employer sponsorship of a visa will not be considered for this position. Job Summary We are seeking a highly skilled and experienced Business Data...

  • Sr. Business Data Architect

    2 weeks ago

    Cincinnati, United States Munich Re Full time

    Sr. Business Data Architect Company American Modern Insurance Group Location Cincinnati , United States Location: Amelia / Cincinnati, OH (hybrid schedule) - may be open to remote Applicants requiring employer sponsorship of a visa will not be considered for this position. Job Summary We are seeking a highly skilled and experienced Business Data...

  • Data Architect, Cassandra

    2 weeks ago

    Cincinnati, Ohio, United States TEPHRA Full time

    :Strong Experience in doing Data Modeling and design with Cassandra as the Database.Strong experience in doing design and development on distributed message queues like Kafka.Good understanding of micro-services architecture patterns and experience in building scalable solutions.Do Assessment of current state data maturity of an enterprise and define the...

  • Solution Architect Level 2

    3 weeks ago

    Cincinnati, United States Strategic Data Systems Full time

    05th June, 2024 Architect Level 2 For more than three decades, Strategic Data Systems (SDS) has been a software consultancy firm specializing in strategy, technology, and business transformation for Fortune 100 companies, mid-sized firms, and startups. At SDS, we empower our development teams to address our clients’ critical business challenges by...

  • test data management architect

    23 hours ago

    Cincinnati, United States ScaleneWorks People Solutions LLP Full time

    Job role : TDM ArchitectLocation : Cincinnati, Ohio (Onsite)Job Type: ContractWork with multiple portfolio team to understand Test Data NeedsDevelop and Implement TDM frameworks for data extraction, masking the data as per business security guidelines using IBM OptimIdentify Data for application needs across Mainframe and Distributed Databases (DB2 UDB,...

  • Staff Engineer/Software Architect

    1 week ago

    Cincinnati, United States GE Aerospace Full time

    Job Description Summary Software Architect in Test Systems Engineer will be responsible for designing, validating, and developing software architectures for data acquisition systems used for validating aircraft engines. As part of the Smart Test Cell team, the Software Architect will architect modern software solutions to re-imagine how test cells acquire,...

  • Staff Engineer/Software Architect

    1 month ago

    Cincinnati, United States GE Renewable Energy Power and Aviation Full time

    Job Description SummarySoftware Architect in Test Systems Engineer will be responsible for designing, validating, and developing software architectures for data acquisition systems used for validating aircraft engines. As part of the Smart Test Cell team, the Software Architect will architect modern software solutions to re-imagine how test cells acquire,...

  • Staff Engineer/Software Architect

    4 weeks ago

    Cincinnati, United States GE Renewable Energy Power and Aviation Full time

    Job Description SummarySoftware Architect in Test Systems Engineer will be responsible for designing, validating, and developing software architectures for data acquisition systems used for validating aircraft engines. As part of the Smart Test Cell team, the Software Architect will architect modern software solutions to re-imagine how test cells acquire,...

  • Solution Architect

    2 weeks ago

    Cincinnati, United States Flexton Full time

    Job Title: Solution Architect Location: Cincinnati, OH - Remote Duration: 12 Months Skills - Azure, React JS, SQL Job Description Project: Front End Architect with strong knowledge of React Azure and JAVA Stack Experience. The Candidate will be responsible for designing a solution for data sharing platform on azure, react, java stack. Should be able to come...

  • Solution Architect

    3 weeks ago

    Cincinnati, United States Flexton Inc Full time

    Job Title: Solution Architect Location: Cincinnati, OH - Remote Duration: 12 Months Skills - Azure, React JS, SQL Job Description Project: Front End Architect with strong knowledge of React + Azure and JAVA Stack Experience. The Candidate will be responsible for designing a solution for data sharing platform on azure, react, java stack. Should be able...

  • Big Data Engineer

    3 months ago

    Cincinnati, Ohio, United States Sun Technologies,Inc. Full time

    Requirements Bachelor's degree typically in Computer Science Management Information Systems Mathematics Business Analytics or another STEM degree. 5+ years proven ability of professional data development experience 3+ years proven ability of developing with Hadoop/HDFS 3+ years developing experience with either Java or Python 3+ years experience with...

  • Big Data Engineer

    3 months ago

    Cincinnati, United States Sun Technologies,Inc. Full time

    Requirements Bachelor’s degree typically in Computer Science Management Information Systems Mathematics Business Analytics or another STEM degree. 5+ years proven ability of professional data development experience 3+ years proven ability of developing with Hadoop/HDFS 3+ years developing experience with either Java or Python 3+ years experience with...