Hadoop/Cloud/Python Analytics Developer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
The Advanced
Analytics Technical Solutions Developer/Platform Administrator is responsible
for supporting our analytics strategy and solutions across critical business
areas, using technologies in the disciplines of Data Base, Big Data, Data
Science, Artificial Intelligence, Machine Learning and Data Visualization. This
role will work as a member of a multi-functional team and participate in
design, development, and deployment of analytic solutions.
The candidate must have strong technical,
analytical and problem-solving skills. The team member will have exposure to
tool administration, installation, configuration, code deployment, security
administration, data analysis, querying and troubleshooting. This position will
have access to and ensure protection of confidential data. Relocation is not
available for this role.
Responsibilities:
-Administer, maintain and deploy analytical
solutions using specialized Cluster compute/database/development platforms -
- Hortonworks/Cloudera Hadoop Eco System(
Ambari, Cloudera Manager, HDFS, YARN, Map/Reduce, Hive, Sqoop, Pig, Oozie,
Zookeeper, Spark, Ranger, Knox etc.).
- Microfocus Vertica Analytics Platform.
- Microsoft Azure (ADLS, Databricks,
Datafactory, Integration Runtime, PowerBI etc.)
- Python, R, Anaconda Navigator etc.
- Expertise in product upgrades and migrations
(e.g. Hortonworks Data Platform to Cloudera Data Platform (CDP DC Private
Cloud)).
- Administer Data Lake Security using Ranger,
Knox, Active Directory and Kerberos in a Multifactor Authentication Setup.
- Develop streamlined data pipelines and
workflows, to support custom workloads ensuring data quality standards, and
automate using CA Autosys R11, Python, Hadoop(e.g. sqoop, hive, spark),
Vertica(e.g. Bulk Loader), Microsoft Azure(IR, ADF, Databricks, Azure DevOps,
MLFlow & MS SQL Server).
- Administer and monitor DataLake batch and near
real-time data processing capabilities.
- Integrate DataLake with Natural Language
Processing and visualizations Platforms like(Tableau, Power BI) to provide
multiple data streams to enable rich visualizations for Corporate users,.
- Expertise in emerging tools within Advanced
Analytics, Big Data and AI technologies including cloud solutions (Azure).
- Working knowledge of Kafka/Nifi, Spark, Storm
and other data engineering tools. Experience working with NoSQL databases like
HBase, Cassandra.
- Knowledge of Statistical, mathematical,
predictive modelling techniques.
-Query, retrieve, integrate and prepare data for profiling and analysis.
-Analyze/Profile various data sets to quickly
identify sensitive fields and help in formulating rules for data anonymization
and tokenization.
- Collecting descriptive statistics like min,
max, count and sum. Collecting data types, length and recurring patterns.
Tagging data with keywords, descriptions or categories.
- Performing data quality assessment, risk of
performing joins on the data. Discovering metadata and assessing its accuracy.
- Identifying distributions, key candidates,
foreign-key candidates, functional dependencies, embedded value dependencies,
and performing inter-table analysis.
Build infrastructure to support Advanced
Analytics and BigData driven projects/solutions. Assist in installation,
configuration and maintenance of BigData/Cloud environments (Hortonworks
Hadoop, Microfocus Vertica, Microsoft Azure etc) and manage efficient
configuration of all platforms. Analyze all platform level changes, monitor
impact for same and provide appropriate technical solutions to resolve all
issues efficiently. Administer configuration of all software services in
various environments. Provide an efficient interface with various teams and
provide appropriate technical support to all teams working on various
platforms.
Provide Management with regular and timely
status reports and benchmarking metrics of projects, issues, system
implementations and upgrades.
Communicate status of issues with both the
project team as well as business team in a timely manner.
Create documentation for project status reports,
timelines, project issues and risks, change requests, requirements, design,
testing plans and test cases as needed.
Define and document application best practices,
required standards, processes, and guidelines regarding the use and
administration of the BI tools.
Technical interface with IT Local Landscape
Application Teams, Enterprise Data Warehouse team as well as various SMEs to
identify and resolve issues and remove obstacles in achieving the Advanced
analytics initiatives.
Skills:
Analytical Skills
Ability to collect, query data, establish facts and identify trends and variances.
Ability to query databases and perform data analysis
Good Understanding of Database Administration Processes, concepts – Modeling, Query, Security Administration etc.
Working knowledge of database software (DB2, SQL Server, Rapid SQL, etc.).
Must have good SQL writing skills.
Knowledge of information technology systems, infrastructure and operations.
Expertise in Linux System Administration and management.
Knowledge of latest big data technologies.
Knowledge of Hadoop and Vertica Eco System tools in a Linux Environment.
Strong people skills including the ability to interact with employees at all levels
Good to have
Expertise in cloud technologies like Microsoft
Azure(HDInsights, Data Bricks, R Server, SQL Data Warehouse, Cosmos DB, Azure
ML etc.), AWS etc. Experience with Python, Shell Scripting, Java.
Note: This requirement is for an on-site
position with at-least 3 days on-site to start with. Interview Mode: Video
Call
Required Skills : Hadoop Experience Experience with Azure Migration Experience
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Other Project Type
Master Job Title :VMS Access Entry
Branch Code :Detroit