Hadoop/Cloud/Python Analytics Developer
3 months ago
The Advanced Analytics Technical Solutions Developer/Platform Administrator is responsible for supporting our analytics strategy and solutions across critical business areas, using technologies in the disciplines of Data Base, Big Data, Data Science, Artificial Intelligence, Machine Learning and Data Visualization. This role will work as a member of a multi-functional team and participate in design, development, and deployment of analytic solutions.
The candidate must have strong technical, analytical and problem-solving skills. The team member will have exposure to tool administration, installation, configuration, code deployment, security administration, data analysis, querying and troubleshooting. This position will have access to and ensure protection of confidential data. Relocation is not available for this role.
Responsibilities:
-Administer, maintain and deploy analytical solutions using specialized Cluster compute/database/development platforms -
- Hortonworks/Cloudera Hadoop Eco System( Ambari, Cloudera Manager, HDFS, YARN, Map/Reduce, Hive, Sqoop, Pig, Oozie, Zookeeper, Spark, Ranger, Knox etc.).
- Microfocus Vertica Analytics Platform.
- Microsoft Azure (ADLS, Databricks, Datafactory, Integration Runtime, PowerBI etc.)
- Python, R, Anaconda Navigator etc.
- Expertise in product upgrades and migrations (e.g. Hortonworks Data Platform to Cloudera Data Platform (CDP DC Private Cloud)).
- Administer Data Lake Security using Ranger, Knox, Active Directory and Kerberos in a Multifactor Authentication Setup.
- Develop streamlined data pipelines and workflows, to support custom workloads ensuring data quality standards, and automate using CA Autosys R11, Python, Hadoop(e.g. sqoop, hive, spark), Vertica(e.g. Bulk Loader), Microsoft Azure(IR, ADF, Databricks, Azure DevOps, MLFlow & MS SQL Server).
- Administer and monitor DataLake batch and near real-time data processing capabilities.
- Integrate DataLake with Natural Language Processing and visualizations Platforms like(Tableau, Power BI) to provide multiple data streams to enable rich visualizations for Corporate users,.
- Expertise in emerging tools within Advanced Analytics, Big Data and AI technologies including cloud solutions (Azure).
- Working knowledge of Kafka/Nifi, Spark, Storm and other data engineering tools. Experience working with NoSQL databases like HBase, Cassandra.
- Knowledge of Statistical, mathematical, predictive modelling techniques.
- Query, retrieve, integrate and prepare data for profiling and analysis.
-Analyze/Profile various data sets to quickly identify sensitive fields and help in formulating rules for data anonymization and tokenization.
- Collecting descriptive statistics like min, max, count and sum. Collecting data types, length and recurring patterns. Tagging data with keywords, descriptions or categories.
- Performing data quality assessment, risk of performing joins on the data. Discovering metadata and assessing its accuracy.
- Identifying distributions, key candidates, foreign-key candidates, functional dependencies, embedded value dependencies, and performing inter-table analysis.
Build infrastructure to support Advanced Analytics and BigData driven projects/solutions. Assist in installation, configuration and maintenance of BigData/Cloud environments (Hortonworks Hadoop, Microfocus Vertica, Microsoft Azure etc) and manage efficient configuration of all platforms. Analyze all platform level changes, monitor impact for same and provide appropriate technical solutions to resolve all issues efficiently. Administer configuration of all software services in various environments. Provide an efficient interface with various teams and provide appropriate technical support to all teams working on various platforms.
Provide Management with regular and timely status reports and benchmarking metrics of projects, issues, system implementations and upgrades.
Communicate status of issues with both the project team as well as business team in a timely manner.
Create documentation for project status reports, timelines, project issues and risks, change requests, requirements, design, testing plans and test cases as needed.
Define and document application best practices, required standards, processes, and guidelines regarding the use and administration of the BI tools.
Technical interface with IT Local Landscape Application Teams, Enterprise Data Warehouse team as well as various SMEs to identify and resolve issues and remove obstacles in achieving the Advanced analytics initiatives.
Skills:
Analytical Skills
Ability to collect, query data, establish facts and identify trends and variances.
Ability to query databases and perform data analysis
Good Understanding of Database Administration Processes, concepts - Modeling, Query, Security Administration etc.
Working knowledge of database software (DB2, SQL Server, Rapid SQL, etc.).
Must have good SQL writing skills.
Knowledge of information technology systems, infrastructure and operations.
Expertise in Linux System Administration and management.
Knowledge of latest big data technologies.
Knowledge of Hadoop and Vertica Eco System tools in a Linux Environment.
Strong people skills including the ability to interact with employees at all levels
Good to have
Expertise in cloud technologies like Microsoft Azure(HDInsights, Data Bricks, R Server, SQL Data Warehouse, Cosmos DB, Azure ML etc.), AWS etc. Experience with Python, Shell Scripting, Java.
Note: This requirement is for an on-site position with at-least 3 days on-site to start with. Interview Mode: Video Call
Required Skills : Hadoop Experience Experience with Azure Migration Experience
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Other Project Type
Master Job Title :VMS Access Entry
Branch Code :Detroit
-
Hadoop Developer
3 months ago
Farmington Hills, Michigan, United States Logging-in Full timeLogging-in INC is one of the fastest growing IT consulting Firm for fortune 500 clients. We cater to the application development Support services needs of our clients and offer them technology-driven business solutions that meet their goals and corporate objectives.WHY US? Logging-in knows what is in demand in the IT industry. In the wake of providing the...
-
Hadoop Developer
3 months ago
Farmington Hills, United States Logging-in Full timeLogging-in INC is one of the fastest growing IT consulting Firm for fortune 500 clients. We cater to the application development Support services needs of our clients and offer them technology-driven business solutions that meet their goals and corporate objectives.WHY US? Logging-in knows what is in demand in the IT industry. In the wake of providing the...
-
Hadoop Developer
3 months ago
Farmington Hills, United States Logging-in Full timeJob DescriptionWe are looking for a Big Data Engineer that will work on the collecting storing processing and analyzing of huge sets of data.The primary focus will be on choosing optimal solutions to use for these purposes then maintaining implementing and monitoring them.You will also be responsible for integrating them with the architecture used...
-
Hadoop Developer
3 months ago
Farmington Hills MI, United States Logging-in Full timeWe are looking for a Big Data Engineer that will work on the collecting storing processing and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes then maintaining implementing and monitoring them. You will also be responsible for integrating them with the architecture used across the...
-
GCP Looker Lead
1 week ago
Parsippany-Troy Hills, United States Centraprise Full timeJob title: GCP Looker LeadJob Location: Parsippany, NJ - OnsiteJob Type: FulltimeJob Description:Senior application developer with 7+ years of experience to support application development of Time & Pay Data Analytics in Google Cloud Platform. Expect to perform the following:-Conducts systems and requirements analyses to identify project action items.Creates...
-
Farmington, United States Synechron Full timeJob Details:Role: Senior .NET Developer with AWS Cloud and Kubernetes experience]Location: Farmington, CT/ HybridResponsibilities:Responsible for the development and release of business applications, application integrations, microservices, and support of critical business application systems.They will development, implementation, integration, and...
-
Farmington, United States Synechron Full timeJob Details:Role: Senior .NET Developer with AWS Cloud and Kubernetes experience]Location: Farmington, CT/ HybridResponsibilities:Responsible for the development and release of business applications, application integrations, microservices, and support of critical business application systems.They will development, implementation, integration, and...
-
NET Cloud Engineer
4 weeks ago
Farmington, United States Accord Technologies Inc. Full timeJob DescriptionJob DescriptionNET Cloud Engineer (AWS)Location: Farmtington, CT/ Richmond, VA (should be willing to work in any location) This is an Onsite position. Duration: 12 months Position type: W2 contractKey skills needed: AWS cloud capabilities, C#, .NET, SQL, Python, Cloud DevOps. Specific AWS services include S3, Event Bridge, Lambdas (C# and...
-
Net Cloud Engineer AWS
2 weeks ago
Farmington, United States JobRialto Full timeJob summary Responsible for the development and release of business applications, application integrations, microservices, and support of critical business application systems. They will development, implementation, integration, and maintenance of business application systems leveraging AWS cloud-based technologies and services. Key skills in AWS cloud...
-
Hadoop Developer
3 months ago
Farmington Hills, United States Logging-in Full timeLogging-in INC is one of the fastest growing IT consulting Firm for fortune 500 clients. We cater to the application development Support services needs of our clients and offer them technology-driven business solutions that meet their goals and corporate objectives.WHY US?Logging-in knows what is in demand in the IT industry. In the wake of providing the...
-
Cloud Operations Engineer
2 weeks ago
Farmington Hills, Michigan, United States RouteOne Full timeRouteOne is seeking a Cloud Operations Engineer to become an integral part of our team focused on the management and support of both test and production environments. The ideal candidate will possess a robust understanding of integrating cloud methodologies with application deployment strategies. Strong system administration skills, technical expertise, and...
-
Tech Lead AWS cloud Developer
2 weeks ago
Farmington, United States Omni Inclusive Full timeMinimum 10 years overall exp with minimum 7 yrs experience on aws cloud. Minimum 3 yrs exp in terraform. Mature enough to understand the importance of application architecture in coding to terraform and understand what services connect to what. Experience working in a large project setting understanding how diff modules of an app work with each other....
-
Farmington, Connecticut, United States Synechron Full timePosition Overview:Title: Lead .NET Engineer with Cloud and Container ExpertiseLocation: Remote/HybridKey Responsibilities:Oversee the design, development, and deployment of enterprise applications, application integrations, and microservices, ensuring the stability of essential business systems.Engage in the creation, implementation, integration, and upkeep...
-
Data and Analytics Lead
2 months ago
Farmington Hills, United States Star Cutter Company Full timeStar Cutter Company is a family owned, globally recognized, manufacturer of custom round tools and hobs. We are seeking a Data and Analytics Lead to support the organization by overseeing the end-to-end data management and analytics processes within the organization. The ideal candidate will be looking for:A company guided by core values which starts with...
-
Data and Analytics Lead
2 months ago
Farmington Hills, United States Star Cutter Company Full timeStar Cutter Company is a family owned, globally recognized, manufacturer of custom round tools and hobs. We are seeking a Data and Analytics Lead to support the organization by overseeing the end-to-end data management and analytics processes within the organization. The ideal candidate will be looking for:A company guided by core values which starts with...
-
Cloud Solutions Engineer
2 weeks ago
Farmington, Connecticut, United States Accord Technologies Inc. Full timeJob OverviewPosition: Cloud Solutions Engineer - .NET SpecialistCompany: Accord Technologies Inc.Location: Flexible (Onsite position)Contract Type: W2 ContractDuration: 12 monthsKey Responsibilities:The Cloud Solutions Engineer will be tasked with the development and deployment of business applications, application integrations, and microservices. This role...
-
Lead Cloud Solutions Engineer with AWS Expertise
2 weeks ago
Farmington, Connecticut, United States Synechron Full timePosition Overview:Title: Senior AWS Cloud DevOps Engineer [C#/.NET Expertise]Location: Remote/Hybrid Options AvailableKey Responsibilities:Oversee the design, development, and deployment of enterprise applications, microservices, and integration solutions that are critical to business operations.Engage in the creation, integration, and ongoing support of...
-
Farmington, Connecticut, United States Synechron Full timePosition Overview:Title: Lead .NET Engineer with Cloud and Container ExpertiseLocation: Remote/HybridKey Responsibilities:Oversee the design, development, and deployment of enterprise applications, ensuring seamless integration and functionality of microservices.Engage in the implementation and maintenance of business-critical application systems utilizing...
-
Cloud Software Engineer
3 days ago
Hanover Hills, Maryland, United States ManTech Full timeJob SummaryWe are seeking a skilled Cloud Software Engineer to join our dynamic team at ManTech. As a Cloud Software Engineer, you will be responsible for designing, building, and maintaining next-generation cloud-based systems using Kubernetes.Key ResponsibilitiesDesign and Develop Software Solutions: Utilize your expertise in software development to design...
-
Cloud Infrastructure Specialist
4 days ago
Farmington, Utah, United States PACS Inc Full timeAbout the RolePACS Inc is a leading provider of innovative healthcare solutions, dedicated to elevating the post-acute care space through our mission and values. We're committed to creating real change by striving for excellence while staying true to our core principles.Job SummaryWe're seeking a highly skilled IT Systems Engineer to join our team. As a key...
