Qualifications:

The Candidate must be a Citizen/Permanent Resident of USA and will have an expert understanding of Linux, Hadoop Ecosystem and associated infrastructure. Knowledge of setting up and configuring Kerberos, Spark, R Studio, Kafka, Flume, Shiny, Ranger, Oozie, NiFI etc. is a must Should have a solid understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks Should be able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups Solid Understanding on premise and Cloud network architectures

Responsibilities:

Will work fairly independently, and performs complex support services with the IT Enterprise infrastructure teams, ensuring operability, capacity and reliability for the Big Data System. Will assist in planning, design, support, implementation and troubleshooting activities. Will work with Developers and Architects to support an optimal & reliable Big Data Infrastructure. Will be on call and may need to work on evenings/weekends as required. Will be responsible for implementation and ongoing administration of Hadoop infrastructure, align with the Architect to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments Diligently team with developers to guarantee high data quality and availability and collaborate with application teams & users to perform Hadoop updates, patches, version upgrades when required Work with Vendor support teams on support tasks and troubleshoot system issues. Specific job includes but not limited to • Setup new Hadoop cluster(s) • Maintain exiting Hadoop cluster by adding and removing nodes, set up security, adding new users, perform periodic security monitoring/auditing by testing HDFS, Hive, HBase, Yarn and IBM Big SQL access • Performance tuning of Hadoop clusters and Spark processes, Screen Hadoop cluster for job performances and capacity planning, Monitor Hadoop cluster connectivity and security, set up and monitor users of the system • Manage and review Hadoop log files. • File system management and monitoring

Saxon Chatbot