Big Data

/ Research

Big Data


Center for Nondestructive Evaluation

Big Data and Hadoop Research lab is designed to provide knowledge and skills to become a successful Hadoop Developer. The following are the details of configuration of the peripherals and licensed software.

S.NO System Configuration Quantity
1 Big data appliance with multicore SDMOS,DB SERVER,WEB SERVER 01
2 Data scientist and web analyst cloud stations 30
3 Network switches-Rack mount 03
4 12 U rack 19”/1000D , With power panel and side panels 01
5 Data analyst license 60
6 Management station license 02
7 Data synchronization licenses 60
8 Big Data ICCP Licenses 60
9 RDP Licenses 60

Objectives
1. Master the concepts of Hadoop Distributed File System and MapReduce framework
2. Setup a Hadoop Cluster
3. Understand Data Loading Techniques using Sqoop and Flume
4. Program in MapReduce (Both MRv1 and MRv2)
5. Learn to write Complex MapReduce programs
6. Program in YARN (MRv2)
7. Perform Data Analytics using Pig and Hive
8. Implement HBase, MapReduce Integration, Advanced Usage and Advanced Indexing
9. Have a good understanding of ZooKeeper service
10. New features in Hadoop 2.0 -- YARN, HDFS Federation, NameNode High Availability
11. Implement best Practices for Hadoop Development and Debugging
12. Implement a Hadoop Project
13. Work on a Real Life Project on Big Data Analytics and gain Hands on Project Experience