DEPRECATED: Use of this script to execute hdfs command is deprecated.
21:54本人安装的hadoop版本是0.21.0的,但每次执行命令时都会显示下面的信息 [hadoop@masterhadoop]$ hadoop dfs -lsDEPRECATED: Use ofthis script. to execute hdfs command is deprecat...
hadoop集群安装
对Hadoop的集群来说,可以分成两大类角色:Master 和 Slave,前者主要配置NameNode和JobTracker 的角色,负责总管分布式数据和分解任务的执行,后者配置DataNode和TaskTracker 的角色,负责分布式数据存储以及任务的执行。 系统版本rhel-server-6.3-x86_64 hadoop 版本hadoop-0.20.2.tar.gz // 我用其他版本时总出问题,这个版本却很不错,不知大家什么个情况 JDKjdk-7u7-linux-x64.tar.gz IP地址分配 IP主机名192.168.100.16master192.168.100.17slave1 配置host Namenode(master)的机器,需要配置集群中所有机器的
WARN mapred.JobClient: Error reading task outputNo route to host
主从节点的/etc/hosts文件配置如下[hadoop@master ~]$ cat /etc/hosts127.0.0.1 localhost localdomain.localhost::1 localhost6.localdomain6 localhost6 192.168.100.11 master.oracle.com master192.168.100.12 slave1.oracle.com slave1[hadoop@master ~]$ 在主从节点执行jps都正常:[hadoop@master ~]$ jps // 在主节点执行4690 Jps2413 JobTracker2350 SecondaryNameNode2229 NameNode[hadoop@master ~]$ [hadoop@slave1 ~]$ jps // 在从节点执行2248 TaskTracker27778 Jps2175 DataNode[hadoop@slave1 ~]$ [hadoop@
Bad connection to FS. command aborted.
太坑爹了,我搭建好HADOOP后执行如下命令:[root@slave1 conf]# hadoop fs -ls结果如下: [root@slave1 conf]# hadoop fs -ls12/10/15 17:07:18 INFO ipc.Client: Retrying connect to server: master/192.168.100.11:9000. Already tried 0 time(s).12/10/15 17:07:19 INFO ipc.Client: Retrying connect to server: master/192.168.100.11:9000. Already tried 1 time(s).12/10/15 17:07:20 INFO ipc.Client: Retrying connect to server: master/192.168.100.11:9000. Already tried 2 time(s).12/10/15 17:07:21 INFO ipc.Clien
v$sysstat和v$sesstat区别
v$sysstat和v$sesstat差别如下:v$sesstat只保存session数据,而v$sysstat则保存所有sessions的累积值。v$sesstat只是暂存数据,session退出后数据即清空。v$sysstat则是累积的,只有当实例被shutdown才会清空。v$sesstat不包括统计项名称,如果要获得统计项名称则必须与v$sysstat或v$statname连接查询获得。[@more@]
Oracle 集中备份脚本
0级备份完整脚本#!/bin/bashbegintime=`date`export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1export ORACLE_SID=calandexport BACKUP_DIR=/arch/backup/calandexport PATH=$PATH:$ORACLE_HOME/binrq=` date +"20%y"-"%m"-"%d"-"%H":"%M":"%S" `/u01/app/oracle/product/10.2.0/db_1/bin/rman target sys/oracle@caland log=/backup_scripts/caland/log/backup_0_$rq.log<<EOFrun{CONFIGURE RETENTION POLICY TO REDUNDANCY