ITPub博客

首页 > 大数据 > 数据分析 > hbase全备增量备份脚本

hbase全备增量备份脚本

原创 数据分析 作者:生活怪盗 时间:2017-09-08 18:14:27 0 删除 编辑
[hadoop@robot-pbs-hadoop-master backup_hbase]$ cat fullbk_endtime.txt
1504606501092
1504755001094
1504839001095
[hadoop@robot-pbs-hadoop-master backup_hbase]$ cat hbase_fullbk.sh
#!/bash/bin
source /home/hadoop/.bashrc
starttime=`date +%s%m%w`
echo $starttime >>/data/backup_hbase/backup_hbase/fullbk_endtime.txt
tablename='didiiml_audio'
backup_date=`date  +%Y-%m-%d-%k-%M-%S`
hbase org.apache.hadoop.hbase.mapreduce.Export $tablename /bak/$backup_date'_fullbk' 1
hdfs dfs -get /bak/$backup_date$tablename'_fullbk' /data/backup_hbase/ 
hdfs dfs -rmr /bak/$backup_date$tablename'_fullbk'
[hadoop@robot-pbs-hadoop-master backup_hbase]$ cat hbase_increbk.sh
#!/bash/bin
source /home/hadoop/.bashrc
start_time=`tail -n 1 /data/backup_hbase/backup_hbase/fullbk_endtime.txt`
end_time=`date +%s%m%w`
echo $end_time >>/data/backup_hbase/backup_hbase/fullbk_endtime.txt
tablename='didiiml_audio'
backup_date=`date  +%Y-%m-%d-%k-%M-%S`
hbase org.apache.hadoop.hbase.mapreduce.Export $tablename /bak/$backup_date$tablename'_increbk' 1 $start_time $end_time
hdfs dfs -get /bak/$backup_date$tablename'_increbk' /data/backup_hbase/
hdfs dfs -rmr /bak/$backup_date$tablename'_increbk'
[hadoop@robot-pbs-hadoop-master backup_hbase]$

来自 “ ITPUB博客 ” ,链接:https://blog.itpub.net/25911813/viewspace-2144715/ ,如需转载,请注明出处,否则将追究法律责任。

上一篇: zabbix监控mysql
请登录后发表评论 登录
全部评论

注册时间:2016-11-14

  • 博文量
    19
  • 访问量
    17005