sqoop抽取问题汇总
23.2.5. MySQL: Import of TINYINT(1) from MySQL behaves strangelyProblem: Sqoop is treating TINYINT(1) columns as booleans, which is for example causing issues with HIVE import. This is because by default the MySQL JDBC connector maps the TINYINT(1) to java.sql.Types.B...
mysql故障排查
mysql -h**** -u*** -p*** -P3306 ***ERROR 1205 (HY000) at line 10208: Lock wait timeout exceeded; try restarting transactionSolution: Add / modify the parameter TransactionDeadlockDetectionTimeout in config.iniDefault value = 1200 millisecondsChanged the value to TransactionDead...
mysql开窗函数
开窗函数又叫OLAP函数。mysql没有开窗算法,等价写法:select modify_name,shotel_id,modify_time,op_type from (select if(@part1=ff.modify_name&&@part2=ff.shotel_id,@rank:=@rank+1,@rank:=1) rank, @part1:=ff.modify_name modify_name, @part2:=ff.shotel_id shotel_id, ff.modi...
hive开窗函数
银行会员流水为例:create table hive_sum(id string COMMENT '会员ID',bank_name string COMMENT '银行名称',create_time string COMMENT '交易时间',amount double COMMENT '交易金额')COMMENT 'hive_sum顶级应用'ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'LINES TERMINATED BY '\n';load data local inpat...