hive建立分区表,以当天日期(“2014-08-15”)作为分区依据,hql如下:
CREATE EXTERNAL TABLE IF NOT EXISTS product_sell(
category_id BIGINT,
province_id BIGINT,
product_id BIGINT,
price DOUBLE,
sell_num BIGINT
)
PARTITIONED BY (ds string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LINES TERMINATED BY '\n'
STORED AS TEXTFILE;
然后以日期作为分区依据,插入数据,shell脚本如下:
#!/bin/bash
source /etc/profile;
today=$(date +%Y-%m-%d)
/usr/local/cloud/hive/bin/hive<
这个部分难点在于hive中不知道如何调用形如shell日期变量的方式创建日期分区,mark一下!