Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- `REGISTER hdfs:////user/labuser/mysql_jar/mysql-connector-java-5.1.44-bin.jar;
- REGISTER /opt/cloudera/parcels/CDH/lib/pig/piggybank.jar;
- dataset = LOAD '/user/labuser/word_count2_eg' USING PigStorage() as (lines:chararray);
- words = FOREACH dataset GENERATE FLATTEN(TOKENIZE(lines)) as word;
- wgroup = GROUP words by word;
- wcount = FOREACH wgroup GENERATE group as dwords, COUNT(words) as dcount;
- wsort = ORDER wcount by dcount DESC;
- STORE wsort into 'web_rank' USING org.apache.pig.piggybank.storage.DBStorage('com.mysql.jdbc.Driver','jdbc:mysql://x.x.x.x/pig_eg','user','password','insert into web_rank(words,total)values(?,?)' );`
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement