Mary had a little lamb its fleece was white as snow and everywhere that Mary went the lamb was sure to go.
Pig Word Count Code
-- Load input from the file named Mary, and call the single -- field in the record 'line'. input = load 'mary' as (line); -- TOKENIZE splits the line into a field for each word. -- flatten will take the collection of records returned by -- TOKENIZE and produce a separate record for each one, calling the single -- field in the record word. words = foreach input generate flatten(TOKENIZE(line)) as word; -- Now group them together by each word. grpd = group words by word; -- Count them. cntd = foreach grpd generate group, COUNT(words); -- Print out the results. dump cntd;
Mary,2 had,1 a,1 little,1 lamb,2 its,1 fleece,1 was,2 white,1 as,1 snow,1 and,1 everywhere,1 that,1 went,1 the,1 sure,1 to,1 go,1